SRE Data Pipelines & Integrity: Data Pipelines

Site reliability engineers often find data processing complex as demands for faster more reliable and extra cost-effective results continue to evolve. In this course youll explore techniques and best practices for managing a data pipeline. Youll start by examining the various pipeline application models and their recommended uses. Youll then learn how to define and measure service level objectives plan for dependency failures and create and maintain pipeline documentation. Next youll outline the phases of a pipeline development lifecycles typical release flow before investigating more challenging topics such as managing data processing pipelines using big data with simple data pipelines and using periodic pipeline patterns. Lastly youll delve into the components of Google Workflow and recognize how to work with this system.