Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Pluralsight

Productionalizing Data Pipelines with Apache Airflow

via Pluralsight

Overview

This course will teach you how to master production-grade Data Pipelines with ease within Apache Airflow.


Production-grade Data Pipelines are hard to get right. Even when they are done, every update is complex due to its central piece in every organization's infrastructure. In this course, Productionalizaing Data Pipelines with Apache Airflow 1, you’ll learn to master them using Apache Airflow. First, you’ll explore what Airflow is and how it creates Data Pipelines. Next, you’ll discover how to make your pipelines more resilient and predictable. Finally, you’ll learn how to distribute tasks with Celery and Kubernetes Executors. When you’re finished with this course, you’ll have the skills and knowledge of Apache Airflow needed to make any Data Pipelines production grade.

Syllabus

  • Course Overview 1min
  • Introducing Apache Airflow 10mins
  • Dissecting the Components of a Pipeline 34mins
  • Demystifying Common DAGs Pitfalls 26mins
  • Abstracting Functionality 27mins
  • Scaling Airflow 27mins
  • Final Thoughts 6mins

Taught by

Axel Sirota

Reviews

3.8 rating at Pluralsight based on 85 ratings

Start your review of Productionalizing Data Pipelines with Apache Airflow

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.