From the course: Hands-On Introduction: Data Engineering

Schalten Sie den kompletten Kurs noch heute frei

Join today to access over 23,400 courses taught by industry experts.

ETL in Airflow

ETL in Airflow

From the course: Hands-On Introduction: Data Engineering

Start my 1-month free trial Buy for my team

ETL in Airflow

"

- [Presenter] Today we're going to be talking about the ETL paradigm and how it relates to Airflow. ETL stands for extract, transform, and load, and is used extensively in the data engineering world. The ETL process involves extracting data from a source system, transforming that data, and then loading it into a final system. This allows data practitioners to clearly define a workflow for working with data in the enterprise. In the past, organizations relied on discreet and difficult to manage jobs across vendors, platforms, and data centers to prepare data for analysis, but with ETL, we can streamline the process and make it more manageable. One tool we'll be using in this course is Airflow. Airflow is a powerful data engineering tool that is flexible and easy to use. One of the great things about Airflow is the community offerings that have been built around it. Enterprises who are just beginning their journey in Airflow…

Inhalt