ETL Basics

After this skill you can…

• Write a Python ETL pipeline with pandas
• Handle schema changes and bad data gracefully
• Log pipeline runs and alert on failures

Prerequisites

Watch (10 videos)

Automate ETL Pipelines

Coursera · beginner hands-on

→ Build ETL pipelines→ Automate data updates

Data Engineering with Delta Lake on Databricks

Coursera · intermediate hands-on

→ Build production-ready data pipelines with Delta Lake→ Design ETL workflows using Medallion Architecture

Data Integration and ETL with Talend

Coursera · intermediate hands-on

→ Extract data from various sources→ Transform data for analysis→ Load data into a target system

Building Batch Pipelines in Cloud Data Fusion

Coursera · intermediate hands-on

→ Build ETL pipelines→ Apply data transformations

Analytics in 15: Save Time! Try No-Code Data Movement and Transformation

AWS Developers · beginner hands-on

→ Use no-code interface for ETL→ Generate ETL code automatically

Data Engineering with Scala and Spark

Coursera · intermediate hands-on

→ Build scalable data pipelines with Scala and Spark→ Optimize data pipeline performance in cloud environments

Talend Data Integration: Build & Automate Workflows

Coursera · intermediate hands-on

→ Install Talend Data Integration Studio→ Create and execute jobs with Talend

Talend ETL: Design, Optimize & Apply Workflows

Coursera · advanced hands-on

→ Design ETL workflows in Talend→ Optimize jobs with filters and logging

ETL Processing on Google Cloud Using Dataflow and BigQuery

Coursera · intermediate hands-on

→ Build ETL pipelines with Dataflow→ Ingest data into BigQuery

Learn ETL Pipelines in Databricks in Under 1 Hour | Data Engineering in Databricks

Alex The Analyst · beginner hands-on

→ Build ETL pipelines in Databricks→ Orchestrate jobs for data automation

Read (10 articles)