SQL for Data Engineering - Full Course for Beginners

Luke Barousse · Beginner ·🔄 Data Engineering ·4mo ago

Key Takeaways

This video course covers SQL for data engineering, including SQL foundations, data analysis, and data warehousing, using tools like DuckDB and GitHub.

Original Description

Power your data pipelines with SerpApi 👉 https://serpapi.link/luke 🏆 Supporter Access: Problems, Certificate, & More 👉 https://lukeb.co/sql-de My FREE Crash Course to be a Data Analyst 👉 https://lukebarousse.com/5daycourse 𝗖𝗼𝘂𝗿𝘀𝗲 𝗥𝗲𝘀𝗼𝘂𝗿𝗰𝗲𝘀 ▔▔▔▔▔▔▔▔ GitHub Repo 👉 https://lukeb.co/sql-de-github Project #1 👉 https://lukeb.co/sql-de-project1 Project #2 👉 https://lukeb.co/sql-de-project2 MotherDuck Signup 👉 https://lukeb.co/motherduck DuckDB Install (Don't use DuckDB.org) 👉 https://lukeb.co/duckdb Attach the data_jobs database: ATTACH 'md:_share/data_jobs/87603155-cdc7-4c80-85ad-3a6b0d760d93' AS data_jobs; 0️⃣ 𝗖𝗼𝘂𝗿𝘀𝗲 𝗜𝗻𝘁𝗿𝗼 00:00:00 Course Intro 00:06:11 What is SQL? 00:12:15 Data & Pipeline Intro 1️⃣ 𝗦𝗤𝗟 𝗙𝗼𝘂𝗻𝗱𝗮𝘁𝗶𝗼𝗻𝘀 00:18:39 SQL & Dataset Setup 00:32:39 Basic Keywords 00:52:06 Comparison & Logical Operators 01:14:52 Wildcards & Aliases 01:26:10 Arithmetic Operators 01:38:10 Aggregate Functions 01:55:01 Terminal Intro 02:28:32 Local DuckDB Intro 03:06:24 VS Code Intro 03:28:56 Data Modeling Pt.1 03:49:10 JOINs 04:11:34 Order of Execution 📊 𝗘𝘅𝗽𝗹𝗼𝗿𝗮𝘁𝗼𝗿𝘆 𝗗𝗮𝘁𝗮 𝗔𝗻𝗮𝗹𝘆𝘀𝗶𝘀 𝘄/ 𝗦𝗤𝗟 — 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 #1 04:30:51 Project #1 Intro 04:38:54 EDA #1 In-Demand Skills 04:47:27 EDA #2 Highest Paying Skills 04:56:02 EDA #3 Most Optimal Skills 05:10:58 README.md Build 05:27:27 Git & GitHub Pt.1 06:03:49 Share Project #1 2️⃣ 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝗤𝗟 06:10:27 Data Types 06:27:17 DDL & DML Pt.1 07:04:57 DDL & DML Pt.2 07:30:28 Subqueries and CTEs 08:06:07 DDL & DML Pt.3 08:44:55 Data Modeling Pt.2 09:08:07 CASE Expressions 09:28:54 Date Functions 09:51:19 SET Operators 10:08:04 Text & NULL Functions 10:26:16 Window Functions 11:00:04 Nested Functions 11:50:17 Git & GitHub Pt.2 🏗️ 𝗗𝗮𝘁𝗮 𝗪𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗲 & 𝗘𝗧𝗟 𝗣𝗶𝗽𝗲𝗹𝗶𝗻𝗲 — 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 #2 12:32:36 Project #2 Intro 12:43:08 Build Data Warehouse 13:21:00 Build Flat Table Mart 13:40:03 Build Skills Mart 14:07:45 Build Priority Mart 14:29:40 README
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Luke Barousse · Luke Barousse · 0 of 60

← Previous Next →
1 Connect Google Sheets to Tableau & Joining Data - Tableau Tutorial P.1
Connect Google Sheets to Tableau & Joining Data - Tableau Tutorial P.1
Luke Barousse
2 How To Use Tableau Desktop Controls - Tableau Tutorial P.2
How To Use Tableau Desktop Controls - Tableau Tutorial P.2
Luke Barousse
3 Dimensions Vs Measures  (Blue Vs Green Data) - Tableau Tutorial P.3
Dimensions Vs Measures (Blue Vs Green Data) - Tableau Tutorial P.3
Luke Barousse
4 Create Stacked Bar Chart (and any other visuals EASILY!) w/ Show Me! - Tableau Tutorial P.4
Create Stacked Bar Chart (and any other visuals EASILY!) w/ Show Me! - Tableau Tutorial P.4
Luke Barousse
5 Conditional Format Tables in Tableau (Like Excel!) - Tableau Tutorial P.5
Conditional Format Tables in Tableau (Like Excel!) - Tableau Tutorial P.5
Luke Barousse
6 Calculated Fields in Tableau (Formulas & IF Statements) - Tableau Tutorial P.6
Calculated Fields in Tableau (Formulas & IF Statements) - Tableau Tutorial P.6
Luke Barousse
7 Parameters (Create & Use in Calculated Fields and/or Visuals) - Tableau Tutorial P.7
Parameters (Create & Use in Calculated Fields and/or Visuals) - Tableau Tutorial P.7
Luke Barousse
8 Totals, Average Lines, & Trend Lines (Analytics Pane) - Tableau Tutorial P.8
Totals, Average Lines, & Trend Lines (Analytics Pane) - Tableau Tutorial P.8
Luke Barousse
9 How To Create a Dashboard - Tableau Tutorial P.9
How To Create a Dashboard - Tableau Tutorial P.9
Luke Barousse
10 Upload your dashboard to Tableau Public  - Tableau Tutorial P.10
Upload your dashboard to Tableau Public - Tableau Tutorial P.10
Luke Barousse
11 Install Python for Data Science on Mac & Windows (PC) with Anaconda - P.1
Install Python for Data Science on Mac & Windows (PC) with Anaconda - P.1
Luke Barousse
12 How to run Python for Data Science - Editors vs IDEs - P.2
How to run Python for Data Science - Editors vs IDEs - P.2
Luke Barousse
13 Install VS Code with Python for Data Science / Data Analysis - P.3
Install VS Code with Python for Data Science / Data Analysis - P.3
Luke Barousse
14 Understanding Virtual Environments for Data Science / Data Analysis - P.4
Understanding Virtual Environments for Data Science / Data Analysis - P.4
Luke Barousse
15 Using VS Code with Python for Data Science / Data Analysis - P.5
Using VS Code with Python for Data Science / Data Analysis - P.5
Luke Barousse
16 Python for Data Science / Analysis  ft. 'The Office' Dataset - P.0
Python for Data Science / Analysis ft. 'The Office' Dataset - P.0
Luke Barousse
17 Python Objects frequently used in Data Science / Data Analysis - P.1
Python Objects frequently used in Data Science / Data Analysis - P.1
Luke Barousse
18 Python If Statements for Data Science / Data Analysis - P.2
Python If Statements for Data Science / Data Analysis - P.2
Luke Barousse
19 Python For & While Loops for Data Science / Data Analysis - P.3
Python For & While Loops for Data Science / Data Analysis - P.3
Luke Barousse
20 Python List Comprehension for Data Science / Data Analysis - P.4
Python List Comprehension for Data Science / Data Analysis - P.4
Luke Barousse
21 Python Functions for Data Science / Data Analysis - P.5
Python Functions for Data Science / Data Analysis - P.5
Luke Barousse
22 Lambda Functions for Data Science / Data Analysis - Python P.6
Lambda Functions for Data Science / Data Analysis - Python P.6
Luke Barousse
23 How NOT to learn Python for Data Science
How NOT to learn Python for Data Science
Luke Barousse
24 What is Business Intelligence (BI)? 📊😅
What is Business Intelligence (BI)? 📊😅
Luke Barousse
25 Top 3️⃣ Technical Skills for Business Intelligence 📚📊
Top 3️⃣ Technical Skills for Business Intelligence 📚📊
Luke Barousse
26 Top Non-technical Skills for Business Intelligence 📊👨🏼‍💻
Top Non-technical Skills for Business Intelligence 📊👨🏼‍💻
Luke Barousse
27 M1 vs Intel Mac for Data Science
M1 vs Intel Mac for Data Science
Luke Barousse
28 M1 vs Intel Mac for Excel 📈👨🏼‍💻
M1 vs Intel Mac for Excel 📈👨🏼‍💻
Luke Barousse
29 M1 vs Intel Mac for Python 🐍👨🏼‍💻
M1 vs Intel Mac for Python 🐍👨🏼‍💻
Luke Barousse
30 M1 vs Intel Mac for Business Intelligence Tools 💻📊
M1 vs Intel Mac for Business Intelligence Tools 💻📊
Luke Barousse
31 M1 Macbook Air vs Pro (8 vs 16 GB) for Data Science
M1 Macbook Air vs Pro (8 vs 16 GB) for Data Science
Luke Barousse
32 Python for M1 Mac vs Intel (SPOILER: M1 is 2x faster)
Python for M1 Mac vs Intel (SPOILER: M1 is 2x faster)
Luke Barousse
33 Data Analyst's WFH Setup & Upgrades
Data Analyst's WFH Setup & Upgrades
Luke Barousse
34 Windows on the M1 Mac - What are your options?
Windows on the M1 Mac - What are your options?
Luke Barousse
35 Install your favorite Windows app on M1 Mac - ft. Parallels
Install your favorite Windows app on M1 Mac - ft. Parallels
Luke Barousse
36 Data Science shortcuts for Mac
Data Science shortcuts for Mac
Luke Barousse
37 Day in the life of a data analyst
Day in the life of a data analyst
Luke Barousse
38 Power BI vs Tableau - Best BI Tool
Power BI vs Tableau - Best BI Tool
Luke Barousse
39 Mac Vs PC - BEST for Data Science
Mac Vs PC - BEST for Data Science
Luke Barousse
40 Data Scientist vs Data Analyst (funny!)
Data Scientist vs Data Analyst (funny!)
Luke Barousse
41 Become a DATA ANALYST with NO degree?!? The Google Data Analytics Professional Certificate
Become a DATA ANALYST with NO degree?!? The Google Data Analytics Professional Certificate
Luke Barousse
42 Certificates vs Degree for Data Analysts (ft. Google Data Analytics Professional Certificate)
Certificates vs Degree for Data Analysts (ft. Google Data Analytics Professional Certificate)
Luke Barousse
43 Google vs IBM Data Analyst Certificate - BEST Certificate for Data Analysts
Google vs IBM Data Analyst Certificate - BEST Certificate for Data Analysts
Luke Barousse
44 Python Vs R (funny!)
Python Vs R (funny!)
Luke Barousse
45 THIS got me my job as a Data Analyst - My portfolio tip
THIS got me my job as a Data Analyst - My portfolio tip
Luke Barousse
46 I used Python to Count my Bike Jumps!
I used Python to Count my Bike Jumps!
Luke Barousse
47 Standout as a Data Analyst with THIS TOOL
Standout as a Data Analyst with THIS TOOL
Luke Barousse
48 STOP using Spreadsheets for Everything!
STOP using Spreadsheets for Everything!
Luke Barousse
49 Transition into Data Science - My Tips & Story
Transition into Data Science - My Tips & Story
Luke Barousse
50 Get a JOB w/ Google Data Analytics Certificate?!? (ft. Certificate Holders)
Get a JOB w/ Google Data Analytics Certificate?!? (ft. Certificate Holders)
Luke Barousse
51 Staying Motivated in Data Science
Staying Motivated in Data Science
Luke Barousse
52 Data Science - Expectation vs Reality (funny!) - ft. @KenJee_ds
Data Science - Expectation vs Reality (funny!) - ft. @KenJee_ds
Luke Barousse
53 Get NOTICED in Data Science!!! (3 types of GREAT projects)
Get NOTICED in Data Science!!! (3 types of GREAT projects)
Luke Barousse
54 Use THIS to showcase EXPERIENCE in Data Science
Use THIS to showcase EXPERIENCE in Data Science
Luke Barousse
55 How to show EXPERIENCE... when you have NONE?!?
How to show EXPERIENCE... when you have NONE?!?
Luke Barousse
56 Learn PYTHON to be a DATA ANALYST?!? (or is R enough...)
Learn PYTHON to be a DATA ANALYST?!? (or is R enough...)
Luke Barousse
57 The BIGGEST MISTAKE when starting a data project!
The BIGGEST MISTAKE when starting a data project!
Luke Barousse
58 Top Jobs in Data Science
Top Jobs in Data Science
Luke Barousse
59 How to get Data Analytics side jobs - NEW LinkedIn Feature
How to get Data Analytics side jobs - NEW LinkedIn Feature
Luke Barousse
60 Building a bot to scrape job data… How NOT to collect data
Building a bot to scrape job data… How NOT to collect data
Luke Barousse

This course teaches SQL for data engineering, covering SQL foundations, data analysis, and data warehousing, with hands-on projects and real-world applications.

Key Takeaways
  1. Setup DuckDB and GitHub
  2. Learn SQL basics
  3. Practice data analysis and modeling
  4. Build a data warehouse
  5. Perform ETL and data pipeline tasks
💡 SQL is a fundamental skill for data engineering, and mastering it can help you build efficient data pipelines and perform complex data analysis tasks.

Related Reads

📰
What Can We Do When Memory Becomes the New Bottleneck in Data Engineering?
Learn how to overcome memory bottlenecks in data engineering using Pandas chunking, Dask, and Polars, and why it matters for processing large datasets
Towards Data Science
📰
Migrate from Ponder to Envio HyperIndex
Learn to migrate your indexer from Ponder to Envio HyperIndex to scale your data management
Dev.to · Envio
📰
Data Backfilling with Apache Airflow: Architectures and Implementations for Historical Data Processing
Learn how to implement data backfilling with Apache Airflow for historical data processing and improve your data pipeline's accuracy and reliability
Dev.to · Wangila russell
📰
Building a Production-Style Weather Analytics Pipeline from Scratch: ETL, ELT, Star Schema, and…
Learn to build a production-ready weather analytics pipeline from scratch using Python, DuckDB, and Apache tools, and understand the importance of ETL, ELT, and Star Schema in data engineering
Medium · Python

Chapters (41)

Course Intro
6:11 What is SQL?
12:15 Data & Pipeline Intro
18:39 SQL & Dataset Setup
32:39 Basic Keywords
52:06 Comparison & Logical Operators
1:14:52 Wildcards & Aliases
1:26:10 Arithmetic Operators
1:38:10 Aggregate Functions
1:55:01 Terminal Intro
2:28:32 Local DuckDB Intro
3:06:24 VS Code Intro
3:28:56 Data Modeling Pt.1
3:49:10 JOINs
4:11:34 Order of Execution
4:30:51 Project #1 Intro
4:38:54 EDA #1 In-Demand Skills
4:47:27 EDA #2 Highest Paying Skills
4:56:02 EDA #3 Most Optimal Skills
5:10:58 README.md Build
5:27:27 Git & GitHub Pt.1
6:03:49 Share Project #1
6:10:27 Data Types
6:27:17 DDL & DML Pt.1
7:04:57 DDL & DML Pt.2
7:30:28 Subqueries and CTEs
8:06:07 DDL & DML Pt.3
8:44:55 Data Modeling Pt.2
9:08:07 CASE Expressions
9:28:54 Date Functions
9:51:19 SET Operators
10:08:04 Text & NULL Functions
10:26:16 Window Functions
11:00:04 Nested Functions
11:50:17 Git & GitHub Pt.2
12:32:36 Project #2 Intro
12:43:08 Build Data Warehouse
13:21:00 Build Flat Table Mart
13:40:03 Build Skills Mart
14:07:45 Build Priority Mart
14:29:40 README
Up next
A Moment Frozen in Time | Arnav Iyengar | TEDxJenks Youth
TEDx Talks
Watch →