How I Would Learn to be a Data Engineer

Luke Barousse ยท Beginner ยท๐Ÿ“Š Data Analytics & Business Intelligence ยท3d ago
My FREE Course to be a Data Engineer ๐Ÿ‘‰ https://lukeb.co/de-crash-course My Job Market Analytics App ๐Ÿ‘‰ https://datanerd.tech ๐— ๐˜† ๐—–๐—ผ๐˜‚๐—ฟ๐˜€๐—ฒ๐˜€ ๐—ณ๐—ผ๐—ฟ ๐——๐—ฎ๐˜๐—ฎ ๐—ก๐—ฒ๐—ฟ๐—ฑ๐˜€ โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–” ๐Ÿ› ๏ธ SQL for Data Engineering ๐Ÿ‘‰๐Ÿผ https://youtu.be/UjhFbq4uU2Y ๐Ÿ Python for Data Analytics ๐Ÿ‘‰๐Ÿผ https://youtu.be/wUSDVGivd-8 ๐Ÿ’ฝ SQL for Data Analytics ๐Ÿ‘‰๐Ÿผ https://youtu.be/7mz73uXD9DA โŽ Excel for Data Analytics ๐Ÿ‘‰๐Ÿผ https://youtu.be/pCJ15nGFgVg ๐Ÿ“Š Power BI for Data Analytics ๐Ÿ‘‰๐Ÿผ https://youtu.be/FwjaHCVNBWA โš›๏ธ ChatGPT for Data Analytics ๐Ÿ‘‰๐Ÿผ https://youtu.be/uhyMqbZI6rM ๐Ÿ™Œ Course Bundles ๐Ÿ‘‰๐Ÿผ https://lukeb.co/courses ๐—ฅ๐—ฒ๐—ฐ๐—ผ๐—บ๐—บ๐—ฒ๐—ป๐—ฑ๐—ฒ๐—ฑ ๐—•๐—ผ๐—ผ๐—ธ๐˜€ โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–”โ–” Fundamentals of Data Engineering ๐Ÿ‘‰ https://amzn.to/3Qdamzh The Data Warehouse Toolkit ๐Ÿ‘‰ https://amzn.to/426zevq ๐—ฆ๐—ผ๐—ฐ๐—ถ๐—ฎ๐—น ๐— ๐—ฒ๐—ฑ๐—ถ๐—ฎ โ–”โ–”โ–”โ–”โ–”โ–” ๐Ÿ“ซ Newsletter: https://lukebarousse.com/crash-courses ๐Ÿ‘จ๐Ÿผโ€๐Ÿ’ผ LinkedIn: https://www.linkedin.com/in/luke-b/ ๐Ÿ‘พ GitHub: https://github.com/lukebarousse ๐Ÿ…ง X/Twitter: https://twitter.com/LukeBarousse ๐ŸŒ„ Instagram: https://www.instagram.com/lukebarousse/ โฐ TikTok: https://www.tiktok.com/@lukebarousse 00:00 - Intro 01:37 - What Does a DE Do? 03:33 - Top Tools of Data Engineers 05:01 - Data Engineering Lifecycle (Intro) 06:22 - Storage (Warehouse vs Lake vs Lakehouse) 09:14 - Storage (Tools) 11:45 - Generation & Ingestion (Batch vs Stream) 13:25 - Generation & Ingestion (Tools) 14:40 - Transformation (Data Modeling 101) 19:50 - Transformation (Tools) 23:50 - Serving (Concepts & Tools) 25:32 - ETL vs ELT 27:08 - Undercurrents (Intro) 27:38 - Orchestration (Concepts) 28:46 - Orchestration (Airflow) 30:01 - Software Engineering (Terminal, Bash, Git) 32:36 - DataOps (CI/CD) 34:10 - Data Architecture (Putting it all together) 34:34 - Top DE Skills to Learn 38:16 - How to Learn Skills #datanerd #dataanalyst #dataengineer
Watch on YouTube โ†— (saves to browser)
Sign in to unlock AI tutor explanation ยท โšก30

Related AI Lessons

โšก
Before I Wrote a Single Line of Code, I Did This And It Changed Everything
Learn how a data analyst's pre-coding research phase transformed their approach to data science and discover the importance of exploratory data analysis
Medium ยท Data Science
 โšก
From Spite to a Double Offer: Data Science Intern at Adobe Research
Learn how to land a data science internship at a top company like Adobe Research by following the author's journey from initial rejection to ultimately receiving a double offer
Medium ยท Data Science
 โšก
Stop Wasting Cloud Budget: How Polars Cut Our AWS Bill by 90%?
Learn how Polars optimized their AWS bill by 90% by processing only necessary data
Medium ยท Python
 โšก
Why Chennai Is Emerging as a Major Center for Data Science Talent in South India
Chennai is emerging as a major center for data science talent in South India, driven by its growing technology economy
Medium ยท Data Science

Chapters (20)

Intro
1:37 What Does a DE Do?
3:33 Top Tools of Data Engineers
5:01 Data Engineering Lifecycle (Intro)
6:22 Storage (Warehouse vs Lake vs Lakehouse)
9:14 Storage (Tools)
11:45 Generation & Ingestion (Batch vs Stream)
13:25 Generation & Ingestion (Tools)
14:40 Transformation (Data Modeling 101)
19:50 Transformation (Tools)
23:50 Serving (Concepts & Tools)
25:32 ETL vs ELT
27:08 Undercurrents (Intro)
27:38 Orchestration (Concepts)
28:46 Orchestration (Airflow)
30:01 Software Engineering (Terminal, Bash, Git)
32:36 DataOps (CI/CD)
34:10 Data Architecture (Putting it all together)
34:34 Top DE Skills to Learn
38:16 How to Learn Skills
Up next
SQL End of Life migration factory offer | Data Exposed
Microsoft Developer
Watch โ†’