Databricks Tutorial | Databricks Free Edition Tutorial with End-to-End Data + AI Project
In this databricks tutorial, you will learn Databricks foundations from scratch and build a real end-to-end project in E-Commerce domain that you can confidently put on your resume. This Databricks micro Course explains everything in a simple, intuitive way!
Signup to Databricks Free Edition: https://bit.ly/4nK0NTN
Code, Dataset, other resources: https://codebasics.io/resources/databrick-mini-course-end-to-end-project
Get Certified by Codebasics with this Databricks Mini Course - https://codebasics.io/courses/Databricks-Mini-Course
⭐️ Timestamps ⭐️
00:00:00 Intro
00:01:15 Project Introduction
00:03:09 Stakeholder Discussion
00:04:45 Two Learning Paths
00:05:19 Sign up for the free edition
00:06:03 Explore Databricks UI
00:11:12 Dataframe Basics
00:27:54 Distributed Computing, Spark, and Databricks
00:34:51 SQL and joins in Spark
00:49:48 Reading Spark plans with explain
01:02:37 Spark Architecture
01:07:43 Transformations vs Actions and Lazy Evaluation
01:16:03 Narrow vs Wide Transformation
01:19:55 Partition and Parallelism: Repartition
01:34:00 Partition and Parallelism: Coalesce
01:39:37 Managed vs External Tables
01:43:26 Medallion architecture
01:49:18 Unity Catalog
01:59:21 Acid & Time Travel
02:09:05 About AWS Account & Delta Lake
02:09:26 AWS Account Setup
02:11:39 Delta Lake and Delta format
02:25:09 Intro & Tech Architecture
02:28:23 Catalog Setup
02:31:51 Data Understanding and Upload
02:36:20 Dimension Data Processing
03:00:45 Fact Data Processing
03:14:25 Get Insights using Genie
03:18:02 BI Dashboard
03:28:15 Orchestration
03:33:27 Stakeholder Review Meeting
03:34:50 What’s Next?
Do you want to learn technology from me? Check https://codebasics.io/?utm_source=description&utm_medium=yt&utm_campaign=description&utm_id=description for my affordable video courses.
Need help building software or data analytics/AI solutions? My company https://www.atliq.com/ can help. Click on the Contact button on that website.
🎥 Codebasics Hindi channel: https://
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from codebasics · codebasics · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Python Tutorial - 1. Install python on windows
codebasics
Python Tutorial - 2. Variables
codebasics
Python Tutorial - 3. Numbers
codebasics
Python Tutorial - 4. Strings
codebasics
Python Tutorial - 5. Lists
codebasics
Python Tutorial - 6. Install PyCharm on Windows
codebasics
PyCharm Tutorial - 7. Debug python code using PyCharm
codebasics
Python Tutorial - 8. If Statement
codebasics
Python Tutorial - 9. For loop
codebasics
Python Tutorial - 10. Functions
codebasics
Python Tutorial - 11. Dictionaries and Tuples
codebasics
Python Tutorial - 12. Modules
codebasics
Python Tutorial - 13. Reading/Writing Files
codebasics
How to install Julia on Windows
codebasics
Python Tutorial - 14. Working With JSON
codebasics
Julia Tutorial - 1. Variables
codebasics
Julia Tutorial - 2. Numbers
codebasics
Python Tutorial - 15. if __name__ == "__main__"
codebasics
Julia Tutorial - Why Should I Learn Julia Programming Language
codebasics
Python Tutorial - 16. Exception Handling
codebasics
Julia Tutorial - 3. Complex and Rational Numbers
codebasics
Julia Tutorial - 4. Strings
codebasics
Python Tutorial - 17. Class and Objects
codebasics
Julia Tutorial - 5. Functions
codebasics
Julia Tutorial - 6. If Statement and Ternary Operator
codebasics
Julia Tutorial - 7. For While Loop
codebasics
Python Tutorial - 18. Inheritance
codebasics
Julia Tutorial - 8. begin and (;) Compound Expressions
codebasics
Python Tutorial - 12.1 - Install Python Module (using pip)
codebasics
Julia Tutorial - 9. Tasks (a.k.a. Generators or Coroutines)
codebasics
Julia Tutorial - 10. Exception Handling
codebasics
Python Tutorial - 19. Multiple Inheritance
codebasics
Python Tutorial - 20. Raise Exception And Finally
codebasics
Python Tutorial - 21. Iterators
codebasics
Python Tutorial - 22. Generators
codebasics
Python Tutorial - 23. List Set Dict Comprehensions
codebasics
Python Tutorial - 24. Sets and Frozen Sets
codebasics
Python Tutorial - 25. Command line argument processing using argparse
codebasics
Debugging Tips - What is bug and debugging?
codebasics
Debugging Tips - Conditional Breakpoint
codebasics
Debugging Tips - Watches and Call Stack
codebasics
Python Tutorial - 26. Multithreading - Introduction
codebasics
Git Tutorial 3: How To Install Git
codebasics
Git Tutorial 1: What is git / What is version control system?
codebasics
Git Tutorial 2 : What is Github? | github tutorial
codebasics
Git Tutorial 4: Basic Commands: add, commit, push
codebasics
Git Tutorial 5: Undoing/Reverting/Resetting code changes
codebasics
Git Tutorial 6: Branches (Create, Merge, Delete a branch)
codebasics
Git Github Tutorial 10: What is Pull Request?
codebasics
Git Tutorial 7: What is HEAD?
codebasics
Git Tutorial 9: Diff and Merge using meld
codebasics
Difference between Multiprocessing and Multithreading
codebasics
Python Tutorial - 27. Multiprocessing Introduction
codebasics
Python Tutorial - 28. Sharing Data Between Processes Using Array and Value
codebasics
Git Tutorial 8 - .gitignore file
codebasics
Python Tutorial - 29. Sharing Data Between Processes Using Multiprocessing Queue
codebasics
Python Tutorial - 30. Multiprocessing Lock
codebasics
Python Tutorial - 31. Multiprocessing Pool (Map Reduce)
codebasics
What is code?
codebasics
Python unit testing - pytest introduction
codebasics
More on: ML Pipelines
View skill →
Related AI Lessons
⚡
⚡
⚡
⚡
Python for Data Science — Handling Missing Values in Pandas
Medium · Programming
Roblox Data Engineering Interview Questions: Full DE Prep Guide
Dev.to · Gowtham Potureddi
Tesla Data Engineering Interview Questions: Full DE Prep Guide
Dev.to · Gowtham Potureddi
Exodus Point Data Engineering Interview Questions: Full DE Prep Guide
Dev.to · Gowtham Potureddi
Chapters (32)
Intro
1:15
Project Introduction
3:09
Stakeholder Discussion
4:45
Two Learning Paths
5:19
Sign up for the free edition
6:03
Explore Databricks UI
11:12
Dataframe Basics
27:54
Distributed Computing, Spark, and Databricks
34:51
SQL and joins in Spark
49:48
Reading Spark plans with explain
1:02:37
Spark Architecture
1:07:43
Transformations vs Actions and Lazy Evaluation
1:16:03
Narrow vs Wide Transformation
1:19:55
Partition and Parallelism: Repartition
1:34:00
Partition and Parallelism: Coalesce
1:39:37
Managed vs External Tables
1:43:26
Medallion architecture
1:49:18
Unity Catalog
1:59:21
Acid & Time Travel
2:09:05
About AWS Account & Delta Lake
2:09:26
AWS Account Setup
2:11:39
Delta Lake and Delta format
2:25:09
Intro & Tech Architecture
2:28:23
Catalog Setup
2:31:51
Data Understanding and Upload
2:36:20
Dimension Data Processing
3:00:45
Fact Data Processing
3:14:25
Get Insights using Genie
3:18:02
BI Dashboard
3:28:15
Orchestration
3:33:27
Stakeholder Review Meeting
3:34:50
What’s Next?
🎓
Tutor Explanation
DeepCamp AI