How do I use the MultiIndex in pandas?

Data School · Intermediate ·📰 AI News & Updates ·7y ago
One of the most powerful features in pandas is multi-level indexing (or "hierarchical indexing"), which allows you to add extra dimensions to your Series or DataFrame objects. But when should you use a MultiIndex, and how do you create, slice, and merge MultiIndexed objects? In this video, I'll demonstrate: - How to create a Series with a MultiIndex, and how to convert it to a DataFrame - How to select from a Series with a MultiIndex - How to create a DataFrame with a MultiIndex - How to select from a DataFrame with a MultiIndex - How to merge two DataFrames with MultiIndexes WANT TO JOIN MY NEXT WEBCAST? Become a member ($5/month): https://www.patreon.com/dataschool === RELATED RESOURCES === Download the lesson notebook: http://nbviewer.jupyter.org/github/justmarkham/pandas-videos/blob/master/pandas_multiindex.ipynb Using the pandas index (Part 1): https://www.youtube.com/watch?v=OYZNk7Z9s6I&list=PL5-da3qGB5ICCsgW1MxlZ0Hq8LL5U3u9y&index=17 Using the pandas index (Part 2): https://www.youtube.com/watch?v=15q-is8P_H4&list=PL5-da3qGB5ICCsgW1MxlZ0Hq8LL5U3u9y&index=18 Analyzing groups with groupby: https://www.youtube.com/watch?v=qy0fDqoMJx8&list=PL5-da3qGB5ICCsgW1MxlZ0Hq8LL5U3u9y&index=14 Selection and slicing with loc: https://www.youtube.com/watch?v=xvpNA7bC8cs&list=PL5-da3qGB5ICCsgW1MxlZ0Hq8LL5U3u9y&index=19 My full pandas video series: https://www.youtube.com/playlist?list=PL5-da3qGB5ICCsgW1MxlZ0Hq8LL5U3u9y DataCamp course on MultiIndex: https://www.datacamp.com/courses/manipulating-dataframes-with-pandas?tap_a=5644-dce66f&tap_s=280411-a25fc8 DataCamp course on merging: https://www.datacamp.com/courses/merging-dataframes-with-pandas?tap_a=5644-dce66f&tap_s=280411-a25fc8 Tidy data: http://r4ds.had.co.nz/tidy-data.html == LET'S CONNECT! == Newsletter: https://www.dataschool.io/subscribe/ Twitter: https://twitter.com/justmarkham Facebook: https://www.facebook.com/DataScienceSchool/ LinkedIn: https://www.linkedin.com/in/justmarkham/
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Data School · Data School · 0 of 60

← Previous Next →
1 Setting up Git and GitHub
Setting up Git and GitHub
Data School
 2 Navigating a GitHub Repository - Part 1
Navigating a GitHub Repository - Part 1
Data School
 3 Forking a GitHub Repository
Forking a GitHub Repository
Data School
 4 Creating a New GitHub Repository
Creating a New GitHub Repository
Data School
 5 Copying a GitHub Repository to Your Local Computer
Copying a GitHub Repository to Your Local Computer
Data School
 6 Committing Changes in Git and Pushing to a GitHub Repository
Committing Changes in Git and Pushing to a GitHub Repository
Data School
 7 Syncing Your GitHub Fork
Syncing Your GitHub Fork
Data School
 8 Allstate Purchase Prediction Challenge on Kaggle
Allstate Purchase Prediction Challenge on Kaggle
Data School
 9 Troubleshooting: Updates Rejected When Pushing to GitHub
Troubleshooting: Updates Rejected When Pushing to GitHub
Data School
 10 Hands-on dplyr tutorial for faster data manipulation in R
Hands-on dplyr tutorial for faster data manipulation in R
Data School
 11 ROC Curves and Area Under the Curve (AUC) Explained
ROC Curves and Area Under the Curve (AUC) Explained
Data School
 12 Going deeper with dplyr: New features in 0.3 and 0.4 (tutorial)
Going deeper with dplyr: New features in 0.3 and 0.4 (tutorial)
Data School
 13 What is machine learning, and how does it work?
What is machine learning, and how does it work?
Data School
 14 Setting up Python for machine learning: scikit-learn and Jupyter Notebook
Setting up Python for machine learning: scikit-learn and Jupyter Notebook
Data School
 15 Getting started in scikit-learn with the famous iris dataset
Getting started in scikit-learn with the famous iris dataset
Data School
 16 Training a machine learning model with scikit-learn
Training a machine learning model with scikit-learn
Data School
 17 Comparing machine learning models in scikit-learn
Comparing machine learning models in scikit-learn
Data School
 18 Data science in Python: pandas, seaborn, scikit-learn
Data science in Python: pandas, seaborn, scikit-learn
Data School
 19 Selecting the best model in scikit-learn using cross-validation
Selecting the best model in scikit-learn using cross-validation
Data School
 20 How to find the best model parameters in scikit-learn
How to find the best model parameters in scikit-learn
Data School
 21 How to evaluate a classifier in scikit-learn
How to evaluate a classifier in scikit-learn
Data School
 22 What is pandas? (Introduction to the Q&A series)
What is pandas? (Introduction to the Q&A series)
Data School
 23 How do I read a tabular data file into pandas?
How do I read a tabular data file into pandas?
Data School
 24 How do I select a pandas Series from a DataFrame?
How do I select a pandas Series from a DataFrame?
Data School
 25 Why do some pandas commands end with parentheses (and others don't)?
Why do some pandas commands end with parentheses (and others don't)?
Data School
 26 How do I rename columns in a pandas DataFrame?
How do I rename columns in a pandas DataFrame?
Data School
 27 How do I remove columns from a pandas DataFrame?
How do I remove columns from a pandas DataFrame?
Data School
 28 How do I sort a pandas DataFrame or a Series?
How do I sort a pandas DataFrame or a Series?
Data School
 29 How do I filter rows of a pandas DataFrame by column value?
How do I filter rows of a pandas DataFrame by column value?
Data School
 30 How do I apply multiple filter criteria to a pandas DataFrame?
How do I apply multiple filter criteria to a pandas DataFrame?
Data School
 31 Your pandas questions answered!
Your pandas questions answered!
Data School
 32 How do I use the "axis" parameter in pandas?
How do I use the "axis" parameter in pandas?
Data School
 33 How do I use string methods in pandas?
How do I use string methods in pandas?
Data School
 34 How do I change the data type of a pandas Series?
How do I change the data type of a pandas Series?
Data School
 35 When should I use a "groupby" in pandas?
When should I use a "groupby" in pandas?
Data School
 36 How do I explore a pandas Series?
How do I explore a pandas Series?
Data School
 37 How do I handle missing values in pandas?
How do I handle missing values in pandas?
Data School
 38 What do I need to know about the pandas index? (Part 1)
What do I need to know about the pandas index? (Part 1)
Data School
 39 What do I need to know about the pandas index? (Part 2)
What do I need to know about the pandas index? (Part 2)
Data School
 40 How do I select multiple rows and columns from a pandas DataFrame?
How do I select multiple rows and columns from a pandas DataFrame?
Data School
 41 Machine Learning with Text in scikit-learn (PyCon 2016)
Machine Learning with Text in scikit-learn (PyCon 2016)
Data School
 42 When should I use the "inplace" parameter in pandas?
When should I use the "inplace" parameter in pandas?
Data School
 43 How do I make my pandas DataFrame smaller and faster?
How do I make my pandas DataFrame smaller and faster?
Data School
 44 How do I use pandas with scikit-learn to create Kaggle submissions?
How do I use pandas with scikit-learn to create Kaggle submissions?
Data School
 45 More of your pandas questions answered!
More of your pandas questions answered!
Data School
 46 How do I create dummy variables in pandas?
How do I create dummy variables in pandas?
Data School
 47 How do I work with dates and times in pandas?
How do I work with dates and times in pandas?
Data School
 48 How do I find and remove duplicate rows in pandas?
How do I find and remove duplicate rows in pandas?
Data School
 49 How do I avoid a SettingWithCopyWarning in pandas?
How do I avoid a SettingWithCopyWarning in pandas?
Data School
 50 How do I change display options in pandas?
How do I change display options in pandas?
Data School
 51 How do I create a pandas DataFrame from another object?
How do I create a pandas DataFrame from another object?
Data School
 52 How do I apply a function to a pandas Series or DataFrame?
How do I apply a function to a pandas Series or DataFrame?
Data School
 53 Getting started with machine learning in Python (webcast)
Getting started with machine learning in Python (webcast)
Data School
 54 Q&A about Machine Learning with Text (online course)
Q&A about Machine Learning with Text (online course)
Data School
 55 Your pandas questions answered! (webcast)
Your pandas questions answered! (webcast)
Data School
 56 Machine Learning with Text in scikit-learn (PyData DC 2016)
Machine Learning with Text in scikit-learn (PyData DC 2016)
Data School
 57 Write Pythonic Code for Better Data Science (webcast)
Write Pythonic Code for Better Data Science (webcast)
Data School
 58 Web scraping in Python (Part 1): Getting started
Web scraping in Python (Part 1): Getting started
Data School
 59 Web scraping in Python (Part 2): Parsing HTML with Beautiful Soup
Web scraping in Python (Part 2): Parsing HTML with Beautiful Soup
Data School
 60 Web scraping in Python (Part 3): Building a dataset
Web scraping in Python (Part 3): Building a dataset
Data School

Related AI Lessons

⚡
Beware of Claude’s WiLd Effort Estimates
Analyze the limitations of Claude's effort estimates and potential consequences for Anthropic's growth
Medium · Data Science
 ⚡
YouTube is testing an AI-powered search feature that shows guided answers
YouTube is testing an AI-powered search feature that provides guided answers, enhancing user experience and search functionality
TechCrunch AI
 ⚡
The Download: Musk and Altman’s legal showdown, and AI’s profit problem
Elon Musk and Sam Altman are heading to court over OpenAI's future, highlighting AI's profit problem
MIT Technology Review
 ⚡
Every Article About AI Jobs Is Written By Someone Whose Job Is Safe
Articles about AI jobs are often written by people whose jobs are not threatened by AI, highlighting a potential bias in the narrative
Medium · AI
Up next
The AI Blog Strategy That Gets You BANNED 🤖 #shorts
Jacky Chou from Indexsy
Watch →