Automate Exploratory Data Analysis & Invent Python Comprehensions | Real Python Podcast #288

Real Python · Beginner ·🔧 Backend Engineering ·3mo ago
Skills: ML Pipelines70%

Key Takeaways

Automate exploratory data analysis with YData Profiling and invent Python comprehensions with custom collections, discussed in Real Python Podcast #288, along with other Python community updates and projects.

Original Description

How do you quickly get an understanding of what's inside a new set of data? How can you share an exploratory data analysis with your team? Christopher Trudeau is back on the show this week with another batch of PyCoder's Weekly articles and projects. 👉 Links from the show: https://realpython.com/podcasts/rpp/288/ We discuss a recent Real Python tutorial about YData Profiling. This library lets you quickly generate an exploratory data analysis (EDA) report with a few lines of code. The report provides column-level analysis, visualizations, and summary statistics that can be exported to HTML to share with others. We cover an article by Trey Hunner about building your own Python comprehensions. Python includes list, dictionary, and set comprehensions. But what if you want to create ones for other collections, such as a tuple, frozenset, or a Counter? We also share other articles and projects from the Python community, including a collection of recent releases and PEPs, using the Django ORM as a standalone module, a history of attempts to eliminate programmers, a discussion of bad managers, a modern Python project template, and a CLI to summarize code size by language. This episode is sponsored by AgentField. Topics: - 00:00:00 -- Introduction - 00:02:46 -- Python 3.12.13, 3.11.15, 3.10.20 and Python 3.15.0 alpha 7 Released - 00:03:25 -- Django Security Releases Issued: 6.0.3, 5.2.12, and 4.2.29 - 00:03:39 -- PEP 825: Wheel Variants: Package Format - 00:04:20 -- PEP 827: Type Manipulation - 00:05:11 -- Automate Python Data Analysis With YData Profiling - 00:11:31 -- Django ORM Standalone: Querying an Existing Database - 00:16:43 -- Sponsor: AgentField - 00:17:42 -- Invent Your Own Comprehensions in Python - 00:22:34 -- A History of Attempts to Eliminate Programmers - 00:28:51 -- Video Course Spotlight - 00:30:03 -- Three Bad Managers - 00:50:42 -- python_template: Modern Python Project Template - 00:53:38 -- tallyman: CLI to Summarize Code Size by Language - 00
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Real Python · Real Python · 0 of 60

← Previous Next →
1 A better Python REPL – bpython vs python interpreter
A better Python REPL – bpython vs python interpreter
Real Python
 2 Introducing large-type.com – A Utility Website
Introducing large-type.com – A Utility Website
Real Python
 3 Reading Hacker News Without Wasting Tons of Time
Reading Hacker News Without Wasting Tons of Time
Real Python
 4 Forward References and Python 3 Type Hints
Forward References and Python 3 Type Hints
Real Python
 5 Using Sublime Text as your Git Editor
Using Sublime Text as your Git Editor
Real Python
 6 Python Code Linting and Auto-Complete for Sublime Text
Python Code Linting and Auto-Complete for Sublime Text
Real Python
 7 Make your Python Code More Readable with Custom Exceptions
Make your Python Code More Readable with Custom Exceptions
Real Python
 8 Write Better Tests with Sublime Text's Split Layout Feature
Write Better Tests with Sublime Text's Split Layout Feature
Real Python
 9 How to Use Sublime Text from the Command Line
How to Use Sublime Text from the Command Line
Real Python
 10 Rename Variables with Multiple Selection in Sublime Text
Rename Variables with Multiple Selection in Sublime Text
Real Python
 11 Sublime Text Settings for Writing PEP 8 Python
Sublime Text Settings for Writing PEP 8 Python
Real Python
 12 Write Cleaner Python with Sublime Text's Indent Guides
Write Cleaner Python with Sublime Text's Indent Guides
Real Python
 13 Sublime Text Whitespace Settings for Python Development
Sublime Text Whitespace Settings for Python Development
Real Python
 14 Function Argument Unpacking in Python
Function Argument Unpacking in Python
Real Python
 15 Python Code Review: Debugging and Refactoring "Conway's Game of Life" + Automated Tests
Python Code Review: Debugging and Refactoring "Conway's Game of Life" + Automated Tests
Real Python
 16 Using "get()" to Return a Default Value from a Python Dict
Using "get()" to Return a Default Value from a Python Dict
Real Python
 17 A Python Shorthand for Swapping Two Variables
A Python Shorthand for Swapping Two Variables
Real Python
 18 Python Code Review: Refactoring a Web Scraper, PEP 8 Style Guide Compliance, requirements.txt
Python Code Review: Refactoring a Web Scraper, PEP 8 Style Guide Compliance, requirements.txt
Real Python
 19 Click & Jump to Test Failures from the Command Line (iTerm2)
Click & Jump to Test Failures from the Command Line (iTerm2)
Real Python
 20 Setting up Sublime Text for Python Developers
Setting up Sublime Text for Python Developers
Real Python
 21 Sublime Text + Python Guide Overview
Sublime Text + Python Guide Overview
Real Python
 22 Python Code Review: Adding Pytest Tests to an Existing Python Web Scraper
Python Code Review: Adding Pytest Tests to an Existing Python Web Scraper
Real Python
 23 Type-Checking Python Programs With Type Hints and mypy
Type-Checking Python Programs With Type Hints and mypy
Real Python
 24 A Shorthand for Merging Dictionaries in Python 3.5+
A Shorthand for Merging Dictionaries in Python 3.5+
Real Python
 25 Python Code Review Flask Web Security Tutorial + Virtualenvs, requirements.txt
Python Code Review Flask Web Security Tutorial + Virtualenvs, requirements.txt
Real Python
 26 My Python Code Looks Ugly and Confusing – Help!
My Python Code Looks Ugly and Confusing – Help!
Real Python
 27 Setting Up a Programmer Portfolio/Developer Blog – How To Get Started
Setting Up a Programmer Portfolio/Developer Blog – How To Get Started
Real Python
 28 Do I Need a GitHub/GitLab/Bitbucket Profile as a Developer?
Do I Need a GitHub/GitLab/Bitbucket Profile as a Developer?
Real Python
 29 Programmer Portfolio – Example and Walkthrough
Programmer Portfolio – Example and Walkthrough
Real Python
 30 How to Get Your 1st Speaking Gig at a Tech Conference
How to Get Your 1st Speaking Gig at a Tech Conference
Real Python
 31 How to Build Your Public Speaking Skills as a Developer
How to Build Your Public Speaking Skills as a Developer
Real Python
 32 The Object-oriented Version of "Spaghetti Code" is "Lasagna Code" ?!
The Object-oriented Version of "Spaghetti Code" is "Lasagna Code" ?!
Real Python
 33 Setting up Sublime Text for Python Developers – Lesson #1
Setting up Sublime Text for Python Developers – Lesson #1
Real Python
 34 Cool New Features in Python 3.6
Cool New Features in Python 3.6
Real Python
 35 "is" vs "==" in Python – What's the Difference? (And When to Use Each)
"is" vs "==" in Python – What's the Difference? (And When to Use Each)
Real Python
 36 Emulating switch/case Statements in Python with Dictionaries
Emulating switch/case Statements in Python with Dictionaries
Real Python
 37 Python Function Argument Unpacking Tutorial (* and ** Operators)
Python Function Argument Unpacking Tutorial (* and ** Operators)
Real Python
 38 What Code Should I Put On My GitHub/GitLab/BitBucket Profile?
What Code Should I Put On My GitHub/GitLab/BitBucket Profile?
Real Python
 39 A Crazy Python Dictionary Expression ?!
A Crazy Python Dictionary Expression ?!
Real Python
 40 String Conversion in Python: When to Use __repr__ vs __str__
String Conversion in Python: When to Use __repr__ vs __str__
Real Python
 41 Method Types in Python OOP: @classmethod, @staticmethod, and Instance Methods
Method Types in Python OOP: @classmethod, @staticmethod, and Instance Methods
Real Python
 42 Optional Arguments in Python With *args and **kwargs
Optional Arguments in Python With *args and **kwargs
Real Python
 43 Python Context Managers and the "with" Statement (__enter__ & __exit__)
Python Context Managers and the "with" Statement (__enter__ & __exit__)
Real Python
 44 Installing Python Packages with pip and virtualenv / venv
Installing Python Packages with pip and virtualenv / venv
Real Python
 45 "For Each" Loops in Python with enumerate() and range()
"For Each" Loops in Python with enumerate() and range()
Real Python
 46 Python Code Review: LibreOffice Automation and the Python Standard Library
Python Code Review: LibreOffice Automation and the Python Standard Library
Real Python
 47 Managing Python Dependencies With Pip and Virtual Environments – Lesson #1
Managing Python Dependencies With Pip and Virtual Environments – Lesson #1
Real Python
 48 Python Tutorial: List Comprehensions Step-By-Step
Python Tutorial: List Comprehensions Step-By-Step
Real Python
 49 Leveraging Python's Implicit "return None" Statements
Leveraging Python's Implicit "return None" Statements
Real Python
 50 What's the meaning of underscores (_ & __) in Python variable names?
What's the meaning of underscores (_ & __) in Python variable names?
Real Python
 51 Python Data Structures: Sets, Frozensets, and Multisets (Bags)
Python Data Structures: Sets, Frozensets, and Multisets (Bags)
Real Python
 52 Writing automated tests for Python command-line apps and scripts
Writing automated tests for Python command-line apps and scripts
Real Python
 53 How to find great Python packages on PyPI, the Python Package Repository
How to find great Python packages on PyPI, the Python Package Repository
Real Python
 54 Immutable vs Mutable Objects in Python
Immutable vs Mutable Objects in Python
Real Python
 55 PyPI vs Warehouse, the Next-Generation Python Package Repository
PyPI vs Warehouse, the Next-Generation Python Package Repository
Real Python
 56 pep8.org — The Prettiest Way to View the PEP 8 Python Style Guide
pep8.org — The Prettiest Way to View the PEP 8 Python Style Guide
Real Python
 57 My Experience at PyCon 2017 in Portland
My Experience at PyCon 2017 in Portland
Real Python
 58 Pylint Tutorial – How to Write Clean Python
Pylint Tutorial – How to Write Clean Python
Real Python
 59 "Reverse a List in Python" Tutorial: Three Methods & How-to Demos
"Reverse a List in Python" Tutorial: Three Methods & How-to Demos
Real Python
 60 Python Refactoring: "while True" Infinite Loops & The "input" Function
Python Refactoring: "while True" Infinite Loops & The "input" Function
Real Python

Automate exploratory data analysis with YData Profiling and learn how to create custom Python comprehensions. This episode covers various Python community updates, including Django ORM and PEPs.

Key Takeaways
  1. Install YData Profiling
  2. Generate EDA report with YData Profiling
  3. Create custom Python comprehensions
  4. Use Django ORM as a standalone module
  5. Explore PEP 825 and PEP 827
💡 YData Profiling can quickly generate EDA reports with column-level analysis, visualizations, and summary statistics, making it easier to share insights with others.

Related Reads

📰
Bypassing Shadow DOMs & Same-Origin Iframes: How I Solved LinkedIn's Massive SDUI Update
Learn how to bypass Shadow DOMs and Same-Origin Iframes to solve issues like LinkedIn's SDUI update
Dev.to · Maaz Khan
 📰
Why Check Then Act Is the Silent Killer in Banking Backends, and How NestJS Prevents It
Learn how 'Check Then Act' can cause issues in banking backends and how NestJS helps prevent it
Dev.to · Peace Melodi
 📰
PDF Tamper Detection API for Laravel and PHP: Integration Guide
Learn to integrate a PDF tamper detection API into Laravel and PHP applications to ensure document integrity
Dev.to · Iurii Rogulia
 📰
How I Built a Concurrency-Safe Reservation System
Learn how to build a concurrency-safe reservation system using FastAPI, PostgreSQL, Redis, and SQLAlchemy to prevent race conditions
Dev.to · Rahul Chaduvula
Up next
Indian Express Editorial Analysis by Chandan Sharma - 1 JULY 2026 | UPSC Current Affairs 2026
StudyIQ IAS
Watch →