Diagnose slow Python code. (Feat. async/await)

mCoding · Beginner ·4y ago
Where is the slow coming from? How do you make your Python code faster? The first step is measuring what part is actually slow. We do this using a profiler, such a cProfile. The profiler measures how much time all your function calls take and then you can print or save these statistics to determine where you should spend your time improving. Take your profiling to the next level using a graphical tool like snakeviz to analyze the stats. I go through a simple example where I go from start to finish diagnosing and fixing some slow code using these techniques. Here we ended up using async/await…
Watch on YouTube ↗ (saves to browser)

Chapters (6)

Intro
0:45 Example slow code
2:34 Basic profiling
4:27 Snakeviz visualizations
6:04 Speeding up the code
9:04 Improved profile

Playlist

Uploads from mCoding · mCoding · 37 of 60

← Previous Next →
1 Goodbye, List! Type hinting standard collections - New in Python 3.9
Goodbye, List! Type hinting standard collections - New in Python 3.9
mCoding
 2 Python's comma equals ,= operator?
Python's comma equals ,= operator?
mCoding
 3 Finding Primes in Python with the Sieve of Eratosthenes
Finding Primes in Python with the Sieve of Eratosthenes
mCoding
 4 Find the First Missing Positive Int | Hard Interview Question on LeetCode
Find the First Missing Positive Int | Hard Interview Question on LeetCode
mCoding
 5 JSON Tutorial Python | Basic Python Recipes
JSON Tutorial Python | Basic Python Recipes
mCoding
 6 Simulating Brownian Motion in Python
Simulating Brownian Motion in Python
mCoding
 7 The Single Most Useful Decorator in Python
The Single Most Useful Decorator in Python
mCoding
 8 The Fastest Way to Loop in Python - An Unfortunate Truth
The Fastest Way to Loop in Python - An Unfortunate Truth
mCoding
 9 Numpy Array Broadcasting In Python Explained
Numpy Array Broadcasting In Python Explained
mCoding
 10 Brownian Motion Single Path Zoom
Brownian Motion Single Path Zoom
mCoding
 11 Brownian Motion Fractal Zoom
Brownian Motion Fractal Zoom
mCoding
 12 Magic Methods - Making Python builtins work with your classes
Magic Methods - Making Python builtins work with your classes
mCoding
 13 50 Million Primes In 5 Seconds - Segmented Sieve of Eratosthenes
50 Million Primes In 5 Seconds - Segmented Sieve of Eratosthenes
mCoding
 14 The Hottest New Feature Coming In Python 3.10 - Structural Pattern Matching / Match Statement
The Hottest New Feature Coming In Python 3.10 - Structural Pattern Matching / Match Statement
mCoding
 15 How Fast is Python's Sort? Performance Testing
How Fast is Python's Sort? Performance Testing
mCoding
 16 C++ First Missing Int, faster than 100%!
C++ First Missing Int, faster than 100%!
mCoding
 17 [April Fools 2021] Python 4.0! New old print, mandatory static typing, StackOverflow integration
[April Fools 2021] Python 4.0! New old print, mandatory static typing, StackOverflow integration
mCoding
 18 Python dataclasses will save you HOURS, also featuring attrs
Python dataclasses will save you HOURS, also featuring attrs
mCoding
 19 C++ Sudoku Solver in 7 minutes using Recursive Backtracking
C++ Sudoku Solver in 7 minutes using Recursive Backtracking
mCoding
 20 Every PROOF you've seen that .999... = 1 is WRONG
Every PROOF you've seen that .999... = 1 is WRONG
mCoding
 21 Python's sharpest corner is ... plus equals? (+=)
Python's sharpest corner is ... plus equals? (+=)
mCoding
 22 Binary Search - A Different Perspective | Python Algorithms
Binary Search - A Different Perspective | Python Algorithms
mCoding
 23 The Best Way to Check for Optional Arguments in Python
The Best Way to Check for Optional Arguments in Python
mCoding
 24 Local and Global Variable Lookup Weirdness in Python
Local and Global Variable Lookup Weirdness in Python
mCoding
 25 Efficient Exponentiation
Efficient Exponentiation
mCoding
 26 How To Install Python for Data Science
How To Install Python for Data Science
mCoding
 27 0.1 + 0.2 is NOT 0.3 in Most Programming Languages
0.1 + 0.2 is NOT 0.3 in Most Programming Languages
mCoding
 28 Python 3.10's new type hinting features
Python 3.10's new type hinting features
mCoding
 29 Python 3.10's Quality of Life improvements
Python 3.10's Quality of Life improvements
mCoding
 30 Introducing mZips! Python Zip and Zip Longest
Introducing mZips! Python Zip and Zip Longest
mCoding
 31 Match statement tips
Match statement tips
mCoding
 32 Using except: is a HUGE mistake
Using except: is a HUGE mistake
mCoding
 33 Python + YouTube API | Automating descriptions
Python + YouTube API | Automating descriptions
mCoding
 34 Anaphones, phonetic anagrams
Anaphones, phonetic anagrams
mCoding
 35 Cracking passwords using ONLY response times | Secure Python
Cracking passwords using ONLY response times | Secure Python
mCoding
 36 Python f-strings can do more than you thought. f'{val=}', f'{val!r}', f'{dt:%Y-%m-%d}'
Python f-strings can do more than you thought. f'{val=}', f'{val!r}', f'{dt:%Y-%m-%d}'
mCoding
 ▶ Diagnose slow Python code. (Feat. async/await)
Diagnose slow Python code. (Feat. async/await)
mCoding
 38 Python MD5 implementation
Python MD5 implementation
mCoding
 39 Salting, peppering, and hashing passwords
Salting, peppering, and hashing passwords
mCoding
 40 x to bool conversion in Python, C++, and C
x to bool conversion in Python, C++, and C
mCoding
 41 You should put this in all your Python scripts | if __name__ == '__main__': ...
You should put this in all your Python scripts | if __name__ == '__main__': ...
mCoding
 42 Find the Skyline Problem with C++ Solution Explained
Find the Skyline Problem with C++ Solution Explained
mCoding
 43 The ONLY C keyword with no C++ equivalent
The ONLY C keyword with no C++ equivalent
mCoding
 44 Should you use "not not x" instead of "bool(x)" in Python? (NO!)
Should you use "not not x" instead of "bool(x)" in Python? (NO!)
mCoding
 45 Multiple Assignments in Python
Multiple Assignments in Python
mCoding
 46 Why I don't like Python's chained comparisons
Why I don't like Python's chained comparisons
mCoding
 47 Automated Testing in Python with pytest, tox, and GitHub Actions
Automated Testing in Python with pytest, tox, and GitHub Actions
mCoding
 48 You can pip install directly from GitHub
You can pip install directly from GitHub
mCoding
 49 __new__ vs __init__ in Python
__new__ vs __init__ in Python
mCoding
 50 Metaclasses in Python
Metaclasses in Python
mCoding
 51 The easy way to keep your repos tidy.
The easy way to keep your repos tidy.
mCoding
 52 Which Python @dataclass is best? Feat. Pydantic, NamedTuple, attrs...
Which Python @dataclass is best? Feat. Pydantic, NamedTuple, attrs...
mCoding
 53 Python __slots__ and object layout explained
Python __slots__ and object layout explained
mCoding
 54 C++ cache locality and branch predictability
C++ cache locality and branch predictability
mCoding
 55 Avoiding import loops in Python
Avoiding import loops in Python
mCoding
 56 25 nooby Python habits you need to ditch
25 nooby Python habits you need to ditch
mCoding
 57 Python staticmethod and classmethod
Python staticmethod and classmethod
mCoding
 58 Building a Python app with Anvil to email me if my website goes down (includes paid features)
Building a Python app with Anvil to email me if my website goes down (includes paid features)
mCoding
 59 31 nooby C++ habits you need to ditch
31 nooby C++ habits you need to ditch
mCoding
 60 Interviewing the creator of C++, Bjarne Stroustrup
Interviewing the creator of C++, Bjarne Stroustrup
mCoding
George Hotz | Programming | tinygrad, starting on CLOUD=1 | Part 2
Next Up
George Hotz | Programming | tinygrad, starting on CLOUD=1 | Part 2
george hotz archive