Building Ambient AI Medical Scribes: Best Practices
๐ Best practices for building ambient AI scribes: https://www.assemblyai.com/docs/medical-scribe-best-practices?utm_source=youtube&utm_medium=referral&utm_campaign=tutorials&utm_content=mart_ambient_scribe
Learn how to build a simple AI ambient medical scribe in Python using AssemblyAI.
In this tutorial, we start with a basic transcription request in under 30 lines of code and incrementally add features that matter in real clinical workflows. Youโll see how to improve medical transcription accuracy with key terms, label speakers by role (doctor vs. patient), generate SOAP notes using LLMs, and apply PII redaction to protect patient privacy.
Weโll also cover how to delete transcription and LLM data after processing so your application meets strict data retention and privacy requirements. By the end, youโll have a practical foundation for building a production-ready ambient medical scribe.
Timestamps:
00:00 โ Intro: Why accuracy and privacy matter for AI medical scribes
00:40 โ Building a basic transcription pipeline in Python
01:01 โ Speaker identification (doctor vs. patient)
02:18 โ Generating SOAP notes with LLMs
02:56 โ PII redaction and data privacy
03:40 โ Deleting data and retention best practices
04:57 โ Final recap
โฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌ CONNECT โฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌ
๐ฅ๏ธ Website: https://www.assemblyai.com
๐ฆ Twitter: https://twitter.com/AssemblyAI
๐ฆพ Discord: https://discord.gg/Cd8MyVJAXd
โถ๏ธ Subscribe: https://www.youtube.com/c/AssemblyAI?sub_confirmation=1
๐ฅ We're hiring! Check our open roles: https://www.assemblyai.com/careers
โฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌ
Watch on YouTube โ
(saves to browser)
Sign in to unlock AI tutor explanation ยท โก30
Playlist
Uploads from AssemblyAI ยท AssemblyAI ยท 0 of 60
โ Previous
Next โ
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Python Speech Recognition in 5 Minutes
AssemblyAI
Python Click Part 1 of 4
AssemblyAI
Python Click Part 2 of 4
AssemblyAI
Python Click Part 3 of 4
AssemblyAI
Python Click Part 4 of 4
AssemblyAI
Deep learning in 5 minutes | What is deep learning?
AssemblyAI
How to make a web app that transcribes YouTube videos with Streamlit | Part 1
AssemblyAI
How to make a web app that transcribes YouTube videos with Streamlit | Part 2
AssemblyAI
Batch normalization | What it is and how to implement it
AssemblyAI
Real-time Speech Recognition in 15 minutes with AssemblyAI
AssemblyAI
Regularization in a Neural Network | Dealing with overfitting
AssemblyAI
Add speech recognition to your Streamlit apps in 5 minutes
AssemblyAI
Transformers for beginners | What are they and how do they work
AssemblyAI
Automatic Chapter Detection With AssemblyAI | Python Tutorial
AssemblyAI
Deep Learning Series Part 1 - What is Deep Learning?
AssemblyAI
Deep Learning Series part 2 - Why is it called โDeep Learningโ?
AssemblyAI
Activation Functions In Neural Networks Explained | Deep Learning Tutorial
AssemblyAI
Deep Learning Series part 3 - Deep Learning vs. Machine Learning
AssemblyAI
Deep Learning Series part 4 - Why is Deep Learning better for NLP?
AssemblyAI
Intro to Batch Normalization Part 1
AssemblyAI
Intro to Batch Normalization Part 2
AssemblyAI
Intro to Batch Normalization Part 3 - What is Normalization?
AssemblyAI
Intro to Batch Normalization Part 4
AssemblyAI
Intro to Batch Normalization Part 5
AssemblyAI
Sentiment Analysis for Earnings Calls with AssemblyAI
AssemblyAI
Summarizing my favorite podcasts with Python
AssemblyAI
Introduction to Regularization
AssemblyAI
How/Why Regularization in Neural Networks?
AssemblyAI
Getting Started With Torchaudio | PyTorch Tutorial
AssemblyAI
Types of Regularization
AssemblyAI
Tuning Alpha in L1 and L2 Regularization
AssemblyAI
Dropout Regularization
AssemblyAI
What is GPT-3 and how does it work? | A Quick Review
AssemblyAI
Backpropagation For Neural Networks Explained | Deep Learning Tutorial
AssemblyAI
Jupyter Notebooks Tutorial | How to use them & tips and tricks!
AssemblyAI
Best Free Speech-To-Text APIs and Open Source Libraries
AssemblyAI
Regularization - Early stopping
AssemblyAI
Regularization - Data Augmentation
AssemblyAI
Bias and Variance for Machine Learning | Deep Learning
AssemblyAI
Recurrent Neural Networks (RNNs) Explained - Deep Learning
AssemblyAI
What is BERT and how does it work? | A Quick Review
AssemblyAI
Introduction to Transformers
AssemblyAI
Transformers | What is attention?
AssemblyAI
Transformers | how attention relates to Transformers
AssemblyAI
Transformers | Basics of Transformers
AssemblyAI
Supervised Machine Learning Explained For Beginners
AssemblyAI
Transformers | Basics of Transformers Encoders
AssemblyAI
Transformers | Basics of Transformers I/O
AssemblyAI
How to evaluate ML models | Evaluation metrics for machine learning
AssemblyAI
Unsupervised Machine Learning Explained For Beginners
AssemblyAI
Weight Initialization for Deep Feedforward Neural Networks
AssemblyAI
Q-Learning Explained - Reinforcement Learning Tutorial
AssemblyAI
Should You Use PyTorch or TensorFlow in 2022?
AssemblyAI
What is Layer Normalization? | Deep Learning Fundamentals
AssemblyAI
I created a Python App to study FASTER
AssemblyAI
How to create your FIRST NEURAL NETWORK with TensorFlow!
AssemblyAI
Neural Networks Summary: All hyperparameters
AssemblyAI
Getting Started with OpenAI API and GPT-3 | Beginner Python Tutorial
AssemblyAI
Convert Speech-To-Text In Python in 60 seconds!
AssemblyAI
Gradient Clipping for Neural Networks | Deep Learning Fundamentals
AssemblyAI
More on: AI Pair Programming
View skill โRelated AI Lessons
โก
โก
โก
โก
Why You Accidentally Built a 5-App AI Stack
Dev.to ยท ForgeWorkflows
Doorbell Cameras Are Becoming Real-Time Awareness Systems
Medium ยท AI
I Built a Fully Automated YouTube Channel That Uploads Every Day - Without Touching It
Dev.to ยท Shuvo
I Didnโt Believe Free AI Tools Could Replace Paid Softwareโฆ Until This Happened
Medium ยท ChatGPT
Chapters (7)
Intro: Why accuracy and privacy matter for AI medical scribes
0:40
Building a basic transcription pipeline in Python
1:01
Speaker identification (doctor vs. patient)
2:18
Generating SOAP notes with LLMs
2:56
PII redaction and data privacy
3:40
Deleting data and retention best practices
4:57
Final recap
๐
Tutor Explanation
DeepCamp AI