Explainable AI with Shapley Values (Part 1: Game Theory)
Skills:
LLM Foundations80%
Key Takeaways
The video explains the concept of Shapley Values, a game theory concept used in explainable AI, and how it is calculated using mathematical equations and weighted averages.
Full Transcript
Shelby value is a famous game theory concept to understand how shape the values are used in explainable AI let's first understand how it was used in Game Theory it was introduced in 1951 by Lloyd shapley in a Cooperative game with many players shapley value calculates how important is each player to the overall Corporation and what payoff can each player expect so that sounds a little vague what exactly are shapley values and how is it calculated you might have seen those equations showing up everywhere on Wikipedia and in books and some people might get confused by those equations no worries in this video I'm going to help you understand those equations and understand sharply values in Game Theory let's say we are playing a Cooperative game and there are n players we're trying to figure out each player's contribution to the game each player makes a certain contribution to the game let's say Player 1 contributes one point player 2 contributes two points and so on in mathematical terms let's call this contribution function new new one equals 1 New 2 equals 2. you might think well you got an answer already new is each player's contribution it's not that simple players can join forces and when they join forces they might contribute differently for example player 2 and player 3 might be interested in working together and forming a coalition let's call this Coalition s s equals player 2 player three player two and three together contribute 8 points mathematically we write it as new s equals eight if we add player one to this Coalition that is s Union player one and three of them contribute 10 points so how much Point does player one contribute here that'll be two points now we understand how much player one contributes to this Coalition how do we calculate player-wise contribution to the entire game we need to figure out all the possible coalitions and simply take a weighted average of playerwise contribution to all possible coalitions that sounds pretty straightforward in this example with four players in our example without player one there will be three players they can form eight different coalitions we have one Coalition size of zero which is empty meaning that there is no teammate there are three coalitions with size of one player two player 3 and player 4. three coalitions size up two player two three two four and three four and one Coalition size of three how do we know there are three Coalition size of one three coalitions size of two and one Collision sets of three it is because a three choose one is three three choose two is three and three choose three is one so a minus one choose the Collision size will give us the number of different combinations of each Collision size let's rewrite everything in curly bracket so now we're going to calculate player one's contribution to each of those collisions remember the way we calculate player one's contribution in each Coalition is the difference between the contribution of Coalition plus player one and the contribution of the Coalition let's just make up some numbers here then we can calculate a weighted average of those numbers where each denominator in the parenthesis is the number of combinations of each clinician size and the denominator 4 is the number of different sizes of collisions which is also the number of players So based on this equation we get the number 2.5 so that is the contribution of Player 1 to the game which is also the sharply value of player one with the same logic we can calculate the sharply values for each player that is how shareply values are calculated in Game Theory thank you
Original Description
This month our book club is reading the book Explainable AI for Practitioners. I thought the equations of Shapley Values might be confusing for some people, so I made a video : )
References:
https://www.oreilly.com/library/view/explainable-ai-for/9781098119126/
https://christophm.github.io/interpretable-ml-book/shapley.html
🌼 About me 🌼
Sophia Yang is a Senior Data Scientist working at a tech company.
🔔 SUBSCRIBE to my channel: https://www.youtube.com/c/SophiaYangDS?sub_confirmation=1
⭐ Stay in touch ⭐
📚 DS/ML Book Club: http://dsbookclub.github.io/
▶ YouTube: https://youtube.com/SophiaYangDS
✍️ Medium: https://sophiamyang.medium.com
🐦 Twitter: https://twitter.com/sophiamyang
🤝 Linkedin: https://www.linkedin.com/in/sophiamyang/
💚 #datascience
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from Sophia Yang · Sophia Yang · 36 of 60
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
▶
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Customer lifetime value in a discrete-time contractual setting (math and Python implementation)
Sophia Yang
Time series analysis using Prophet in Python — Math explained
Sophia Yang
Multiclass logistic/softmax regression from scratch
Sophia Yang
Deploy a Python Visualization Panel App to Google Cloud App Engine
Sophia Yang
Deploy a Python Visualization Panel App to Google Cloud Run
Sophia Yang
[Read a paper (with code)] Beyond Accuracy: Behavioral Testing of NLP models with CheckList
Sophia Yang
5-step data science workflow
Sophia Yang
Multi-armed bandit algorithms - ETC Explore then Commit
Sophia Yang
Multi-armed bandit algorithms - Epsilon greedy algorithm
Sophia Yang
User retention analysis framework | data science product sense
Sophia Yang
Visualization and Interactive Dashboard in Python: My favorite Python Viz tools — HoloViz
Sophia Yang
Multi-armed bandit algorithms: Thompson Sampling
Sophia Yang
The Easiest Way to Create an Interactive Dashboard in Python
Sophia Yang
Big Data Visualization Using Datashader in Python | How does Datashader work and why is it so fast?
Sophia Yang
Why do you want to be a data scientist? Don't be a data scientist if ...
Sophia Yang
Johnny Depp v Amber Heard Twitter Sentiment Analysis | Is Camille Vasquez the real winner | 🤗 NLP
Sophia Yang
How to build a product that sells itself | Product-led Growth | Book Summary | Read a book with me
Sophia Yang
Designing Machine Learning Systems | book summary | Read a book with me
Sophia Yang
Where do data scientists/analysts go next? Love and hate in data analytics (ft. Shashank Kalanithi)
Sophia Yang
Meet the Author: Fundamentals of Data Engineering | DS/ML book club
Sophia Yang
What's new in hvPlot releases 0.8.0 & 0.8.1?
Sophia Yang
Meet the Author: Machine Learning Design Patterns | What do ML/Research Engineers do at Google?
Sophia Yang
Machine Learning Design Patterns | Google Executive | Investor | Meet the Author
Sophia Yang
How to solve data quality issues | Data Reliability | Meet the Author
Sophia Yang
Reliable Machine Learning author interview | DS/ML book club
Sophia Yang
Toronto VLOG | First vlog | Meet my favorite author | Toronto ML Summit conference
Sophia Yang
TOP 6 tech news in 2022 #shorts
Sophia Yang
How to deploy a Panel app to Hugging Face using Docker?
Sophia Yang
Tech news this week | ChatGPT, Hacks, Snowflake, CES #shorts
Sophia Yang
🗞️ Tech news this week: ChatGPT, DreamerV3, Muse, VALL-E, Mineral, DoNotPay, Tesla, SBF... #shorts
Sophia Yang
Tech news this week | Boston Dynamics, Microsoft, Snowflake, Google, and more #shorts
Sophia Yang
The story of Metaflow | Effective Data Science Infrastructure | Book author interview
Sophia Yang
Tech news this week #shorts
Sophia Yang
A day in life of a data scientist | Data Day Texas | Interview 12 authors/speakers
Sophia Yang
Tech news this week #shorts
Sophia Yang
Explainable AI with Shapley Values (Part 1: Game Theory)
Sophia Yang
Explainable AI with Shapley Values (Part 2: Estimate Shapley Values)
Sophia Yang
Explainable AI with Shapley Values (Part 3: KernelSHAP)
Sophia Yang
Tech news this week | AI search war between Microsoft and Google #shorts
Sophia Yang
The Story of ChatGPT's creator OpenAI | From Riches to Fame
Sophia Yang
Explainable AI for Practitioners | Must-read for XAI | author interview
Sophia Yang
Train your own language model with nanoGPT | Let’s build a songwriter
Sophia Yang
The easiest way to work with large language models | Learn LangChain in 10min
Sophia Yang
The BEST browser? AI article summary, image generation, website insights. Microsoft Edge Copilot!
Sophia Yang
startup scene in data | insights from 50+ data startups from Data Council
Sophia Yang
NLP with Transformers author interview with Lewis Tunstall from Hugging Face
Sophia Yang
4 ways to do question answering in LangChain | chat with long PDF docs | BEST method
Sophia Yang
5 Steps to Build a Question Answering PDF Chatbot: LangChain + OpenAI + Panel + HuggingFace.
Sophia Yang
4 Autonomous AI Agents: “Westworld” simulation, Camel, BabyAGI, AutoGPT, Camel ⭐ LangChain ⭐
Sophia Yang
MiniGPT4: image understanding & open-source!
Sophia Yang
BEST Practices in Prompt Engineering: Learnings and Thoughts from Andrew Ng's New Course
Sophia Yang
Designing Machine Learning Systems author interview with Chip Huyen
Sophia Yang
Tech news this week: code interpreter, Mojo, Redpajama, MPT7b, StarCoder #shorts
Sophia Yang
🤗 Hugging Face Transformers Agent | LangChain comparisons
Sophia Yang
📢 Tech news this week #shorts
Sophia Yang
📢 Tech news this week #shorts
Sophia Yang
The BEST ChatGPT Plugins | Brand NEW Bing Search | Web browsing, CODING, summarizing, and more
Sophia Yang
Tech news this week #shorts #short
Sophia Yang
📢 Tech news this week #shorts
Sophia Yang
Deep Learning with PyTorch Author Interview with Eli Stevens, Luca Antiga, and Thomas Viehmann
Sophia Yang
More on: LLM Foundations
View skill →Related AI Lessons
⚡
⚡
⚡
⚡
Embeddings Simplified
Medium · RAG
I built a tool that cuts Claude/ChatGPT token usage by 97% — here's how it works
Dev.to · Rohith Matam
Serverless AI in a Browser Tab: Java WebAssembly + Local WebGPU LLMs
Dev.to · vishalmysore
Building LSTMs with PyTorch and Lightning AI Part 7: Resuming Training with Checkpoints
Dev.to · Rijul Rajesh
🎓
Tutor Explanation
DeepCamp AI