OpenAI vs. Deepseek vs. Qwen: Comparing Open Source LLM Architectures
OpenAI recently released its first open-weights model since GPT-2, entering a field led by DeepSeek and Alibaba's Qwen.
YC's Ankit Gupta breaks down everything you need to know about these top OSS models, including what sets them apart under the hood. He’ll compare their approaches to mixture-of-experts, long-context training, and post-training techniques that shape reasoning and alignment—and explore how different design choices lead to surprisingly similar performance.
Apply to Y Combinator: https://www.ycombinator.com/apply
Work at a startup: https://www.ycombinator.com/jobs
00:00 – Open…
Watch on YouTube ↗
(saves to browser)
Chapters (15)
OpenAI OSS Launch
1:00
Comparing Open Source LLM Architectures
1:46
GPT OSS Overview
2:37
Under The Hood of GPT OSS
3:25
Qwen-3 Architecture
4:17
Qwen-3 Training
5:12
Qwen-3 Post-Training
6:08
Qwen-3 Reasoning & RL Innovations
6:52
DeepSeek V3 Overview
7:40
DeepSeek V3.1 Updates
8:39
Attention Mechanism (MLA)
9:39
Comparing Model Sizes
10:35
Long Context Strategies
11:25
Reflections on Methods
12:00
Takeaways
Playlist
Uploads from Y Combinator · Y Combinator · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
Mark Zuckerberg at Startup School 2012
Y Combinator
Jessica Livingston at Startup School 2012
Y Combinator
Ben Silbermann at Startup School 2012
Y Combinator
David Rusenko at Startup School 2012
Y Combinator
Tom Preston Werner at Startup School 2012
Y Combinator
Joel Spolsky at Startup School 2012
Y Combinator
Travis Kalanick at Startup School 2012
Y Combinator
Hiroshi Mikitani at Startup School 2012
Y Combinator
Ron Conway at Startup School 2012
Y Combinator
Balaji Srinivasan at Startup School 2013
Y Combinator
Chris Dixon at Startup School 2013
Y Combinator
Dan Siroker at Startup School 2013
Y Combinator
Diane Greene at Startup School 2013
Y Combinator
Jack Dorsey at Startup School 2013
Y Combinator
Mark Zuckerberg at Startup School 2013
Y Combinator
Nate Blecharczyk at Startup School 2013
Y Combinator
Phil Libin at Startup School 2013
Y Combinator
Ron Conway at Startup School 2013
Y Combinator
Office Hours at Startup School 2013 with Paul Graham and Sam Altman
Y Combinator
Chase Adam at Startup School 2013
Y Combinator
Jessica Livingston at Female Founders Conference 2014
Y Combinator
Julia Hartz at Female Founders Conference 2014
Y Combinator
Elli Sharef at Female Founders Conference 2014
Y Combinator
Kathryn Minshew at Female Founders Conference 2014
Y Combinator
Elizabeth Iorns at Female Founders Conference 2014
Y Combinator
Jessica Mah at Female Founders Conference 2014
Y Combinator
Office Hours at Startup School NY 2014
Y Combinator
Apoorva Mehta at Startup School NY 2014
Y Combinator
David Lee at Startup School NY 2014
Y Combinator
Chase Adam at Startup School NY 2014
Y Combinator
Closing Remarks at Startup School NY 2014
Y Combinator
Introduction at Startup School NY 2014
Y Combinator
Shana Fisher at Startup School NY 2014
Y Combinator
Zach Sims at Startup School NY 2014
Y Combinator
Kathryn Minshew at Startup School NY 2014
Y Combinator
Adora Cheung
Y Combinator
Ian Hogarth
Y Combinator
Hiroki Takeuchi
Y Combinator
Alfred Lin with Justin Kan
Y Combinator
Urska Srsen
Y Combinator
Office Hours with Kevin & Qasar
Y Combinator
Paul Buchheit
Y Combinator
Y Combinator Partners Q&A
Y Combinator
Eric Migicovsky at Startup School SV 2014
Y Combinator
Jim Goetz and Jan Koum at Startup School SV 2014
Y Combinator
Michelle Zatlyn and Matthew Prince at Startup School SV 2014
Y Combinator
Jessica Livingston Introduces Startup School SV 2014
Y Combinator
Danae Ringelmann at Startup School SV 2014
Y Combinator
Hosain Rahman at Startup School SV 2014
Y Combinator
Kevin Systrom at Startup School SV 2014
Y Combinator
Emmett Shear at Startup School SV 2014
Y Combinator
Reid Hoffman at Startup School SV 2014
Y Combinator
Ron Conway at Startup School SV 2014
Y Combinator
Andrew Mason at Startup School SV 2014
Y Combinator
Tracy Young Speaks at Female Founders Conference 2015
Y Combinator
Ruchi Sanghvi Speaks at Female Founders Conference 2015
Y Combinator
Kimberly Bryant Speaks at Female Founders Conference 2015
Y Combinator
Fundraising Panel at Female Founders Conference 2015
Y Combinator
Jessica Livingston Speaks at Female Founders Conference 2015
Y Combinator
Adora Cheung Speaks at Female Founders Conference 2015
Y Combinator
DeepCamp AI