PyTorch Foundation Spotlight: Simon Mo
Key Takeaways
Simon Mo discusses vLLM becoming a PyTorch Foundation project, highlighting its ecosystem and efficiency focus, built on PyTorch from the beginning, with a goal to drive ease of use and efficiency for large language models in enterprise and organizations.
Full Transcript
VR has [music] become a PyTorch Foundation project as of May 2025 and this actually has been a long time in the making in the sense that VR has been built on top [music] of PyTorch from day one. It is fundamentally an ecosystem where we work [music] with people who build the model like Meta, Quinn, OpenAI as well as the accelerator companies like [music] Nvidia, AMD, Intel, many of them are PyTorch sponsors that directly match making sure that all the model can be run on [music] VM efficiently on all the hardware. VM's primary focus is to drive ease of [music] use and efficiency. One of the key barrier to adopting large language models in enterprise and organization today is how hard it is and how expensive it is to use. By leveraging [music] open source systems, a lot of users can use this on day [music] one to be able to get value out of it. And additionally, VLM keep driving the frontier of efficiency forward so that you can always achieve the lowest cost possible on a given hardware to serve [music] the model. VM's goal is to become the easiest to use and most efficient inference engine that will help [music] driving the progress of AI forward.
Original Description
In this PyTorch Foundation Spotlight, Simon Mo discusses vLLM becoming a PyTorch Foundation project and why that milestone reflects years of building directly on PyTorch from the beginning.
Simon explains how vLLM works within a broad ecosystem that includes model builders and hardware providers, many of whom are PyTorch sponsors, to ensure models can run efficiently across different accelerators. He shares vLLM’s focus on ease of use and efficiency, the barriers organizations face when adopting large language models, and how vLLM helps users get value quickly while continuing to push the frontier of inference efficiency and cost optimization.
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
Playlist
Uploads from PyTorch · PyTorch · 0 of 60
← Previous
Next →
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
What is PyTorch?
PyTorch
PyTorch Tutorial: A Quick Preview
PyTorch
PyTorch Summer Hackathon 2019
PyTorch
Tips and Tricks on Hacking with PyTorch: A Quick Tutorial by Brad Heintz
PyTorch
PyTorch 1.2 and PyTorch Hub: A Quick Introduction by Soumith Chintala and Ailing Zhang
PyTorch
Torchtext 0.4 with Supervised Learning Datasets: A Quick Introduction by George Zhang
PyTorch
Torchaudio 0.3 with Kaldi Compatibility, New Transforms: A Quick Introduction by Jason Lian
PyTorch
Torchvision 0.4 with Support for Video: A Quick Introduction by Francisco Massa
PyTorch
Introduction to Machine Learning for Developers at F8 2019
PyTorch
Powered by PyTorch at F8 2019
PyTorch
Developing and Scaling AI Experiences at Facebook with PyTorch at F8 2019
PyTorch
New Approaches to Image and Video Reconstruction Using Deep Learning at Facebook at F8 2019
PyTorch
PyTorch Developer Conference 2018: Recap
PyTorch
PyTorch Developer Conference 2018: Keynote & Deep Dive
PyTorch
PyTorch Developer Conference 2018: Production & Research Sessions
PyTorch
PyTorch Developer Conference 2018: Cloud & Academia Sessions
PyTorch
PyTorch Developer Conference 2018: Enterprise, Education, & Future of AI Panel
PyTorch
PyTorch Developer Conference 2019 | Full Livestream
PyTorch
PyTorch Developer Conference 2019: Recap
PyTorch
PyTorch Developer Conference Keynote - Mike Schroepfer
PyTorch
What’s new in PyTorch 1.3 - Lin Qiao
PyTorch
PyTorch Front-End Features: Named Tensors and Type Promotion - Gregory Chanan
PyTorch
Research to Production: PyTorch JIT/TorchScript Updates - Michael Suo
PyTorch
Quantization - Dmytro Dzhulgakov
PyTorch
PyTorch ONNX Export Support - Lara Haidar, Microsoft
PyTorch
Apex - Michael Carilli, NVIDIA
PyTorch
Dataloader Design for PyTorch - Tongzhou Wang, MIT
PyTorch
Linear Algebra in PyTorch - Vishwak Srinivasan, CMU
PyTorch
PyTorch Mobile - David Reiss
PyTorch
Model Interpretability with Captum - Narine Kokhilkyan
PyTorch
Detectron2 - Next Gen Object Detection Library - Yuxin Wu
PyTorch
Speech Extensions to Fairseq - Dmytro Okhonko
PyTorch
PyTorch on Google Cloud TPUs - Google, Salesforce, Facebook
PyTorch
PyTorch Summer Hackathon Winners - Joe Spisak, Sebastien Arnold, Tristan Deleu
PyTorch
PyTorch in Robotics - Yisong Yue, Caltech
PyTorch
StanfordNLP - Yuhao Zhang, Stanford
PyTorch
Sotabench for Reproducible Research - Robert Stojnic, Papers with Code
PyTorch
Collaborative Natural Language Inference - Sasha Rush, Cornell
PyTorch
Privacy Preserving AI - Andrew Trask, OpenMined
PyTorch
CrypTen - Laurens van der Maaten
PyTorch
PyTorch at Uber - Sidney Zhang, Uber
PyTorch
PyTorch at Tesla - Andrej Karpathy, Tesla
PyTorch
PyTorch at Microsoft - Saurabh Tiwary, Microsoft
PyTorch
PyTorch at Dolby Labs - Vivek Kumar, Dolby Labs
PyTorch
PyTorch Developer Conference 2019 - Panel Discussion
PyTorch
Using deep learning and PyTorch to power next gen aircraft at Caltech
PyTorch
Named Tensors, Model Quantization, and the Latest PyTorch Features - Part 1
PyTorch
TorchScript and PyTorch JIT | Deep Dive
PyTorch
Announcing the PyTorch Global Summer Hackathon 2020
PyTorch
Opening Up the Black Box: Model Understanding with Captum and PyTorch
PyTorch
PyTorch Mobile Runtime for Android
PyTorch
Torchvision in 5 minutes
PyTorch
3D Deep Learning with PyTorch3D
PyTorch
What is Torchtext?
PyTorch
TorchAudio: A Quick Intro
PyTorch
PyTorch Mobile Runtime for iOS
PyTorch
PySlowFast: Deep learning with Video
PyTorch
PyTorch Pruning | How it's Made by Michela Paganini
PyTorch
Measuring Fairness in Machine Learning Systems
PyTorch
PyTorch for Hackathons
PyTorch
More on: LLM Foundations
View skill →Related Reads
📰
📰
📰
📰
Threads users can now chat with Meta AI in their DMs
TechCrunch AI
Beyond RAG: Task-aware knowledge compression for enterprise AI on AWS
AWS Machine Learning
Four Vectors, One Record: How I Split Embeddings Before They Hit Search
Dev.to · Daniel Romitelli
Can a Single Token Reveal Which Model Is Behind an API?
Dev.to AI
🎓
Tutor Explanation
DeepCamp AI