Applied Deep Learning 2022 - Lecture 10 - Serving, Optimizing, and Practical Aspects

Alexander Pacha · Beginner ·📐 ML Fundamentals ·3y ago

About this lesson

Complete Playlist: https://www.youtube.com/playlist?list=PLNsFwZQ_pkE_QaTwYxoTmmRJHtMXyIAU6 == Literature == 1. Seide et al. 1-Bit Stochastic Gradient Descent and Application to Data-Parallel Distributed Training of Speech DNNs, 2014. 2. Micikevicius, Mixed-Precision Training of Deep Neural Networks, 2017. 3. Addair, What is the difference between FP16 and FP32, 2018. 4. Tensor Processing Unit on Wikipedia. 5. Goyal et al. Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour, 2018. 6. Kim et al. PyTorch Gradual Warmup LR on Github. 7. TensorFlow Data Performance Guide. 8. Prakash, Serving a deep learning model in production using tensorflow-serving, Medium, 2019. 9. Ma et al. Moving Deep Learning into Web Browser: How Far Can We Go?, 2019. 10. Gu et al. Distributed Machine Learning on Mobile Devices: A Survey, 2019. 11. Ramanujan et al. What’s Hidden in a Randomly Weighted Neural Network?, 2019. 12. Frankle et al. Stabilizing the Lottery Ticket Hypothesis, 2019. 13. Singh. Pruning Deep Neural Networks, Medium, 2019. 14. Frankle, Carbin, The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks, 2019. 15. Wilkinson et al. The FAIR Guiding Principles for scientific data management and stewardship, 2016. 16. FAIR Principles website. https://www.go-fair.org/fair-principles/

Original Description

Complete Playlist: https://www.youtube.com/playlist?list=PLNsFwZQ_pkE_QaTwYxoTmmRJHtMXyIAU6 == Literature == 1. Seide et al. 1-Bit Stochastic Gradient Descent and Application to Data-Parallel Distributed Training of Speech DNNs, 2014. 2. Micikevicius, Mixed-Precision Training of Deep Neural Networks, 2017. 3. Addair, What is the difference between FP16 and FP32, 2018. 4. Tensor Processing Unit on Wikipedia. 5. Goyal et al. Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour, 2018. 6. Kim et al. PyTorch Gradual Warmup LR on Github. 7. TensorFlow Data Performance Guide. 8. Prakash, Serving a deep learning model in production using tensorflow-serving, Medium, 2019. 9. Ma et al. Moving Deep Learning into Web Browser: How Far Can We Go?, 2019. 10. Gu et al. Distributed Machine Learning on Mobile Devices: A Survey, 2019. 11. Ramanujan et al. What’s Hidden in a Randomly Weighted Neural Network?, 2019. 12. Frankle et al. Stabilizing the Lottery Ticket Hypothesis, 2019. 13. Singh. Pruning Deep Neural Networks, Medium, 2019. 14. Frankle, Carbin, The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks, 2019. 15. Wilkinson et al. The FAIR Guiding Principles for scientific data management and stewardship, 2016. 16. FAIR Principles website. https://www.go-fair.org/fair-principles/

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

The Hidden Reason Self-Taught Data Scientists Are Failing Technical Interviews in 2026

Self-taught data scientists are failing technical interviews due to a lack of production-level experience, learn how to bridge this gap

Medium · Python

Designing Scalable Data Pipelines for Machine Learning Applications

Learn to design scalable data pipelines for machine learning applications to avoid project failures

Dev.to · Eva Clari

Is there a name for this: local model holds your context, cloud model never sees the raw data? [D]

Learn about local-first and cloud-based models for personal data management and their trade-offs between capability and privacy

Reddit r/MachineLearning

Correlated-Error Forecasting: Calibrating Multivariate Predictions with Residual Dependencies

Learn to calibrate multivariate predictions with residual dependencies using a plug-and-play covariance model for sequential probabilistic forecasting

Medium · Deep Learning

How to Train AI to Play Games ? How AI Learns to Play ? Several Methods EXPLAINED