Applied Deep Learning 2022 - Lecture 10 - Serving, Optimizing, and Practical Aspects

Alexander Pacha · Beginner ·📐 ML Fundamentals ·3y ago

About this lesson

Complete Playlist: https://www.youtube.com/playlist?list=PLNsFwZQ_pkE_QaTwYxoTmmRJHtMXyIAU6 == Literature == 1. Seide et al. 1-Bit Stochastic Gradient Descent and Application to Data-Parallel Distributed Training of Speech DNNs, 2014. 2. Micikevicius, Mixed-Precision Training of Deep Neural Networks, 2017. 3. Addair, What is the difference between FP16 and FP32, 2018. 4. Tensor Processing Unit on Wikipedia. 5. Goyal et al. Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour, 2018. 6. Kim et al. PyTorch Gradual Warmup LR on Github. 7. TensorFlow Data Performance Guide. 8. Prakash, Serving a deep learning model in production using tensorflow-serving, Medium, 2019. 9. Ma et al. Moving Deep Learning into Web Browser: How Far Can We Go?, 2019. 10. Gu et al. Distributed Machine Learning on Mobile Devices: A Survey, 2019. 11. Ramanujan et al. What’s Hidden in a Randomly Weighted Neural Network?, 2019. 12. Frankle et al. Stabilizing the Lottery Ticket Hypothesis, 2019. 13. Singh. Pruning Deep Neural Networks, Medium, 2019. 14. Frankle, Carbin, The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks, 2019. 15. Wilkinson et al. The FAIR Guiding Principles for scientific data management and stewardship, 2016. 16. FAIR Principles website. https://www.go-fair.org/fair-principles/

Original Description

Complete Playlist: https://www.youtube.com/playlist?list=PLNsFwZQ_pkE_QaTwYxoTmmRJHtMXyIAU6 == Literature == 1. Seide et al. 1-Bit Stochastic Gradient Descent and Application to Data-Parallel Distributed Training of Speech DNNs, 2014. 2. Micikevicius, Mixed-Precision Training of Deep Neural Networks, 2017. 3. Addair, What is the difference between FP16 and FP32, 2018. 4. Tensor Processing Unit on Wikipedia. 5. Goyal et al. Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour, 2018. 6. Kim et al. PyTorch Gradual Warmup LR on Github. 7. TensorFlow Data Performance Guide. 8. Prakash, Serving a deep learning model in production using tensorflow-serving, Medium, 2019. 9. Ma et al. Moving Deep Learning into Web Browser: How Far Can We Go?, 2019. 10. Gu et al. Distributed Machine Learning on Mobile Devices: A Survey, 2019. 11. Ramanujan et al. What’s Hidden in a Randomly Weighted Neural Network?, 2019. 12. Frankle et al. Stabilizing the Lottery Ticket Hypothesis, 2019. 13. Singh. Pruning Deep Neural Networks, Medium, 2019. 14. Frankle, Carbin, The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks, 2019. 15. Wilkinson et al. The FAIR Guiding Principles for scientific data management and stewardship, 2016. 16. FAIR Principles website. https://www.go-fair.org/fair-principles/

Watch on YouTube ↗ (saves to browser)

Sign in to unlock AI tutor explanation · ⚡30

Related Reads

IEEE Machine Learning Projects for Final Year Engineering Students

Explore IEEE machine learning projects for final year engineering students to gain practical experience and build a strong portfolio

Medium · Machine Learning

Building a Document Intelligence Pipeline (Or: 80% of Your Data Is in PDFs)

Learn to build a document intelligence pipeline to unlock 80% of your business's unstructured data in PDFs and other documents

Yelp Unifies ML Model Training with Training Orchestrator

Yelp's Training Orchestrator unifies ML model training, replacing individual Spark scripts with a configuration-driven approach, streamlining the training process

How to Select the Right AI Model for Your Project: A Future-Ready Guide

Learn how to select the right AI model for your project with a future-ready approach

Medium · Machine Learning

The Real AI Frontier Isn't Smarter Machines (with Catherine Williams)

Super Data Science: ML & AI Podcast with Jon Krohn