Training at Scale
Train large models with mixed precision, gradient checkpointing, and distributed strategies.
0%
Confidence · no data yet
After this skill you can…
- Use FP16/BF16 mixed precision training
- Apply gradient accumulation for large batches
- Set up DDP and FSDP on multi-GPU clusters
Prerequisites
Watch (10 videos)
Lightning Talk: Optimized PyTorch Inference on aarch64 Linux CPUs - Sunita Nadampalli, Amazon (AWS)
→ Optimize PyTorch inference on aarch64 Linux CPUs→ Use Arm compute library for optimization
DeepSpeed: Efficient Training Scalability for Deep Learning - Tunji Ruwase, Snowflake
→ Train large-scale deep learning models→ Optimize compiler for efficiency
Keras 3 Distributed Training: Scaling Models with JAX using DataParallel, and ModelParallel
→ Train large deep learning models→ Use Keras 3 for distributed training
Pushing the Performance Envelope: An Optimization Study for 3... Suvaditya Mukherjee & Shireen Chand
→ Train 3D generative models with PyTorch→ Optimize performance of Variational Autoencoders
Deep Learning with PyTorch Live Course - Training Deep Neural Networks on GPUs (Part 3 of 6)
→ Train neural networks on GPUs→ Implement GANs with PyTorch
Take large scale AI from research to production with Google Cloud's AI Hypercomputer
→ Train large-scale AI models on Google Cloud→ Deploy AI models to production using AI Hypercomputer
Distributed Training using PyTorch with Kubeflow on AWS and AWS DLC - AWS Virtual Workshop
→ Train PyTorch models using Kubeflow on AWS→ Distribute PyTorch training
Distributed ML training with PyTorch and Amazon SageMaker - AWS Virtual Workshop
→ Train PyTorch models using Amazon SageMaker→ Distribute PyTorch training
Finish Work Faster with Acer Nitro 5 equipped with NVIDIA GeForce RTX 3060
→ Train a deep learning model→ Optimize model performance→ Deploy a model
Stock Price Prediction using GRU | Deep Learning Project in Tamil | Gated Recurrent Unit
→ Train a GRU model for stock price prediction→ Optimize deep learning models for time series forecasting
DeepCamp AI