NVIDIA: Large Language Models and Generative AI Deployment

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

NVIDIA: Large Language Models and Generative AI Deployment

Coursera · Advanced ·🧠 Large Language Models ·3mo ago

Key Takeaways

Deploys Large Language Models and Generative AI using NVIDIA technologies and frameworks

Original Description

NVIDIA: Large Language Models and Generative AI Deployment is the fourth course of the Exam Prep (NCA-GENL): NVIDIA-Certified Generative AI LLMs - Associate Specialization. This course offers a comprehensive understanding of Large Language Models (LLMs) and Generative AI deployment, combining theoretical insights with practical skills. Learners will explore key components of Generative AI, data requirements, and cleaning techniques for LLMs. The course covers model training, optimization, and evaluation methods, including Few-shot, Zero-shot, and Instruction Tuning. Additionally, the course dives into loss functions, alignment techniques, and evaluation metrics such as Perplexity. It also emphasizes the use of GPUs for training, fine-tuning methods like prompt tuning, and Parameter Efficient Fine Tuning (PEFT). Learners will gain expertise in LLM deployment strategies and monitoring with ONNX. This course is divided into three modules, each containing lessons and video lectures. Learners will engage with 4:30-5:00 hours of video content, covering both theoretical concepts and hands-on practices. Each module is equipped with quizzes to reinforce learning and assess understanding. Module 1: Fundamentals of Large Language Models Module 2: Training, Optimization, and Evaluation of LLMs Module 3: LLM Deployment Strategies and Monitoring By the end of this course, a learner will be able to: - Understand the foundational concepts of LLMs, including NLP and training data. - Explore model optimization techniques like loss functions, alignment, and PEFT. - Implement deployment strategies for LLMs and monitor performance using ONNX. This course is intended for professionals looking to deepen their expertise in deploying and optimizing LLMs for Generative AI applications.
Watch on External: Coursera ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
Understanding the Mechanics Behind Open-Weight LLM API Integration: A Deep Dive into Request Lifecycle and Response Hand
Learn how Open-Weight LLM API integration works and how to handle requests and responses effectively, crucial for building efficient AI-powered applications
Dev.to · NovaStack
📰
The Token Standard: Why AI Tokens May Become the New Unit of Work
Discover how AI tokens may revolutionize the concept of work and become a new standard unit, and why this matters for the future of labor and productivity
Medium · LLM
📰
The Visual Reverse Engineering Hypothesis: From Phosphenes to Latent Space
Explore the Visual Reverse Engineering Hypothesis to understand how the brain processes visual information and its potential connection to latent space in machine learning models
Medium · Machine Learning
📰
Text to SQL with Amazon Bedrock and LangChain
Learn to simplify RAG pipelines for structured data using Amazon Bedrock and LangChain with just three prompts and a schema dump
Medium · LLM
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →