NVIDIA: Large Language Models and Generative AI Deployment

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

NVIDIA: Large Language Models and Generative AI Deployment

Coursera · Advanced ·🧠 Large Language Models ·3mo ago

Key Takeaways

Deploys Large Language Models and Generative AI using NVIDIA technologies and frameworks

Original Description

NVIDIA: Large Language Models and Generative AI Deployment is the fourth course of the Exam Prep (NCA-GENL): NVIDIA-Certified Generative AI LLMs - Associate Specialization. This course offers a comprehensive understanding of Large Language Models (LLMs) and Generative AI deployment, combining theoretical insights with practical skills. Learners will explore key components of Generative AI, data requirements, and cleaning techniques for LLMs. The course covers model training, optimization, and evaluation methods, including Few-shot, Zero-shot, and Instruction Tuning. Additionally, the course dives into loss functions, alignment techniques, and evaluation metrics such as Perplexity. It also emphasizes the use of GPUs for training, fine-tuning methods like prompt tuning, and Parameter Efficient Fine Tuning (PEFT). Learners will gain expertise in LLM deployment strategies and monitoring with ONNX. This course is divided into three modules, each containing lessons and video lectures. Learners will engage with 4:30-5:00 hours of video content, covering both theoretical concepts and hands-on practices. Each module is equipped with quizzes to reinforce learning and assess understanding. Module 1: Fundamentals of Large Language Models Module 2: Training, Optimization, and Evaluation of LLMs Module 3: LLM Deployment Strategies and Monitoring By the end of this course, a learner will be able to: - Understand the foundational concepts of LLMs, including NLP and training data. - Explore model optimization techniques like loss functions, alignment, and PEFT. - Implement deployment strategies for LLMs and monitor performance using ONNX. This course is intended for professionals looking to deepen their expertise in deploying and optimizing LLMs for Generative AI applications.
Watch on External: Coursera ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

📰
After Artificial Intelligence: Why AI Is Not the Final Category
Explore the concept of Artificial Sapiens and its relation to AI's evolution, and why AI may not be the final category in intelligent systems
Medium · Machine Learning
📰
LLMs Can’t Say: “I Don’t Know”
LLMs lack the ability to say 'I don't know', which can lead to providing incorrect or harmful information, and it's crucial to acknowledge and address this limitation
Medium · LLM
📰
What Happens Inside an AI Model After Fine-Tuning?
Discover what happens inside an AI model after fine-tuning and why it matters for improving model performance
Medium · LLM
📰
Field Notes: The LLM is not a security boundary
Learn why LLMs cannot be trusted as a security boundary in production systems and how to design around this limitation
Dev.to · Raj Murugan
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →