Skills › MLOps & LLMOps

LLMOps

Operate LLM applications in production — evals, prompt versioning, and observability.

0%
Confidence · no data yet
Sign in to track

After this skill you can…

  • Set up LangSmith or Langfuse for LLM tracing
  • Version and test prompts in a CI pipeline
  • Monitor token costs, latency, and quality metrics

Prerequisites

Watch (10 videos)

LLMOPS 06: CI/CD Deployment with AWS ECS & Fargate | End-to-End GenAI Project Deployment
Sunny Savita · intermediate hands-on
→ Deploy GenAI models with AWS ECS and Fargate→ Implement CI/CD pipelines for LLMOPS
Deploy ComfyUI Docker Container on MonsterAPI
MonsterAPI · intermediate hands-on
→ Deploy custom LLM models on MonsterAPI→ Finetune LLMs with GPU computing
Detailed LLMOPs Project Lifecycle
Krish Naik · intermediate hands-on
→ Deploy LLMOPs projects→ Take AI projects to production
4. LLM Ops Infrastructure: Model Serving, RAG Pipelines, and Observability
Analytics Vidhya · advanced hands-on
→ Build LLM Ops Infrastructure→ Implement model serving and RAG pipelines
Model CI/CD Course: LLM Evaluation results
Weights & Biases · intermediate hands-on
→ Deploy LLM models to production→ Automate LLM evaluation pipelines
OpenClaw is open! Run your 24x7 Clawdbot on a Secure VPS!
1littlecoder · beginner hands-on
→ Deploy an AI assistant on VPS→ Use Docker for AI deployment
Build and Deploy a GenAI App with RAG on AWS Cloud | Step-by-Step Tutorial
Analytics Vidhya · intermediate hands-on
→ Deploy GenAI app on cloud→ Build RAG-based chatbot
Develop Build and Deploy LLM Apps using GitHub Models and Azure AI Foundry | BRK107
Microsoft Developer · intermediate hands-on
→ Deploy an LLM model to production using Azure AI Foundry→ Build an LLM app using GitHub Models
Workshop: MLOps: End-to-End Hugging Face Transformers with the Hub & SageMaker Pipelines
HuggingFace · intermediate hands-on
→ Deploy Hugging Face Transformers to production→ Create automated MLOps pipelines
Scaling your tuned models with Cloud Run
Google Cloud Tech · beginner hands-on
→ Deploy AI models on cloud infrastructure→ Scale models for high performance

Read (10 articles)

📄
End to end LLMOps Pipeline - Part 2 - FastAPI
Dev.to · Prashant Lakhera · 2024-08-13
📄
Project of the Week: Dify
Dev.to · Riyana Patel · 2025-09-19
📄
The Infrastructure Layer Enterprises Need for Production LLM Systems
Dev.to · Emmanuel Mumba · 2026-03-04
📄
# Treating Prompts Like Code: Building CI/CD for LLM Workflows on AWS
Dev.to · Dhananjay Lakkawar · 2026-03-24
📄
From MLOps to LLMOps: A Practical AWS GenAI Operations Guide
Dev.to · N Chandra Prakash Reddy · 2026-04-03