AWS CloudWatch for LLM Monitoring: Track Metrics and Set Alerts for Bedrock Models

In this video, we walk through how to use AWS CloudWatch to monitor and alert on Large Language Models deployed on Amazon Bedrock. You’ll learn how to observe default LLM metrics like input tokens, output tokens, and invocation latency, and how to extend CloudWatch with custom metrics such as Time To First Token (TTFT). We also cover setting up alarms and email notifications so you can proactively catch issues in production. You’ll learn how to: Monitor Bedrock LLMs using CloudWatch default metrics Track input tokens, output tokens, and invocation latency Add a custom CloudWatch metric fo…