All
Articles 110,091Blog Posts 120,723Tech Tutorials 28,047Research Papers 22,439News 16,533
⚡ AI Lessons
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
6d ago
Loaded Crossplane's full doc set into a 1M context model to speed up our evaluation
We've been evaluating Crossplane for about 8 weeks. Our Terraform setup covers 3 cloud providers, around 40 modules, and state management across teams keeps get
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
6d ago
LiteLLM is becoming much more than just an LLM gateway. Has anyone actually deployed its Datadog integration in production?
I've been evaluating LiteLLM's Datadog integration in a test environment, and it looks much more comprehensive than I expected. Beyond basic logging, it include
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
3w ago
AI log analyser : How do you filter logs and define what is actually an incident vs noise?
I’m building an AI log analyzer for AWS Glue + CloudWatch logs and got stuck on one problem: How do you decide which logs should actually be marked as “errors”?
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
3w ago
prompt drift is an operations nightmare. we started using gitops for our agents.
We’ve been running a few LLM agents in production and managing them has been a complete mess from an operations perspective. Right now, most teams seem to store
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
3w ago
Built this dev tool to help fine tune vLLM server
It measures live GPU and scheduler telemetry against your hardware’s real decode/prefill ceiling. Traffic-Gated Analysis: Idle servers are ignored. Under load,
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
1mo ago
Putting guardrails around llm calls before they become an incident
We had an internal support triage service call an llm to classify tickets and suggest next actions. Boring use case, low traffic, nobody considered it productio
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
1mo ago
Our LLM traffic was invisible to oncall until we made it look like normal RPC
Bit of a rant after this week. We had a degraded period where our internal code-review assistant was timing out for about 40 minutes before anyone noticed. Onca
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
1mo ago
LLM / Chat recommendation / preferences ?
I may have missed this topic if this was once a conversation on here, so apologies, but curious what you all are using to help with troubleshooting something yo
Reddit r/devops
🧠 Large Language Models
⚡ AI Lesson
1mo ago
How are you securing the DBs when product teams deploy LLM agents?
Product teams are starting to ship autonomous agents that have access to our internal APIs and databases. From an infra/security perspective, how are you standa
DeepCamp AI