✕ Clear all filters
9 articles
▶ Videos →

📰 Reddit r/devops

9 articles · Updated every 3 hours · View all reads

All Articles 110,091Blog Posts 120,723Tech Tutorials 28,047Research Papers 22,439News 16,533 ⚡ AI Lessons
Reddit r/devops 🧠 Large Language Models ⚡ AI Lesson 3w ago
Built this dev tool to help fine tune vLLM server
It measures live GPU and scheduler telemetry against your hardware’s real decode/prefill ceiling. Traffic-Gated Analysis: Idle servers are ignored. Under load,
Reddit r/devops 🧠 Large Language Models ⚡ AI Lesson 1mo ago
Putting guardrails around llm calls before they become an incident
We had an internal support triage service call an llm to classify tickets and suggest next actions. Boring use case, low traffic, nobody considered it productio
Reddit r/devops 🧠 Large Language Models ⚡ AI Lesson 1mo ago
Our LLM traffic was invisible to oncall until we made it look like normal RPC
Bit of a rant after this week. We had a degraded period where our internal code-review assistant was timing out for about 40 minutes before anyone noticed. Onca
Reddit r/devops 🧠 Large Language Models ⚡ AI Lesson 1mo ago
LLM / Chat recommendation / preferences ?
I may have missed this topic if this was once a conversation on here, so apologies, but curious what you all are using to help with troubleshooting something yo
Reddit r/devops 🧠 Large Language Models ⚡ AI Lesson 1mo ago
How are you securing the DBs when product teams deploy LLM agents?
Product teams are starting to ship autonomous agents that have access to our internal APIs and databases. From an infra/security perspective, how are you standa