▶ Videos →

📰 Dev.to · Shuntaro Okuma

2 articles · Updated every 3 hours · View all reads

All Articles 185,022 Blog Posts 167,050 Tech Tutorials 49,691 Research Papers 36,752 News 23,030 ⚡ AI Lessons

I Tested 12 LLMs With Few-Shot Examples. The Results Were Not What I Expected.

Dev.to · Shuntaro Okuma 🧠 Large Language Models ⚡ AI Lesson 6mo ago

I Tested 12 LLMs With Few-Shot Examples. The Results Were Not What I Expected.

In a previous article, I tested 8 models across 4 tasks and reported on "few-shot collapse" — cases...

When More Examples Make Your LLM Worse: Discovering Few-Shot Collapse

Dev.to · Shuntaro Okuma 🧠 Large Language Models ⚡ AI Lesson 6mo ago

When More Examples Make Your LLM Worse: Discovering Few-Shot Collapse

I found that adding few-shot examples can actively degrade LLM performance. Here are three patterns I discovered and an open-source tool to detect them.