SetFit: Efficient Few-Shot Learning Without Prompts

📰 Hugging Face Blog

SetFit enables efficient few-shot learning without prompts, outperforming standard fine-tuning in sample efficiency and robustness to noise

advanced Published 26 Sept 2022
Action Steps
  1. Understand the concept of few-shot learning and its challenges
  2. Explore the SetFit approach and its advantages over standard fine-tuning
  3. Evaluate the performance of SetFit using benchmarking tools and datasets
  4. Train and fine-tune models using SetFit for specific use cases
Who Needs to Know This

Machine learning engineers and researchers can benefit from SetFit to improve the performance of their models with limited training data, while product managers can leverage this technology to develop more efficient AI-powered products

Key Insight

💡 SetFit achieves significant improvements in sample efficiency and robustness to noise compared to standard fine-tuning

Share This
🚀 SetFit revolutionizes few-shot learning without prompts! 💡

Key Takeaways

SetFit enables efficient few-shot learning without prompts, outperforming standard fine-tuning in sample efficiency and robustness to noise

Full Article

Published Time: 2022-09-26T00:00:00.129Z

# SetFit: Efficient Few-Shot Learning Without Prompts

[![Image 1: Hugging Face's logo](https://huggingface.co/front/assets/huggingface_logo-noborder.svg)Hugging Face](https://huggingface.co/)

* [Models](https://huggingface.co/models)
* [Datasets](https://huggingface.co/datasets)
* [Spaces](https://huggingface.co/spaces)
* [Buckets new](https://huggingface.co/storage)
* [Docs](https://huggingface.co/docs)
* [Enterprise](https://huggingface.co/enterprise)
* [Pricing](https://huggingface.co/pricing)
*
*
* * *

* [Log In](https://huggingface.co/login)
* [Sign Up](https://huggingface.co/join)

[Back to Articles](https://huggingface.co/blog)

# [](https://huggingface.co/blog/setfit#setfit-efficient-few-shot-learning-without-prompts) SetFit: Efficient Few-Shot Learning Without Prompts

Published September 26, 2022

[Update on GitHub](https://github.com/huggingface/blog/blob/main/setfit.md)

[- [x] Upvote 40](https://huggingface.co/login?next=%2Fblog%2Fsetfit)
* [![Image 2](https://cdn-avatars.huggingface.co/v1/production/uploads/6055ae5d25cd24537dd59dc5/eswozkCirLrnyhufN8_-f.jpeg)](https://huggingface.co/danielkorat "danielkorat")
* [![Image 3](https://cdn-avatars.huggingface.co/v1/production/uploads/1664643955283-60570320cbe9c7542f3501e3.jpeg)](https://huggingface.co/orenpereg "orenpereg")
* [![Image 4](https://huggingface.co/avatars/c8f51fbfa46dd7eff41dcd1ea9d405e9.svg)](https://huggingface.co/taners "taners")
* [![Image 5](https://cdn-avatars.huggingface.co/v1/production/uploads/1657654655919-62cdcba79403ec4719d465f5.jpeg)](https://huggingface.co/Ivanrs "Ivanrs")
* [![Image 6](https://cdn-avatars.huggingface.co/v1/production/uploads/6303ea40a362e7e8b51cea6b/D6zeTWnTxzgXBIuYSp84f.jpeg)](https://huggingface.co/bethrezen "bethrezen")
* [![Image 7](https://cdn-avatars.huggingface.co/v1/production/uploads/6304ec75bad6ce7fc028eefa/8-tfqzA47Z77qEDjUibJy.jpeg)](https://huggingface.co/pkghf "pkghf")
* +34

[![Image 8: Unso Eun Seo Jo's avatar](https://huggingface.co/avatars/e9db9a03b69a339bf57777132ef9508e.svg)](https://huggingface.co/Unso)

[Unso Eun Seo Jo Unso Follow](https://huggingface.co/Unso)

[![Image 9: Lewis Tunstall's avatar](https://cdn-avatars.huggingface.co/v1/production/uploads/1594651707950-noauth.jpeg)](https://huggingface.co/lewtun)

[Lewis Tunstall lewtun Follow](https://huggingface.co/lewtun)

[![Image 10: Luke Bates's avatar](https://cdn-avatars.huggingface.co/v1/production/uploads/1664191170841-61bed873b8b525b3c1a2c92b.jpeg)](https://huggingface.co/luketheduke)

[Luke Bates luketheduke Follow](https://huggingface.co/luketheduke)

[![Image 11: Daniel Korat's avatar](https://cdn-avatars.huggingface.co/v1/production/uploads/6055ae5d25cd24537dd59dc5/eswozkCirLrnyhufN8_-f.jpeg)](https://huggingface.co/danielkorat)

[Daniel Korat danielkorat Follow](https://huggingface.co/danielkorat)

[![Image 12: Oren Pereg's avatar](https://cdn-avatars.huggingface.co/v1/production/uploads/1664643955283-60570320cbe9c7542f3501e3.jpeg)](https://huggingface.co/orenpereg)

[Oren Pereg orenpereg Follow](https://huggingface.co/orenpereg)

[![Image 13: Moshe Wasserblat's avatar](https://huggingface.co/avatars/e05ca715004b39e79472399f75010bda.svg)](https://huggingface.co/moshew)

[Moshe Wasserblat moshew Follow](https://huggingface.co/moshew)

![Image 14](https://huggingface.co/blog/assets/103_setfit/setfit_curves.png)

_SetFit is significantly more sample efficient and robust to noise than standard fine-tuning._

* [How does it work?](https://huggingface.co/blog/setfit#how-does-it-work "How does it work?")

* [Benchmarking SetFit](https://huggingface.co/blog/setfit#benchmarking-setfit "Benchmarking SetFit")

* [Fast training and inference](https://huggingface.co/blog/setfit#fast-training-and-inference "Fast training and inference")

* [Training your own model](https://huggingface.co/blog/setfit#training-your-own-model "Training your own model")

* [Next
Read full article → ← Back to Reads

Related Videos

5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Fable 5: The Full Story from Capabilities to Drama (Ep. 1002 with Jon Krohn)
Fable 5: The Full Story from Capabilities to Drama (Ep. 1002 with Jon Krohn)
Super Data Science: ML & AI Podcast with Jon Krohn
The AI Model That Finally Beat Me (with Jon Krohn)
The AI Model That Finally Beat Me (with Jon Krohn)
Super Data Science: ML & AI Podcast with Jon Krohn
Human Consciousness vs. Next Token Prediction
Human Consciousness vs. Next Token Prediction
Super Data Science: ML & AI Podcast with Jon Krohn
7 Claude Features Only 1% of People Know About
7 Claude Features Only 1% of People Know About
Conor Martin
Kimi K3 by Moonshot AI Surpassed Claude Fable 5
Kimi K3 by Moonshot AI Surpassed Claude Fable 5
Dr Mehrdad Arashpour