ModernBERT - Modern Replacement for BERT | RAG, Embeddings, Classification, Reranking
ModernBERT is a drop-in replacement for the original BERT encoder model. It was trained on a much larger dataset, uses training techniques from modern LLMs and beats most encoder with much better performance. But what made all of this possible?
Blog post: https://huggingface.co/blog/modernbert
Weights: https://huggingface.co/answerdotai/ModernBERT-base
AI Academy: https://mlexpert.io/
Work with me: https://mlexpert.io/consulting
LinkedIn: https://www.linkedin.com/in/venelin-valkov/
Follow me on X: https://twitter.com/venelin_valkov
Discord: https://discord.gg/UaNPxVD6tv
Subscribe: http://bit…
Watch on YouTube ↗
(saves to browser)
DeepCamp AI