ModernBERT - Modern Replacement for BERT | RAG, Embeddings, Classification, Reranking

Venelin Valkov · Advanced ·🧠 Large Language Models ·3w ago
ModernBERT is a drop-in replacement for the original BERT encoder model. It was trained on a much larger dataset, uses training techniques from modern LLMs and beats most encoder with much better performance. But what made all of this possible? Blog post: https://huggingface.co/blog/modernbert Weights: https://huggingface.co/answerdotai/ModernBERT-base AI Academy: https://mlexpert.io/ Work with me: https://mlexpert.io/consulting LinkedIn: https://www.linkedin.com/in/venelin-valkov/ Follow me on X: https://twitter.com/venelin_valkov Discord: https://discord.gg/UaNPxVD6tv Subscribe: http://bit…
Watch on YouTube ↗ (saves to browser)
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Next Up
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)