MiniCPM4 - Efficient Edge-Side Large Model

🚀 MiniCPM4 is here! 5x faster on end devices 🔥 ✨ What's new: 🏗️ Efficient Model Architecture - InfLLM v2 -- Trainable Sparse Attention Mechanism 🧠 Efficient Learning Algorithms - Model Wind Tunnel 2.0 -- Efficient Predictable Scaling - BitCPM -- Ultimate Ternary Quantization 📚 High-Quality Training Data - UltraClean -- High-quality Pre-training Data Filtering and Generation - UltraChat v2 -- High-quality Supervised Fine-tuning Data Generation ⚡ Efficient Inference System: - CPM.cu -- Light Lightweight and Efficient CUDA Inference Framework - ArkInfer -- Cross-Platform Deployment Framework 📖 Technical Report: https://github.com/OpenBMB/MiniCPM/blob/main/report/MiniCPM_4_Technical_Report.pdf 🤗 Models: https://huggingface.co/collections/openbmb/minicpm-4-6841ab29d180257e940baa9b ⭐ GitHub: https://github.com/OpenBMB/MiniCPM 🤖 Discord: https://t.co/g8WB7WxxSj