AMALIA Technical Report: A Fully Open Source Large Language Model for European Portuguese

1. 1Collect and preprocess high-quality European Portuguese data
2. 2Use the data to fine-tune a large language model during mid- and post-training stages
3. 3Evaluate the model using native benchmarks to ensure faithful representation of linguistic and cultural nuances
4. 4Release the model and evaluation benchmarks as open source to promote community engagement and improvement

NLP researchers and engineers working on language models for underrepresented languages can benefit from AMALIA's approach, as it provides a fully open source solution for European Portuguese

💡 Prioritizing high-quality data for underrepresented languages can improve the accuracy and cultural sensitivity of large language models

🇵🇹 AMALIA: A fully open source large language model for European Portuguese! 🤖