|
--- |
|
license: apache-2.0 |
|
language: |
|
- it |
|
- en |
|
pipeline_tag: text-generation |
|
datasets: |
|
- DeepMount00/o1-ITA-REASONING |
|
- DeepMount00/GPT-4o-ITA-INSTRUCT |
|
- DeepMount00/Sonnet-3.5-ITA-INSTRUCT |
|
- DeepMount00/open-perfectblend-ita |
|
- HuggingFaceTB/cosmopedia |
|
- DeepMount00/pretraining_multi |
|
--- |
|
|
|
<p align="center"> |
|
<img src="alireo.webp" style="width: 500px; height:500px;"/> |
|
</p> |
|
|
|
<h2 style="font-size: 32px; text-align: center;">Alireo-400M 🤖 🇮🇹</h2> |
|
<p style="font-size: 21px; text-align: center;">A Lightweight Italian Language Model</p> |
|
|
|
<h3 style="font-size: 21px; color: #2980b9;">Model Description 📝</h3> |
|
|
|
Alireo-400M is a lightweight yet powerful Italian language model with 400M parameters, designed to provide efficient natural language processing capabilities while maintaining a smaller footprint compared to larger models. |
|
|
|
<h3 style="font-size: 21px; color: #2980b9;">Key Features ✨</h3> |
|
|
|
* **Architecture**: Transformer-based language model 🏗️ |
|
* **Parameters**: 400M 📊 |
|
* **Context Window**: 8K tokens 🪟 |
|
* **Training Data**: Curated Italian text corpus (books, articles, web content) 📚 |
|
* **Model Size**: ~800MB 💾 |
|
|
|
<h3 style="font-size: 21px; color: #2980b9;">Performance 📈</h3> |
|
|
|
Despite its compact size, Alireo-400M demonstrates impressive performance: |
|
|
|
* **Benchmark Results**: Outperforms Qwen 0.5B across multiple benchmarks 🏆 |
|
* **Language Understanding**: Maintains high accuracy in Italian language understanding tasks 🎯 |
|
* **Speed**: Efficient inference speed due to optimized architecture ⚡ |
|
|
|
<h3 style="font-size: 21px; color: #2980b9;">Limitations ⚠️</h3> |
|
|
|
* Limited context window compared to larger models |
|
* May struggle with highly specialized technical content |
|
* Performance may vary on dialectal variations |
|
* Not suitable for multilingual tasks |
|
|
|
<h3 style="font-size: 21px; color: #2980b9;">Hardware Requirements 💻</h3> |
|
|
|
* **Minimum RAM**: 2GB |
|
* **Recommended RAM**: 4GB |
|
* **GPU**: Optional, but recommended for faster inference |
|
* **Disk Space**: ~1GB (including model and dependencies) |
|
|
|
<h3 style="font-size: 21px; color: #2980b9;">Citation 📄</h3> |
|
|
|
```bibtex |
|
@software{alireo2024, |
|
author = {[Michele Montebovi]}, |
|
title = {Alireo-400M: A Lightweight Italian Language Model}, |
|
year = {2024}, |
|
} |
|
``` |
