File size: 1,343 Bytes
9de9507 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 |
# Alireo-400M Model Card 📚
## Model Description
Alireo-400M is a lightweight yet powerful Italian language model with 400M parameters, designed to provide efficient natural language processing capabilities while maintaining a smaller footprint compared to larger models.
## Key Features
- **Architecture**: Transformer-based language model
- **Parameters**: 400M
- **Context Window**: 8K tokens
- **Training Data**: Curated Italian text corpus (books, articles, web content)
- **Model Size**: ~800MB
## Performance
Despite its compact size, Alireo-400M demonstrates impressive performance:
- Outperforms Qwen 0.5B across multiple benchmarks
- Maintains high accuracy in Italian language understanding tasks
- Efficient inference speed due to optimized architecture
## Limitations
- Limited context window compared to larger models
- May struggle with highly specialized technical content
- Performance may vary on dialectal variations
- Not suitable for multilingual tasks
## Hardware Requirements
- Minimum RAM: 2GB
- Recommended RAM: 4GB
- GPU: Optional, but recommended for faster inference
- Disk Space: ~1GB (including model and dependencies)
## License
Apache 2.0
## Citation
```bibtex
@software{alireo2024,
author = {[Michele Montebovi]},
title = {Alireo-400M: A Lightweight Italian Language Model},
year = {2024},
}
``` |