Alireo-400M Model Card 📚

Model Description

Alireo-400M is a lightweight yet powerful Italian language model with 400M parameters, designed to provide efficient natural language processing capabilities while maintaining a smaller footprint compared to larger models.

Key Features

Architecture: Transformer-based language model
Parameters: 400M
Context Window: 8K tokens
Training Data: Curated Italian text corpus (books, articles, web content)
Model Size: ~800MB

Performance

Despite its compact size, Alireo-400M demonstrates impressive performance:

Outperforms Qwen 0.5B across multiple benchmarks
Maintains high accuracy in Italian language understanding tasks
Efficient inference speed due to optimized architecture

Limitations

Limited context window compared to larger models
May struggle with highly specialized technical content
Performance may vary on dialectal variations
Not suitable for multilingual tasks

Hardware Requirements

Minimum RAM: 2GB
Recommended RAM: 4GB
GPU: Optional, but recommended for faster inference
Disk Space: ~1GB (including model and dependencies)

License

Apache 2.0

Citation

@software{alireo2024,
  author = {[Michele Montebovi]},
  title = {Alireo-400M: A Lightweight Italian Language Model},
  year = {2024},
}