Fine-tuned XLM-R Model for nepali Sentiment Analysis
This is a fine-tuned XLM-R model for sentiment analysis in nepali.
Model Details
- Model Name: XLM-R Sentiment Analysis
- Language: nepali
- Fine-tuning Dataset: DGurgurov/nepali_sa
Training Details
- Epochs: 20
- Batch Size: 32 (train), 64 (eval)
- Optimizer: AdamW
- Learning Rate: 5e-5
Performance Metrics
- Accuracy: 0.69412
- Macro F1: 0.67423
- Micro F1: 0.69412
Usage
To use this model, you can load it with the Hugging Face Transformers library:
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("DGurgurov/xlm-r_nepali_sentiment")
model = AutoModelForSequenceClassification.from_pretrained("DGurgurov/xlm-r_nepali_sentiment")
License
[MIT]