Fine-tuned XLM-R Model for welsh Sentiment Analysis
This is a fine-tuned XLM-R model for sentiment analysis in welsh.
Model Details
- Model Name: XLM-R Sentiment Analysis
- Language: welsh
- Fine-tuning Dataset: DGurgurov/welsh_sa
Training Details
- Epochs: 20
- Batch Size: 32 (train), 64 (eval)
- Optimizer: AdamW
- Learning Rate: 5e-5
Performance Metrics
- Accuracy: 0.86613
- Macro F1: 0.86609
- Micro F1: 0.86613
Usage
To use this model, you can load it with the Hugging Face Transformers library:
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("DGurgurov/xlm-r_welsh_sentiment")
model = AutoModelForSequenceClassification.from_pretrained("DGurgurov/xlm-r_welsh_sentiment")
License
[MIT]