| # Fine-tuned XLM-R Model for welsh Sentiment Analysis | |
| This is a fine-tuned XLM-R model for sentiment analysis in welsh. | |
| ## Model Details | |
| - **Model Name**: XLM-R Sentiment Analysis | |
| - **Language**: welsh | |
| - **Fine-tuning Dataset**: DGurgurov/welsh_sa | |
| ## Training Details | |
| - **Epochs**: 20 | |
| - **Batch Size**: 32 (train), 64 (eval) | |
| - **Optimizer**: AdamW | |
| - **Learning Rate**: 5e-5 | |
| ## Performance Metrics | |
| - **Accuracy**: 0.86613 | |
| - **Macro F1**: 0.86609 | |
| - **Micro F1**: 0.86613 | |
| ## Usage | |
| To use this model, you can load it with the Hugging Face Transformers library: | |
| ```python | |
| from transformers import AutoTokenizer, AutoModelForSequenceClassification | |
| tokenizer = AutoTokenizer.from_pretrained("DGurgurov/xlm-r_welsh_sentiment") | |
| model = AutoModelForSequenceClassification.from_pretrained("DGurgurov/xlm-r_welsh_sentiment") | |
| ``` | |
| ## License | |
| [MIT] | |