|
--- |
|
license: cc-by-nc-sa-4.0 |
|
--- |
|
# CITDA: |
|
|
|
Fine-tuned `bert-base-uncased` on the `emotions` dataset |
|
|
|
Demo Notebook: https://colab.research.google.com/drive/10ZCFvlf2UV3FjU4ymf4OoipQvqHbIItG?usp=sharing |
|
|
|
## Packages |
|
|
|
- Install `torch` |
|
- Also, `pip install transformers datasets scikit-learn wandb seaborn python-dotenv` |
|
|
|
|
|
## Train |
|
|
|
1. Rename `.env.example` to `.env` and set an API key from [wandb](https://wandb.ai/authorize) |
|
2. You can adjust model parameters in the `explainableai.py` file. |
|
2. The model (`pytorch_model.bin`) is a based on the `bert-base-uncased` and already trained on the `emotions` dataset. |
|
To re-produce the training run `finetune-emotions.py`. You can change the base model, or the dataset by changing that file's code. |
|
|
|
|
|
|
|
## Example |
|
|
|
Run `example.py` |
|
|
|
## Train |
|
The model is already trained on `bert-base-uncased` with the [emotions dataset](https://huggingface.co/datasets/emotion). However, you can change parameters and re-fine-tune the model by running `finetune-emotions.py`. |
