--- tags: - generated_from_trainer datasets: - emotion metrics: - accuracy - f1 model-index: - name: bertweet-base-finetuned-emotion results: - task: type: text-classification name: Text Classification dataset: name: emotion type: emotion args: default metrics: - type: accuracy value: 0.9365 name: Accuracy - type: f1 value: 0.9371 name: F1 - task: type: text-classification name: Text Classification dataset: name: emotion type: emotion config: default split: test metrics: - type: accuracy value: 0.923 name: Accuracy verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmM2MWE4ZjY5YTgwYTJiMjU3NzM2ZThhY2E1ZTMwODViYWQ3MjMyYWQwNjY5YmQzNWI4MDNkMDIzNjViNGFiZSIsInZlcnNpb24iOjF9.6EvBDfdNh_DOQdV5x7v-1kbmWOtC8y5_d05D-q4D6HijTs2CWCJq9fIxejdK_fhCmgrjplgg2nUivCKhdYhaCw - type: precision value: 0.8676576686813523 name: Precision Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYWNlYTE4YTNkYjc2OGEwZGUzYzI1MjNjOTc3NTNiMGQ0MWNmZjQwNTgzZWNmMzMzMTU4YjIyODQ2Njg3YzQ5NyIsInZlcnNpb24iOjF9.EKO1dxq7_i3YOM-qr_VsPmLdUtRmjqmAWZ3fwvhU8LINMf96FtpVidg-tzScuDvOuokSlyxuWWK0N5_W_7f9Dw - type: precision value: 0.923 name: Precision Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzQ5ZTA5ZTY0MjhhNWE0YjdiYTk5N2ZjMDlhYmViMTNiZjk5MTZjODUwNTQxNDRkNzFiNDgzZTRmYzAxMzg0NSIsInZlcnNpb24iOjF9.P0M_qss4GFeHpOBs3Qch7LqgkJRn_8rAqVYS1DJcWjSldPu9SAg9h_1XYgmHPt0AlkJQ3WJe4Kx_MBJJWpnEAw - type: precision value: 0.9268406401714973 name: Precision Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzQ1MGVjZGQ4YmYxY2M0OTliMDAxY2VkNzU0YzI5ZWVlNWE2YjAzZDYwYzRiNmQwMjliNTQ5NDc2ZmViZGZhYSIsInZlcnNpb24iOjF9.x5qfOfbrYgVZfcOB2Bi18-bIHwK8G24njA0hUGkIQqJi8qhFXLU2pjhQtarHrrq_6A1eTADhgIyqMacpGM_TAQ - type: recall value: 0.8945488803260702 name: Recall Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiM2ZlZWQ3YjMwZGJlYWYyMjc2NTFlZDVkY2IyMjJlZmY3M2Q5MmMzNTQxZWFiNjY3YmY5ZDU5NzcwZTc4ODQ3ZSIsInZlcnNpb24iOjF9.uq3VbwWkRU1Y2ICazCwNJuoYpw-dDMWT8gdRWrC5astZCA4MB378utJv5C4LD1ZIfInjY_VYvawZtAJj7QLADw - type: recall value: 0.923 name: Recall Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNWNhMWE4MzcwNDg5MTAxYzUxZmRkNGE5NjA1NjIwYTdkZDg4MWUyMjE0MWRjODA2NmRkNTg4MTZlNWRhMTE2ZSIsInZlcnNpb24iOjF9.-gqvwVg7e5Nz7_0gsnDfB5UQQzhj4F8DmEq8AaGB8wTO9TDavykemllYREzAe93NjW-50uCHFJmAtsAZXPKDAg - type: recall value: 0.923 name: Recall Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzA3NDVmNWZkZDFjODVhY2UzNzUyMDJjMDcyN2NlZmNiMTc0NGRhOTRjMzhmOTVmMjJjMjZlOWU2MTUxZWMyMSIsInZlcnNpb24iOjF9.aMkVOk3SPDKoNhBXvWV3NhsZmlHbWSNxR5g8uM0GYbA6piMP9Knm8IHW47ixrsFI2a3dOlinpeMMZeZRvYoiBA - type: f1 value: 0.8798961895301041 name: F1 Macro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNjlhZTgwYzc2OWZiNGMzMTBlNzM0YmMwMDMwNzk3Zjc0OGFhZDgwYjk2YzNkNjQ4MzVkOTc5MmQwZWI2NTY1YiIsInZlcnNpb24iOjF9._Z0Nb5e2Xyk_9Djq9oIIe6p_nFsbuda9jon8Q1SrTepkQZVMQEWEWAogGMUqkfN7YHYGWsqgaXV1G1GxLd9SDA - type: f1 value: 0.923 name: F1 Micro verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYWRkMGM1MTdmM2QyMTM5NGFhZjcxNDQzODEzMWViOGZkMzZmODI3MjcxYzgyZDU1OWRjZjg0N2NhMzhiM2MxYyIsInZlcnNpb24iOjF9.aWqfU-Bc0fRVMwVwn_WL6vErIae_H8a3QWSgTwLLAsL0fXuvqskDzQeIZ0spUD7mfPlxqWUwkwgQz4vkJ1dyDw - type: f1 value: 0.9241278880972197 name: F1 Weighted verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTYxNjk1OGEwZTgxMzE5ZjQ0NzY5NjUwMzUyYjhkMzU4YjEzMjRkYWJkMGY0NDc5MjU4YjA2MzAyOTY5MGJjMCIsInZlcnNpb24iOjF9.bRRF1cPvYN2-CHKhJdXVNzfQnf7ObMBut7LMAmr9oZnbDECtvlzO_GSwU-8Tse6HDn7BFUdloJUn-XfhSt_oBQ - type: loss value: 0.24626904726028442 name: loss verified: true verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNGM0NTVkMjk5NjZmMmJkZGVkNzZjZWJmNzJhMmMxMTIwZDgxMTcxMTJiY2Q0Njc5YTliN2VmMzkxNGNkYzZjYiIsInZlcnNpb24iOjF9.wlQDSCjkdMc7UTaLMKrPlhFxmf7E2o2SE8pVprUkBjVcgiRZYbKdj0XECmBHhCEIJXSpO9fmUdcLO5qf4dv9BQ --- # distilbert-base-uncased-finetuned-emotion This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset. It achieves the following results on the evaluation set: - Loss: 0.1995 - Accuracy: 0.9365 - F1: 0.9371 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 64 - eval_batch_size: 64 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 5 ### Training results | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:| | 0.475 | 1.0 | 503 | 0.2171 | 0.928 | 0.9292 | | 0.1235 | 2.0 | 1006 | 0.1764 | 0.9365 | 0.9372 | | 0.0802 | 3.0 | 1509 | 0.1788 | 0.938 | 0.9388 | | 0.0531 | 4.0 | 2012 | 0.2005 | 0.938 | 0.9388 | | 0.0367 | 5.0 | 2515 | 0.1995 | 0.9365 | 0.9371 | ### Framework versions - Transformers 4.13.0 - Pytorch 1.11.0+cu113 - Datasets 1.16.1 - Tokenizers 0.10.3