File size: 2,376 Bytes
3e7e156 81aa429 c68b60f 3e7e156 c68b60f 3e7e156 c68b60f 3e7e156 2fefd60 3e7e156 c68b60f 3e7e156 2e80a9b 63b30c4 c68b60f 2e80a9b 63b30c4 3e7e156 c68b60f 3e7e156 78f4396 3e7e156 c68b60f 3e7e156 78f4396 3e7e156 c68b60f 3e7e156 c68b60f 3e7e156 c68b60f dbd7435 3e7e156 1764031 dbd7435 3e7e156 c68b60f 3e7e156 c68b60f 78f4396 e9fc23b 78f4396 b398a89 78f4396 821896d e9fc23b 78f4396 c68b60f 7a81dc3 c68b60f 7a81dc3 8d111d4 7a81dc3 5a5fe12 c68b60f 78f4396 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 |
---
base_model: google-bert/bert-base-cased
library_name: peft
license: apache-2.0
language:
- en
tags:
- propaganda
---
# Model Card for identrics/wasper_propaganda_detection_en
## Model Description
- **Developed by:** [`Identrics`](https://identrics.ai/)
- **Language:** English
- **License:** apache-2.0
- **Finetuned from model:** [`google-bert/bert-base-cased`](https://huggingface.co/google-bert/bert-base-cased)
- **Context window :** 512 tokens
## Model Description
This model consists of a fine-tuned version of google-bert/bert-base-cased for a propaganda detection task. It is effectively a binary classifier, determining whether propaganda is present in the output string.
This model was created by [`Identrics`](https://identrics.ai/), in the scope of the WASPer project. The detailed taxonomy of the full pipeline could be found [here](https://github.com/Identrics/wasper/).
## Uses
Designed as a binary classifier to determine whether a traditional or social media comment contains propaganda.
### Example
First install direct dependencies:
```
pip install transformers torch accelerate
```
Then the model can be downloaded and used for inference:
```py
from transformers import pipeline
labels_map = {"0": "No Propaganda", "1": "Propaganda"}
pipe = pipeline(
"text-classification",
model="identrics/wasper_propaganda_detection_en",
tokenizer="identrics/wasper_propaganda_detection_en",
)
text = "Our country is the most powerful country in the world!"
prediction = pipe(text)
print(labels_map[prediction[0]["label"]])
```
## Training Details
The training dataset for the model consists of a balanced collection of English examples, including both propaganda and non-propaganda content. These examples were sourced from a variety of traditional media and social media platforms and manually annotated by domain experts. Additionally, the dataset is enriched with AI-generated samples.
The model achieved an F1 score of **0.807** during evaluation.
## Compute Infrastructure
This model was fine-tuned using a **GPU / 2xNVIDIA Tesla V100 32GB**.
## Citation [this section is to be updated soon]
If you find our work useful, please consider citing WASPer:
```
@article{...2024wasper,
title={WASPer: Propaganda Detection in Bulgarian and English},
author={....},
journal={arXiv preprint arXiv:...},
year={2024}
}
```
|