Add BERTopic model

README.md

@@ -0,0 +1,103 @@
+
+---
+tags:
+- bertopic
+library_name: bertopic
+pipeline_tag: text-classification
+---
+
+# topic_immigration_it
+
+This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model. 
+BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets. 
+
+## Usage 
+
+To use this model, please install BERTopic:
+
+```
+pip install -U bertopic
+```
+
+You can use the model as follows:
+
+```python
+from bertopic import BERTopic
+topic_model = BERTopic.load("brema76/topic_immigration_it")
+
+topic_model.get_topic_info()
+```
+
+## Topic overview
+
+* Number of topics: 36
+* Number of training documents: 159408
+
+<details>
+  <summary>Click here for an overview of all topics.</summary>
+  
+  | Topic ID | Topic Keywords | Topic Frequency | Label | 
+|----------|----------------|-----------------|-------| 
+| 0 | salvini - immigrato - ong - straniero - mare | 77801 | Crime | 
+| 1 | italia - sicilia - italiano - meloni - aquarius | 27045 | Reception | 
+| 2 | libia - libico - seawatch - tunisia - tunisino | 18643 | Sea rescue | 
+| 3 | ucraino - trump - profugo - polonia - russia | 10779 | Border crisis | 
+| 4 | sardegna - video - lampedusa - notte - algerino | 3478 | Landings | 
+| 5 | papa - chiesa - francesco - vescovo - papafrancesco | 3395 | The Church's view | 
+| 6 | coronavirus - positivo - virus - ospedale - contagio | 2308 | Coronavirus and its spread | 
+| 7 | hotspot - protestare - collasso - centro - lampedusa | 2298 | First reception centers | 
+| 8 | camion - arrestato - scafista - arresto - furgone | 1624 | Illegal immigration | 
+| 9 | incendio - baobab - tendopoli - moria - fiamma | 1046 | Shanty towns | 
+| 10 | reddito - pensione - cittadinanza - euro - investimento | 1028 | Economy | 
+| 11 | afghanistan - afgano - talebani - kabul - profugo | 1011 | Humanitarian corridors for refugees | 
+| 12 | turismo - turista - vacanza - estate - presenza | 798 | Tourism and vacations | 
+| 13 | incinta - bambino - donna - neonato - bimbo | 776 | Pregnancy, parenthood, and children | 
+| 14 | scuola - università - studente - tutore - lingua | 651 | Education and School-related themes | 
+| 15 | vaccino - vaccinato - vaccinale - vaccinare - covid | 650 | Vaccinations and EU digital Covid certificate | 
+| 16 | musumeci - ordinanza - islam - islamico - musulmano | 621 | Islam | 
+| 17 | alarmphone - egeo - naufragio - bambino - pericolo | 552 | Shipwrecks | 
+| 18 | stupro - sessuale - stuprato - violenza - stuprare | 519 | Sexual violence | 
+| 19 | multa - ong - decreto - amp - erostraniero | 517 | NGOs regulation | 
+| 20 | razzismo - razzista - odio - razziale - insulto | 422 | Racism and Hatred | 
+| 21 | agricoltura - schiavo - schiavitù - agricolo - schiavismo | 409 | Illegal work and exploitation | 
+| 22 | tubercoloso - malattia - tbc - salute - pandemia | 361 | Disease transmission | 
+| 23 | africa - africano - mission - continente - sviluppo | 353 | Cooperation and Development in Africa | 
+| 24 | asilo - giudice - richiedente - tribunale - ricorso | 350 | Right to asylum | 
+| 25 | dublino - regolamento - riforma - trattato - superare | 310 | EU regulation | 
+| 26 | fake - propaganda - fakenews - news - sapevatelo | 285 | Spread of fake news | 
+| 27 | droga - cocaina - hashish - eroina - marijuana | 266 | Drugs and Drug Dealing | 
+| 28 | film - miglior - oscar - sorrentino - dogman | 263 | Movies | 
+| 29 | gay - lgbt - omosessuale - cassazione - lgbti | 149 | LGBTQ+ and sexual minorities' rights | 
+| 30 | qatar - qatargate - panzeri - fifa - mondiale | 129 | Quatargate | 
+| 31 | perugia - università - suarez - rettore - universitàstranieri | 127 | Luis Suarez's Italian exam scam | 
+| 32 | brexit - regno - unito - inglese - qualificato | 120 | Brexit | 
+| 33 | basket - calcio - campionato - squadra - giocatore | 117 | Sports | 
+| 34 | profugo - volontario - gualzetti - sottoscrizione - accoglienza | 107 | Donations | 
+| 35 | matrimonio - combinato - finto - nozze - fittizio | 100 | Marriages and Fake Unions |
+  
+</details>
+
+## Training hyperparameters
+
+* calculate_probabilities: True
+* language: None
+* low_memory: False
+* min_topic_size: 200
+* n_gram_range: (1, 1)
+* nr_topics: auto
+* seed_topic_list: None
+* top_n_words: 15
+* verbose: True
+
+## Framework versions
+
+* Numpy: 1.23.5
+* HDBSCAN: 0.8.33
+* UMAP: 0.5.3
+* Pandas: 2.0.3
+* Scikit-Learn: 1.3.0
+* Sentence-transformers: 2.2.2
+* Transformers: 4.33.1
+* Numba: 0.56.4
+* Plotly: 5.16.1
+* Python: 3.10.11

config.json

@@ -0,0 +1,15 @@
+{
+  "calculate_probabilities": true,
+  "language": null,
+  "low_memory": false,
+  "min_topic_size": 200,
+  "n_gram_range": [
+    1,
+    1
+  ],
+  "nr_topics": "auto",
+  "seed_topic_list": null,
+  "top_n_words": 15,
+  "verbose": true,
+  "embedding_model": "sentence-transformers/paraphrase-multilingual-mpnet-base-v2"
+}

ctfidf.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa944da93b10f12aca048bdb7d4dd01097a859be1aca8a96ebde4a94e83384cb
+size 1410004

topic_embeddings.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0237d20acc35cc866fba7a782aa142bbaca990bb8a349a745ff8bedf6881d525
+size 111430