Add BERTopic model

b056319 verified 7 months ago

15.5 kB


	---
	tags:
	- bertopic
	library_name: bertopic
	pipeline_tag: text-classification
	---

	# bertopic-20-newsgroups

	This is a [BERTopic](https://github.com/MaartenGr/BERTopic) model.
	BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.

	## Usage

	To use this model, please install BERTopic:

	```
	pip install -U bertopic
	```

	You can use the model as follows:

	```python
	from bertopic import BERTopic
	topic_model = BERTopic.load("ctam8736/bertopic-20-newsgroups")

	topic_model.get_topic_info()
	```

	## Topic overview

	* Number of topics: 135
	* Number of training documents: 11314

	<details>
	<summary>Click here for an overview of all topics.</summary>

	\| Topic ID \| Topic Keywords \| Topic Frequency \| Label \|
	\|----------\|----------------\|-----------------\|-------\|
	\| -1 \| article - information - subject - re - what \| 10 \| -1_article_information_subject_re \|
	\| 0 \| scsi - scsi2 - scsi1 - drives - bios \| 3737 \| 0_scsi_scsi2_scsi1_drives \|
	\| 1 \| nhl - puck - leafs - flyers - pitching \| 976 \| 1_nhl_puck_leafs_flyers \|
	\| 2 \| firearm - firearms - handgun - guns - gun \| 918 \| 2_firearm_firearms_handgun_guns \|
	\| 3 \| ford - honda - nissan - bmw - dealer \| 409 \| 3_ford_honda_nissan_bmw \|
	\| 4 \| encryption - encrypted - crypto - nsa - chip \| 387 \| 4_encryption_encrypted_crypto_nsa \|
	\| 5 \| atheism - atheist - atheists - christianity - belief \| 377 \| 5_atheism_atheist_atheists_christianity \|
	\| 6 \| hezbollah - gaza - lebanon - palestinians - lebanese \| 342 \| 6_hezbollah_gaza_lebanon_palestinians \|
	\| 7 \| window - x11r5 - openwindows - x11 - x11r4 \| 249 \| 7_window_x11r5_openwindows_x11 \|
	\| 8 \| modems - modem - mouse - ports - port \| 243 \| 8_modems_modem_mouse_ports \|
	\| 9 \| anonymity - anonymous - mailing - usenet - newsgroups \| 151 \| 9_anonymity_anonymous_mailing_usenet \|
	\| 10 \| armenians - armenia - armenian - azerbaijani - azerbaijan \| 147 \| 10_armenians_armenia_armenian_azerbaijani \|
	\| 11 \| clinton - stephanopoulos - secretary - president - congress \| 135 \| 11_clinton_stephanopoulos_secretary_president \|
	\| 12 \| os - windows - win32 - microsoft - win31 \| 133 \| 12_os_windows_win32_microsoft \|
	\| 13 \| diseases - disease - candida - infection - infections \| 113 \| 13_diseases_disease_candida_infection \|
	\| 14 \| superstition - msg - sensitivity - glutamate - causes \| 100 \| 14_superstition_msg_sensitivity_glutamate \|
	\| 15 \| laserjet - inkjet - printers - bubblejet - bubblejets \| 86 \| 15_laserjet_inkjet_printers_bubblejet \|
	\| 16 \| billboard - billboards - nasa - space - advertising \| 75 \| 16_billboard_billboards_nasa_space \|
	\| 17 \| radar - detectors - detector - detecting - radarjust \| 68 \| 17_radar_detectors_detector_detecting \|
	\| 18 \| speeding - speeds - mph - speed - driving \| 64 \| 18_speeding_speeds_mph_speed \|
	\| 19 \| ssto - moonbase - moon - lunar - billion \| 63 \| 19_ssto_moonbase_moon_lunar \|
	\| 20 \| station - nasa - redesign - space - shuttle \| 61 \| 20_station_nasa_redesign_space \|
	\| 21 \| eternity - afterlife - heaven - hell - judgement \| 49 \| 21_eternity_afterlife_heaven_hell \|
	\| 22 \| testament - manuscripts - scripture - bible - hebrew \| 47 \| 22_testament_manuscripts_scripture_bible \|
	\| 23 \| homosexuality - heterosexual - homosexual - homosexuals - gays \| 45 \| 23_homosexuality_heterosexual_homosexual_homosexuals \|
	\| 24 \| libertarians - libertarian - libertarianism - regulation - governments \| 44 \| 24_libertarians_libertarian_libertarianism_regulation \|
	\| 25 \| islamic - muslim - islam - muslims - koran \| 44 \| 25_islamic_muslim_islam_muslims \|
	\| 26 \| tax - taxes - vat - deficits - income \| 44 \| 26_tax_taxes_vat_deficits \|
	\| 27 \| oil - drain - engine - fuel - dumping \| 44 \| 27_oil_drain_engine_fuel \|
	\| 28 \| helmet - helmets - head - protection - gloves \| 43 \| 28_helmet_helmets_head_protection \|
	\| 29 \| fonts - font - ttfonts - truetype - printing \| 42 \| 29_fonts_font_ttfonts_truetype \|
	\| 30 \| morality - moral - morals - instinctive - immoral \| 39 \| 30_morality_moral_morals_instinctive \|
	\| 31 \| colormaps - colourmap - colormap - xalloccolor - cwcolormap \| 39 \| 31_colormaps_colourmap_colormap_xalloccolor \|
	\| 32 \| homosexuals - molesters - homosexual - homosexuality - pedophilia \| 38 \| 32_homosexuals_molesters_homosexual_homosexuality \|
	\| 33 \| migraine - migraines - headache - headaches - analgesics \| 37 \| 33_migraine_migraines_headache_headaches \|
	\| 34 \| resurrection - gospels - tomb - testament - jesuss \| 37 \| 34_resurrection_gospels_tomb_testament \|
	\| 35 \| graphics - copyright - images - siggraph - image \| 37 \| 35_graphics_copyright_images_siggraph \|
	\| 36 \| mormon - mormons - lds - brigham - utah \| 35 \| 36_mormon_mormons_lds_brigham \|
	\| 37 \| scientific - scipsychology - scientist - science - methodology \| 34 \| 37_scientific_scipsychology_scientist_science \|
	\| 38 \| tapes - tape - backup - copy - floppy \| 34 \| 38_tapes_tape_backup_copy \|
	\| 39 \| drugs - marijuana - drug - legalizing - legalization \| 34 \| 39_drugs_marijuana_drug_legalizing \|
	\| 40 \| punishment - punish - murder - penalty - murderer \| 34 \| 40_punishment_punish_murder_penalty \|
	\| 41 \| sphere - globe - radius - pointstruct - circle \| 34 \| 41_sphere_globe_radius_pointstruct \|
	\| 42 \| surgery - patients - hernia - massager - pain \| 33 \| 42_surgery_patients_hernia_massager \|
	\| 43 \| genocide - bosnia - atheism - serbs - christians \| 32 \| 43_genocide_bosnia_atheism_serbs \|
	\| 44 \| insurance - liability - insureyear - deductible - accident \| 32 \| 44_insurance_liability_insureyear_deductible \|
	\| 45 \| polygon - polygons - triangulation - hexagons - polyn \| 30 \| 45_polygon_polygons_triangulation_hexagons \|
	\| 46 \| spacecraft - galileo - galileos - mission - magellan \| 29 \| 46_spacecraft_galileo_galileos_mission \|
	\| 47 \| countersteering - countersteeringfaq - countersteer - riding - bikes \| 29 \| 47_countersteering_countersteeringfaq_countersteer_riding \|
	\| 48 \| antenna - antennas - transmitters - transmitting - radios \| 28 \| 48_antenna_antennas_transmitters_transmitting \|
	\| 49 \| canine - dogs - dog - spaniel - springer \| 28 \| 49_canine_dogs_dog_spaniel \|
	\| 50 \| batteries - battery - electrolyte - galvanized - zinc \| 28 \| 50_batteries_battery_electrolyte_galvanized \|
	\| 51 \| oscilloscope - scopes - scope - oscilliscopes - digital \| 27 \| 51_oscilloscope_scopes_scope_oscilliscopes \|
	\| 52 \| xgrabkey - definekeys - accelerators - accelerator - shiftkeyq \| 27 \| 52_xgrabkey_definekeys_accelerators_accelerator \|
	\| 53 \| protoncentaur - centaur - proton - accelerator - nuclear \| 27 \| 53_protoncentaur_centaur_proton_accelerator \|
	\| 54 \| telephone - dial - phone - call - lines \| 26 \| 54_telephone_dial_phone_call \|
	\| 55 \| marriages - wedding - vows - weddings - marriage \| 25 \| 55_marriages_wedding_vows_weddings \|
	\| 56 \| ibm - levels - level - nasa - software \| 25 \| 56_ibm_levels_level_nasa \|
	\| 57 \| nasa - aerospace - astronomy - spacecraft - astronomical \| 24 \| 57_nasa_aerospace_astronomy_spacecraft \|
	\| 58 \| motif - neosoft - unix - platforms - software \| 24 \| 58_motif_neosoft_unix_platforms \|
	\| 59 \| nuclear - cooling - reactor - tower - towers \| 23 \| 59_nuclear_cooling_reactor_tower \|
	\| 60 \| injuries - struck - snot - rocks - warningplease \| 23 \| 60_injuries_struck_snot_rocks \|
	\| 61 \| transmissions - shifter - automatics - autos - auto \| 22 \| 61_transmissions_shifter_automatics_autos \|
	\| 62 \| lzr1260 - printing - mwt9caxaxaxaxaxaxaxaxaxaxaxaxax - m9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax - mi68qaxaxaxaxaxaxaxaxaxaxaxaxaxax \| 22 \| 62_lzr1260_printing_mwt9caxaxaxaxaxaxaxaxaxaxaxaxax_m9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax \|
	\| 63 \| cview - files - directory - file - tmp \| 21 \| 63_cview_files_directory_file \|
	\| 64 \| immaculate - mary - marys - conception - catholics \| 21 \| 64_immaculate_mary_marys_conception \|
	\| 65 \| cryptology - cryptanalyst - crypt - cryptanalysis - ciphers \| 20 \| 65_cryptology_cryptanalyst_crypt_cryptanalysis \|
	\| 66 \| hotelco - hotels - resorts - hotel - tickets \| 20 \| 66_hotelco_hotels_resorts_hotel \|
	\| 67 \| 3dos - 3do - 3ds - 3d - 3dstudio \| 20 \| 67_3dos_3do_3ds_3d \|
	\| 68 \| comet - comets - jupiter - asteroids - jovian \| 20 \| 68_comet_comets_jupiter_asteroids \|
	\| 69 \| polishing - scratches - paint - rubbing - glaze \| 20 \| 69_polishing_scratches_paint_rubbing \|
	\| 70 \| newsgroup - groups - groupsplit - group - split \| 20 \| 70_newsgroup_groups_groupsplit_group \|
	\| 71 \| koresh - koreshs - david - sermon - biblical \| 20 \| 71_koresh_koreshs_david_sermon \|
	\| 72 \| parking - parked - liability - unsafe - stickers \| 20 \| 72_parking_parked_liability_unsafe \|
	\| 73 \| trumpet - tcp - windows - winqvtnet - winsock \| 19 \| 73_trumpet_tcp_windows_winqvtnet \|
	\| 74 \| freon - heater - coolant - r12 - vents \| 19 \| 74_freon_heater_coolant_r12 \|
	\| 75 \| sabbath - commandments - sunday - worship - church \| 19 \| 75_sabbath_commandments_sunday_worship \|
	\| 76 \| geekdom - computer - fourdcom - csws18icsunysbedu - psychnet \| 19 \| 76_geekdom_computer_fourdcom_csws18icsunysbedu \|
	\| 77 \| bosnia - serbs - sanctions - somalia - war \| 18 \| 77_bosnia_serbs_sanctions_somalia \|
	\| 78 \| soundblaster - midi - midimapper - soundexe - wavfiles \| 18 \| 78_soundblaster_midi_midimapper_soundexe \|
	\| 79 \| condo - remodeled - townhome - bedroom - rent \| 18 \| 79_condo_remodeled_townhome_bedroom \|
	\| 80 \| odometers - odometer - sensor - mileage - sensors \| 18 \| 80_odometers_odometer_sensor_mileage \|
	\| 81 \| joystick - joysticks - joyport - joyread - hardware \| 17 \| 81_joystick_joysticks_joyport_joyread \|
	\| 82 \| abortion - abortions - roe - proabortion - fetus \| 17 \| 82_abortion_abortions_roe_proabortion \|
	\| 83 \| seizures - seizure - allergies - corn - cereal \| 17 \| 83_seizures_seizure_allergies_corn \|
	\| 84 \| sobriety - sober - drinking - drink - drinks \| 17 \| 84_sobriety_sober_drinking_drink \|
	\| 85 \| nubus - lciiipowerpc - pds - powerpcs - powerpc \| 17 \| 85_nubus_lciiipowerpc_pds_powerpcs \|
	\| 86 \| mining - miners - minerals - miner - mineral \| 17 \| 86_mining_miners_minerals_miner \|
	\| 87 \| outlets - outlet - electrical - wiring - grounded \| 16 \| 87_outlets_outlet_electrical_wiring \|
	\| 88 \| rosicrucianum - rosicrucian - orders - order - organization \| 16 \| 88_rosicrucianum_rosicrucian_orders_order \|
	\| 89 \| tempest - shielding - surveillance - encryption - electromagnetic \| 16 \| 89_tempest_shielding_surveillance_encryption \|
	\| 90 \| monitor - monitors - screen - scrolling - display \| 16 \| 90_monitor_monitors_screen_scrolling \|
	\| 91 \| krillean - photographs - photography - kirlian - pictures \| 16 \| 91_krillean_photographs_photography_kirlian \|
	\| 92 \| scanner - scanners - scanning - scans - scanman \| 16 \| 92_scanner_scanners_scanning_scans \|
	\| 93 \| sexism - sexist - extramarital - islamic - marriage \| 16 \| 93_sexism_sexist_extramarital_islamic \|
	\| 94 \| noisy - noise - noises - rattled - quiets \| 16 \| 94_noisy_noise_noises_rattled \|
	\| 95 \| orion - astronomy - museum - prototype - space \| 15 \| 95_orion_astronomy_museum_prototype \|
	\| 96 \| easter - pagan - celebrating - feast - celebration \| 15 \| 96_easter_pagan_celebrating_feast \|
	\| 97 \| batf - assault - waco - blasting - blast \| 15 \| 97_batf_assault_waco_blasting \|
	\| 98 \| batchfile - ini - updating - file - winfileini \| 15 \| 98_batchfile_ini_updating_file \|
	\| 99 \| copyprotect - copying - protected - copy - protection \| 15 \| 99_copyprotect_copying_protected_copy \|
	\| 100 \| 42 - tiff - tiff6 - significance - universe \| 14 \| 100_42_tiff_tiff6_significance \|
	\| 101 \| stove - stoves - splitfires - splitfire - burns \| 14 \| 101_stove_stoves_splitfires_splitfire \|
	\| 102 \| automotive - backing - lights - corvette - reverse \| 14 \| 102_automotive_backing_lights_corvette \|
	\| 103 \| dock - docks - minidocks - portable - minidock \| 14 \| 103_dock_docks_minidocks_portable \|
	\| 104 \| cdaudio - stereo - audio - soundbase - speakers \| 14 \| 104_cdaudio_stereo_audio_soundbase \|
	\| 105 \| uv - flashlight - houselights - fluorescent - lamps \| 14 \| 105_uv_flashlight_houselights_fluorescent \|
	\| 106 \| papal - papacy - pope - popes - schism \| 14 \| 106_papal_papacy_pope_popes \|
	\| 107 \| scsi - quadra - quadras - quadraspecific - firmware \| 14 \| 107_scsi_quadra_quadras_quadraspecific \|
	\| 108 \| crohns - colitis - dietary - gastroenterology - diet \| 13 \| 108_crohns_colitis_dietary_gastroenterology \|
	\| 109 \| crashes - powerbook - plugged - corrupted - duos \| 13 \| 109_crashes_powerbook_plugged_corrupted \|
	\| 110 \| eyedness - handedness - righteye - righthandedness - eyes \| 13 \| 110_eyedness_handedness_righteye_righthandedness \|
	\| 111 \| wrench - pliers - tool - tools - srb \| 13 \| 111_wrench_pliers_tool_tools \|
	\| 112 \| scripture - scriptures - prophecy - revelation - revelations \| 13 \| 112_scripture_scriptures_prophecy_revelation \|
	\| 113 \| nikon - lens - lenses - olympus - 35mm \| 13 \| 113_nikon_lens_lenses_olympus \|
	\| 114 \| prosecution - suspects - encrypted - defendant - incriminate \| 13 \| 114_prosecution_suspects_encrypted_defendant \|
	\| 115 \| wheel - shaftdrives - wheelies - wheelie - shaftdrive \| 12 \| 115_wheel_shaftdrives_wheelies_wheelie \|
	\| 116 \| obesity - rebound - dieting - diet - metabolism \| 12 \| 116_obesity_rebound_dieting_diet \|
	\| 117 \| adl - adls - spying - fbi - investigation \| 12 \| 117_adl_adls_spying_fbi \|
	\| 118 \| lunar - moon - exploration - attend - conference \| 12 \| 118_lunar_moon_exploration_attend \|
	\| 119 \| draftees - draft - selective - military - abolished \| 12 \| 119_draftees_draft_selective_military \|
	\| 120 \| sunrise - sunset - daylight - algorithm - astronomical \| 12 \| 120_sunrise_sunset_daylight_algorithm \|
	\| 121 \| octopus - octopuses - octopi - squid - octapus \| 12 \| 121_octopus_octopuses_octopi_squid \|
	\| 122 \| gassing - explosion - gas - explode - explosive \| 11 \| 122_gassing_explosion_gas_explode \|
	\| 123 \| tutorial - handbook - chemistry - paperback - books \| 11 \| 123_tutorial_handbook_chemistry_paperback \|
	\| 124 \| amp - decibels - current - ampere - db \| 11 \| 124_amp_decibels_current_ampere \|
	\| 125 \| uniforms - jerseys - uniform - mets - reds \| 11 \| 125_uniforms_jerseys_uniform_mets \|
	\| 126 \| eugenics - eugenic - geneticallyengineered - genetic - genetically \| 11 \| 126_eugenics_eugenic_geneticallyengineered_genetic \|
	\| 127 \| fractals - fractal - fractally - compression - pascalfractals \| 11 \| 127_fractals_fractal_fractally_compression \|
	\| 128 \| sunview - xputimage - pixmap - pixmaps - ximage \| 11 \| 128_sunview_xputimage_pixmap_pixmaps \|
	\| 129 \| waving - wave - waves - bikers - bikes \| 11 \| 129_waving_wave_waves_bikers \|
	\| 130 \| vocoder - compressionalgorithms - compression - modems - cryptophones \| 11 \| 130_vocoder_compressionalgorithms_compression_modems \|
	\| 131 \| mouse - jumpiness - mousecom - mouseits - jumps \| 11 \| 131_mouse_jumpiness_mousecom_mouseits \|
	\| 132 \| netware - lan - workgroup - workgroups - w4wg \| 10 \| 132_netware_lan_workgroup_workgroups \|
	\| 133 \| timers - timer - ultralong - clock - oscillator \| 10 \| 133_timers_timer_ultralong_clock \|

	</details>

	## Training hyperparameters

	* calculate_probabilities: False
	* language: english
	* low_memory: False
	* min_topic_size: 10
	* n_gram_range: (1, 1)
	* nr_topics: auto
	* seed_topic_list: None
	* top_n_words: 10
	* verbose: True
	* zeroshot_min_similarity: 0.7
	* zeroshot_topic_list: None

	## Framework versions

	* Numpy: 1.23.5
	* HDBSCAN: 0.8.33
	* UMAP: 0.5.5
	* Pandas: 2.2.1
	* Scikit-Learn: 1.3.1
	* Sentence-transformers: 2.5.1
	* Transformers: 4.37.0.dev0
	* Numba: 0.59.1
	* Plotly: 5.20.0
	* Python: 3.10.4