metadata
tags:
- bertopic
library_name: bertopic
pipeline_tag: text-classification
bertopic-20-newsgroups
This is a BERTopic model. BERTopic is a flexible and modular topic modeling framework that allows for the generation of easily interpretable topics from large datasets.
Usage
To use this model, please install BERTopic:
pip install -U bertopic
You can use the model as follows:
from bertopic import BERTopic
topic_model = BERTopic.load("ctam8736/bertopic-20-newsgroups")
topic_model.get_topic_info()
Topic overview
- Number of topics: 135
- Number of training documents: 11314
Click here for an overview of all topics.
| Topic ID | Topic Keywords | Topic Frequency | Label |
|---|---|---|---|
| -1 | article - information - subject - re - what | 10 | -1_article_information_subject_re |
| 0 | scsi - scsi2 - scsi1 - drives - bios | 3737 | 0_scsi_scsi2_scsi1_drives |
| 1 | nhl - puck - leafs - flyers - pitching | 976 | 1_nhl_puck_leafs_flyers |
| 2 | firearm - firearms - handgun - guns - gun | 918 | 2_firearm_firearms_handgun_guns |
| 3 | ford - honda - nissan - bmw - dealer | 409 | 3_ford_honda_nissan_bmw |
| 4 | encryption - encrypted - crypto - nsa - chip | 387 | 4_encryption_encrypted_crypto_nsa |
| 5 | atheism - atheist - atheists - christianity - belief | 377 | 5_atheism_atheist_atheists_christianity |
| 6 | hezbollah - gaza - lebanon - palestinians - lebanese | 342 | 6_hezbollah_gaza_lebanon_palestinians |
| 7 | window - x11r5 - openwindows - x11 - x11r4 | 249 | 7_window_x11r5_openwindows_x11 |
| 8 | modems - modem - mouse - ports - port | 243 | 8_modems_modem_mouse_ports |
| 9 | anonymity - anonymous - mailing - usenet - newsgroups | 151 | 9_anonymity_anonymous_mailing_usenet |
| 10 | armenians - armenia - armenian - azerbaijani - azerbaijan | 147 | 10_armenians_armenia_armenian_azerbaijani |
| 11 | clinton - stephanopoulos - secretary - president - congress | 135 | 11_clinton_stephanopoulos_secretary_president |
| 12 | os - windows - win32 - microsoft - win31 | 133 | 12_os_windows_win32_microsoft |
| 13 | diseases - disease - candida - infection - infections | 113 | 13_diseases_disease_candida_infection |
| 14 | superstition - msg - sensitivity - glutamate - causes | 100 | 14_superstition_msg_sensitivity_glutamate |
| 15 | laserjet - inkjet - printers - bubblejet - bubblejets | 86 | 15_laserjet_inkjet_printers_bubblejet |
| 16 | billboard - billboards - nasa - space - advertising | 75 | 16_billboard_billboards_nasa_space |
| 17 | radar - detectors - detector - detecting - radarjust | 68 | 17_radar_detectors_detector_detecting |
| 18 | speeding - speeds - mph - speed - driving | 64 | 18_speeding_speeds_mph_speed |
| 19 | ssto - moonbase - moon - lunar - billion | 63 | 19_ssto_moonbase_moon_lunar |
| 20 | station - nasa - redesign - space - shuttle | 61 | 20_station_nasa_redesign_space |
| 21 | eternity - afterlife - heaven - hell - judgement | 49 | 21_eternity_afterlife_heaven_hell |
| 22 | testament - manuscripts - scripture - bible - hebrew | 47 | 22_testament_manuscripts_scripture_bible |
| 23 | homosexuality - heterosexual - homosexual - homosexuals - gays | 45 | 23_homosexuality_heterosexual_homosexual_homosexuals |
| 24 | libertarians - libertarian - libertarianism - regulation - governments | 44 | 24_libertarians_libertarian_libertarianism_regulation |
| 25 | islamic - muslim - islam - muslims - koran | 44 | 25_islamic_muslim_islam_muslims |
| 26 | tax - taxes - vat - deficits - income | 44 | 26_tax_taxes_vat_deficits |
| 27 | oil - drain - engine - fuel - dumping | 44 | 27_oil_drain_engine_fuel |
| 28 | helmet - helmets - head - protection - gloves | 43 | 28_helmet_helmets_head_protection |
| 29 | fonts - font - ttfonts - truetype - printing | 42 | 29_fonts_font_ttfonts_truetype |
| 30 | morality - moral - morals - instinctive - immoral | 39 | 30_morality_moral_morals_instinctive |
| 31 | colormaps - colourmap - colormap - xalloccolor - cwcolormap | 39 | 31_colormaps_colourmap_colormap_xalloccolor |
| 32 | homosexuals - molesters - homosexual - homosexuality - pedophilia | 38 | 32_homosexuals_molesters_homosexual_homosexuality |
| 33 | migraine - migraines - headache - headaches - analgesics | 37 | 33_migraine_migraines_headache_headaches |
| 34 | resurrection - gospels - tomb - testament - jesuss | 37 | 34_resurrection_gospels_tomb_testament |
| 35 | graphics - copyright - images - siggraph - image | 37 | 35_graphics_copyright_images_siggraph |
| 36 | mormon - mormons - lds - brigham - utah | 35 | 36_mormon_mormons_lds_brigham |
| 37 | scientific - scipsychology - scientist - science - methodology | 34 | 37_scientific_scipsychology_scientist_science |
| 38 | tapes - tape - backup - copy - floppy | 34 | 38_tapes_tape_backup_copy |
| 39 | drugs - marijuana - drug - legalizing - legalization | 34 | 39_drugs_marijuana_drug_legalizing |
| 40 | punishment - punish - murder - penalty - murderer | 34 | 40_punishment_punish_murder_penalty |
| 41 | sphere - globe - radius - pointstruct - circle | 34 | 41_sphere_globe_radius_pointstruct |
| 42 | surgery - patients - hernia - massager - pain | 33 | 42_surgery_patients_hernia_massager |
| 43 | genocide - bosnia - atheism - serbs - christians | 32 | 43_genocide_bosnia_atheism_serbs |
| 44 | insurance - liability - insureyear - deductible - accident | 32 | 44_insurance_liability_insureyear_deductible |
| 45 | polygon - polygons - triangulation - hexagons - polyn | 30 | 45_polygon_polygons_triangulation_hexagons |
| 46 | spacecraft - galileo - galileos - mission - magellan | 29 | 46_spacecraft_galileo_galileos_mission |
| 47 | countersteering - countersteeringfaq - countersteer - riding - bikes | 29 | 47_countersteering_countersteeringfaq_countersteer_riding |
| 48 | antenna - antennas - transmitters - transmitting - radios | 28 | 48_antenna_antennas_transmitters_transmitting |
| 49 | canine - dogs - dog - spaniel - springer | 28 | 49_canine_dogs_dog_spaniel |
| 50 | batteries - battery - electrolyte - galvanized - zinc | 28 | 50_batteries_battery_electrolyte_galvanized |
| 51 | oscilloscope - scopes - scope - oscilliscopes - digital | 27 | 51_oscilloscope_scopes_scope_oscilliscopes |
| 52 | xgrabkey - definekeys - accelerators - accelerator - shiftkeyq | 27 | 52_xgrabkey_definekeys_accelerators_accelerator |
| 53 | protoncentaur - centaur - proton - accelerator - nuclear | 27 | 53_protoncentaur_centaur_proton_accelerator |
| 54 | telephone - dial - phone - call - lines | 26 | 54_telephone_dial_phone_call |
| 55 | marriages - wedding - vows - weddings - marriage | 25 | 55_marriages_wedding_vows_weddings |
| 56 | ibm - levels - level - nasa - software | 25 | 56_ibm_levels_level_nasa |
| 57 | nasa - aerospace - astronomy - spacecraft - astronomical | 24 | 57_nasa_aerospace_astronomy_spacecraft |
| 58 | motif - neosoft - unix - platforms - software | 24 | 58_motif_neosoft_unix_platforms |
| 59 | nuclear - cooling - reactor - tower - towers | 23 | 59_nuclear_cooling_reactor_tower |
| 60 | injuries - struck - snot - rocks - warningplease | 23 | 60_injuries_struck_snot_rocks |
| 61 | transmissions - shifter - automatics - autos - auto | 22 | 61_transmissions_shifter_automatics_autos |
| 62 | lzr1260 - printing - mwt9caxaxaxaxaxaxaxaxaxaxaxaxax - m9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax - mi68qaxaxaxaxaxaxaxaxaxaxaxaxaxax | 22 | 62_lzr1260_printing_mwt9caxaxaxaxaxaxaxaxaxaxaxaxax_m9l0qaxaxaxaxaxaxaxaxaxaxaxaxaxax |
| 63 | cview - files - directory - file - tmp | 21 | 63_cview_files_directory_file |
| 64 | immaculate - mary - marys - conception - catholics | 21 | 64_immaculate_mary_marys_conception |
| 65 | cryptology - cryptanalyst - crypt - cryptanalysis - ciphers | 20 | 65_cryptology_cryptanalyst_crypt_cryptanalysis |
| 66 | hotelco - hotels - resorts - hotel - tickets | 20 | 66_hotelco_hotels_resorts_hotel |
| 67 | 3dos - 3do - 3ds - 3d - 3dstudio | 20 | 67_3dos_3do_3ds_3d |
| 68 | comet - comets - jupiter - asteroids - jovian | 20 | 68_comet_comets_jupiter_asteroids |
| 69 | polishing - scratches - paint - rubbing - glaze | 20 | 69_polishing_scratches_paint_rubbing |
| 70 | newsgroup - groups - groupsplit - group - split | 20 | 70_newsgroup_groups_groupsplit_group |
| 71 | koresh - koreshs - david - sermon - biblical | 20 | 71_koresh_koreshs_david_sermon |
| 72 | parking - parked - liability - unsafe - stickers | 20 | 72_parking_parked_liability_unsafe |
| 73 | trumpet - tcp - windows - winqvtnet - winsock | 19 | 73_trumpet_tcp_windows_winqvtnet |
| 74 | freon - heater - coolant - r12 - vents | 19 | 74_freon_heater_coolant_r12 |
| 75 | sabbath - commandments - sunday - worship - church | 19 | 75_sabbath_commandments_sunday_worship |
| 76 | geekdom - computer - fourdcom - csws18icsunysbedu - psychnet | 19 | 76_geekdom_computer_fourdcom_csws18icsunysbedu |
| 77 | bosnia - serbs - sanctions - somalia - war | 18 | 77_bosnia_serbs_sanctions_somalia |
| 78 | soundblaster - midi - midimapper - soundexe - wavfiles | 18 | 78_soundblaster_midi_midimapper_soundexe |
| 79 | condo - remodeled - townhome - bedroom - rent | 18 | 79_condo_remodeled_townhome_bedroom |
| 80 | odometers - odometer - sensor - mileage - sensors | 18 | 80_odometers_odometer_sensor_mileage |
| 81 | joystick - joysticks - joyport - joyread - hardware | 17 | 81_joystick_joysticks_joyport_joyread |
| 82 | abortion - abortions - roe - proabortion - fetus | 17 | 82_abortion_abortions_roe_proabortion |
| 83 | seizures - seizure - allergies - corn - cereal | 17 | 83_seizures_seizure_allergies_corn |
| 84 | sobriety - sober - drinking - drink - drinks | 17 | 84_sobriety_sober_drinking_drink |
| 85 | nubus - lciiipowerpc - pds - powerpcs - powerpc | 17 | 85_nubus_lciiipowerpc_pds_powerpcs |
| 86 | mining - miners - minerals - miner - mineral | 17 | 86_mining_miners_minerals_miner |
| 87 | outlets - outlet - electrical - wiring - grounded | 16 | 87_outlets_outlet_electrical_wiring |
| 88 | rosicrucianum - rosicrucian - orders - order - organization | 16 | 88_rosicrucianum_rosicrucian_orders_order |
| 89 | tempest - shielding - surveillance - encryption - electromagnetic | 16 | 89_tempest_shielding_surveillance_encryption |
| 90 | monitor - monitors - screen - scrolling - display | 16 | 90_monitor_monitors_screen_scrolling |
| 91 | krillean - photographs - photography - kirlian - pictures | 16 | 91_krillean_photographs_photography_kirlian |
| 92 | scanner - scanners - scanning - scans - scanman | 16 | 92_scanner_scanners_scanning_scans |
| 93 | sexism - sexist - extramarital - islamic - marriage | 16 | 93_sexism_sexist_extramarital_islamic |
| 94 | noisy - noise - noises - rattled - quiets | 16 | 94_noisy_noise_noises_rattled |
| 95 | orion - astronomy - museum - prototype - space | 15 | 95_orion_astronomy_museum_prototype |
| 96 | easter - pagan - celebrating - feast - celebration | 15 | 96_easter_pagan_celebrating_feast |
| 97 | batf - assault - waco - blasting - blast | 15 | 97_batf_assault_waco_blasting |
| 98 | batchfile - ini - updating - file - winfileini | 15 | 98_batchfile_ini_updating_file |
| 99 | copyprotect - copying - protected - copy - protection | 15 | 99_copyprotect_copying_protected_copy |
| 100 | 42 - tiff - tiff6 - significance - universe | 14 | 100_42_tiff_tiff6_significance |
| 101 | stove - stoves - splitfires - splitfire - burns | 14 | 101_stove_stoves_splitfires_splitfire |
| 102 | automotive - backing - lights - corvette - reverse | 14 | 102_automotive_backing_lights_corvette |
| 103 | dock - docks - minidocks - portable - minidock | 14 | 103_dock_docks_minidocks_portable |
| 104 | cdaudio - stereo - audio - soundbase - speakers | 14 | 104_cdaudio_stereo_audio_soundbase |
| 105 | uv - flashlight - houselights - fluorescent - lamps | 14 | 105_uv_flashlight_houselights_fluorescent |
| 106 | papal - papacy - pope - popes - schism | 14 | 106_papal_papacy_pope_popes |
| 107 | scsi - quadra - quadras - quadraspecific - firmware | 14 | 107_scsi_quadra_quadras_quadraspecific |
| 108 | crohns - colitis - dietary - gastroenterology - diet | 13 | 108_crohns_colitis_dietary_gastroenterology |
| 109 | crashes - powerbook - plugged - corrupted - duos | 13 | 109_crashes_powerbook_plugged_corrupted |
| 110 | eyedness - handedness - righteye - righthandedness - eyes | 13 | 110_eyedness_handedness_righteye_righthandedness |
| 111 | wrench - pliers - tool - tools - srb | 13 | 111_wrench_pliers_tool_tools |
| 112 | scripture - scriptures - prophecy - revelation - revelations | 13 | 112_scripture_scriptures_prophecy_revelation |
| 113 | nikon - lens - lenses - olympus - 35mm | 13 | 113_nikon_lens_lenses_olympus |
| 114 | prosecution - suspects - encrypted - defendant - incriminate | 13 | 114_prosecution_suspects_encrypted_defendant |
| 115 | wheel - shaftdrives - wheelies - wheelie - shaftdrive | 12 | 115_wheel_shaftdrives_wheelies_wheelie |
| 116 | obesity - rebound - dieting - diet - metabolism | 12 | 116_obesity_rebound_dieting_diet |
| 117 | adl - adls - spying - fbi - investigation | 12 | 117_adl_adls_spying_fbi |
| 118 | lunar - moon - exploration - attend - conference | 12 | 118_lunar_moon_exploration_attend |
| 119 | draftees - draft - selective - military - abolished | 12 | 119_draftees_draft_selective_military |
| 120 | sunrise - sunset - daylight - algorithm - astronomical | 12 | 120_sunrise_sunset_daylight_algorithm |
| 121 | octopus - octopuses - octopi - squid - octapus | 12 | 121_octopus_octopuses_octopi_squid |
| 122 | gassing - explosion - gas - explode - explosive | 11 | 122_gassing_explosion_gas_explode |
| 123 | tutorial - handbook - chemistry - paperback - books | 11 | 123_tutorial_handbook_chemistry_paperback |
| 124 | amp - decibels - current - ampere - db | 11 | 124_amp_decibels_current_ampere |
| 125 | uniforms - jerseys - uniform - mets - reds | 11 | 125_uniforms_jerseys_uniform_mets |
| 126 | eugenics - eugenic - geneticallyengineered - genetic - genetically | 11 | 126_eugenics_eugenic_geneticallyengineered_genetic |
| 127 | fractals - fractal - fractally - compression - pascalfractals | 11 | 127_fractals_fractal_fractally_compression |
| 128 | sunview - xputimage - pixmap - pixmaps - ximage | 11 | 128_sunview_xputimage_pixmap_pixmaps |
| 129 | waving - wave - waves - bikers - bikes | 11 | 129_waving_wave_waves_bikers |
| 130 | vocoder - compressionalgorithms - compression - modems - cryptophones | 11 | 130_vocoder_compressionalgorithms_compression_modems |
| 131 | mouse - jumpiness - mousecom - mouseits - jumps | 11 | 131_mouse_jumpiness_mousecom_mouseits |
| 132 | netware - lan - workgroup - workgroups - w4wg | 10 | 132_netware_lan_workgroup_workgroups |
| 133 | timers - timer - ultralong - clock - oscillator | 10 | 133_timers_timer_ultralong_clock |
Training hyperparameters
- calculate_probabilities: False
- language: english
- low_memory: False
- min_topic_size: 10
- n_gram_range: (1, 1)
- nr_topics: auto
- seed_topic_list: None
- top_n_words: 10
- verbose: True
- zeroshot_min_similarity: 0.7
- zeroshot_topic_list: None
Framework versions
- Numpy: 1.23.5
- HDBSCAN: 0.8.33
- UMAP: 0.5.5
- Pandas: 2.2.1
- Scikit-Learn: 1.3.1
- Sentence-transformers: 2.5.1
- Transformers: 4.37.0.dev0
- Numba: 0.59.1
- Plotly: 5.20.0
- Python: 3.10.4