Edit model card

Word2Bezbar: Word2Vec Models for French Rap Lyrics

Overview

Word2Bezbar are Word2Vec models trained on french rap lyrics sourced from Genius. Tokenization has been done using NLTK french word_tokenze function, with a prior processing to remove french oral contractions. Used dataset size was 323MB, corresponding to 77M tokens.

The model captures the semantic relationships between words in the context of french rap, providing a useful tool for studies associated to french slang and music lyrics analysis.

Model Details

Size of this model is large

Parameter Value
Dimensionality 300
Window Size 10
Epochs 20
Algorithm CBOW

Versions

This model has been trained with the followed software versions

Requirement Version
Python 3.8.5
Gensim library 4.3.2
NTLK library 3.8.1

Installation

  1. Install Required Python Libraries:

    pip install gensim
    
  2. Clone the Repository:

    git clone https://github.com/rapminerz/Word2Bezbar-large.git
    
  3. Navigate to the Model Directory:

    cd Word2Bezbar-large
    

Loading the Model

To load the Word2Bezbar Word2Vec model, use the following Python code:

import gensim

# Load the Word2Vec model
model = gensim.models.Word2Vec.load("word2vec.model")

Using the Model

Once the model is loaded, you can use it as shown:

  1. To get the most similary words regarding a word
model.wv.most_similar("bendo")
[('binks', 0.7082766890525818),
 ('bando', 0.684855043888092),
 ('tieks', 0.664956271648407),
 ('hall', 0.6226587295532227),
 ('ghetto', 0.6097022294998169),
 ('barrio', 0.5864858627319336),
 ('hood', 0.5714126229286194),
 ('block', 0.5666197538375854),
 ('quartier', 0.557117760181427),
 ('bloc', 0.5540688037872314)]

model.wv.most_similar("kichta")
[('liasse', 0.7318882942199707),
 ('sse-lia', 0.7186722755432129),
 ('kishta', 0.6604368686676025),
 ('kich', 0.6188479661941528),
 ('moula', 0.570914626121521),
 ('sacoche', 0.553415834903717),
 ('skalape', 0.5243070125579834),
 ('Kichta', 0.49806657433509827),
 ('ppe-fra', 0.49229520559310913),
 ('valise', 0.49089524149894714)]
  1. To find the word that doesn't match in a list of words
model.wv.doesnt_match(["racli","gow","gadji","fimbi","boug"])
'boug'

model.wv.doesnt_match(["Zidane","Mbappé","Ronaldo","Messi","Jordan"])
'Jordan'
  1. To find the similarity between two words
model.wv.similarity("kichta", "moula")
0.57091457

model.wv.similarity("bonheur", "moula")
0.09769239
  1. Or even get the vector representation of a word
model.wv['ekip']
array([ 1.4757039e-01,  ... 1.1260221e+00],
      dtype=float32)

Purpose and Disclaimer

This model is designed for academic and research purposes only. It is not intended for commercial use. The creators of this model do not endorse or promote any specific views or opinions that may be represented in the dataset.

Please mention @RapMinerz if you use our models

Contact

For any questions or issues, please contact the repository owner, RapMinerz, at rapminerz.contact@gmail.com.

Downloads last month
4
Inference API
Unable to determine this model’s pipeline type. Check the docs .