|
--- |
|
license: mit |
|
language: |
|
- az |
|
tags: |
|
- wikipedia |
|
- books |
|
- social-media |
|
vocab-size: 16378 |
|
|
|
|
|
--- |
|
|
|
# Model Details |
|
|
|
## Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
|
|
|
|
- **Developed by:** Farid Haziyev |
|
- **Model type:** Tokenizer |
|
- **Language(s) (NLP):** Azerbaijani |
|
- **License:** MIT |
|
- **Finetuned from model [optional]:** bert-based-uncased |
|
|
|
|
|
# Uses |
|
Can be used in any project intended for the purpose of improving Azerbaijani language models |
|
|
|
|
|
|
|
## How to Get Started with the Model |
|
|
|
Use the code below to get started with the model. |
|
|
|
```python |
|
from transformers import AutoTokenizer |
|
tokenizer = AutoTokenizer.from_pretrained("heziyevv/aze-bert-tokenizer-middle") |
|
``` |
