Update README.md
Browse files
README.md
CHANGED
@@ -1,13 +1,18 @@
|
|
1 |
---
|
2 |
license: mit
|
|
|
|
|
|
|
3 |
---
|
4 |
|
5 |
-
# Convert MUSE from TensorFlow to PyTorch
|
6 |
|
7 |
-
|
8 |
|
9 |
> [!IMPORTANT]
|
10 |
-
> **The PyTorch model can be used not only for inference, but also for additional training and fine-tuning
|
|
|
|
|
11 |
|
12 |
# Usage
|
13 |
|
@@ -17,8 +22,8 @@ Model initialization and usage code:
|
|
17 |
```python
|
18 |
import torch
|
19 |
from functools import partial
|
20 |
-
from
|
21 |
-
from
|
22 |
|
23 |
PATH_TO_PT_MODEL = "model.pt"
|
24 |
PATH_TO_TF_MODEL = "universal-sentence-encoder-multilingual-large-3"
|
|
|
1 |
---
|
2 |
license: mit
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
- ru
|
6 |
---
|
7 |
|
8 |
+
# Convert MUSE from TensorFlow to PyTorch
|
9 |
|
10 |
+
This repository contains code to use mUSE (Multilingual Universal Sentence Encoder) transformer model from [TF Hub](https://www.kaggle.com/models/google/universal-sentence-encoder/tensorFlow2/multilingual-large) using **PyTorch**.
|
11 |
|
12 |
> [!IMPORTANT]
|
13 |
+
> **The PyTorch model can be used not only for inference, but also for additional training and fine-tuning!**
|
14 |
+
|
15 |
+
Read more about the project: [GitHub](https://github.com/dayyass/muse_tf2pt/tree/main).
|
16 |
|
17 |
# Usage
|
18 |
|
|
|
22 |
```python
|
23 |
import torch
|
24 |
from functools import partial
|
25 |
+
from architecture import MUSE
|
26 |
+
from tokenizer import get_tokenizer, tokenize
|
27 |
|
28 |
PATH_TO_PT_MODEL = "model.pt"
|
29 |
PATH_TO_TF_MODEL = "universal-sentence-encoder-multilingual-large-3"
|