madlad400-3b-mt / README.md
iliemihai's picture
Create README.md
b75bc6a
|
raw
history blame
1.07 kB
---
license: apache-2.0
language:
- en
- pt
- es
- de
- it
library_name: transformers
tags:
- text-generation-inference
---
T5ForConditionalGeneration files for the [Madlad-400](https://github.com/google-research/google-research/tree/master/madlad_400) 3B parameter MT model.
```python
from transformers import T5ForConditionalGeneration, T5Tokenizer, GenerationConfig
model = T5ForConditionalGeneration.from_pretrained("iliemihai/madlad400-3b-mt")
tokenizer = T5Tokenizer.from_pretrained("iliemihai/madlad400-3b-mt")
text = """The quick brown fox jumped over the laisy dog."""
input_ids = tokenizer.encode(f"<2ro> {text} </s>", return_tensors="pt")
outputs = model.generate(input_ids,
do_sample=True,
early_stopping=True,
top_p=0.92,
top_k=50,
temperature=0.3,
max_length=256)
print(tokenizer.decode(outputs[0]))
```
**KUDOS TO jbochi FOR RELEASING THE COLAB AND CONVERSION CODE
Colab to generate these files is [here](https://colab.research.google.com/drive/1rZ2NRyl2zwmg0sQ2Wi-uZZF48iVYulTC#scrollTo=pVODoE6gA9sw).