|
--- |
|
license: cc-by-nc-4.0 |
|
--- |
|
|
|
Description TBD, thanks for checking in! |
|
|
|
|
|
### **Loading the Model** |
|
|
|
Use the following Python code to load the model: |
|
|
|
```python |
|
import torch |
|
from transformers import AutoModelForCausalLM, AutoTokenizer |
|
|
|
model = AutoModelForCausalLM.from_pretrained(repo_id) |
|
``` |
|
|
|
### **Generating Text** |
|
|
|
To generate text, use the following Python code: |
|
|
|
```python |
|
text = "Hi, my name is " |
|
inputs = tokenizer(text, return_tensors="pt") |
|
|
|
outputs = model.generate(**inputs, max_new_tokens=64) |
|
print(tokenizer.decode(outputs[0], skip_special_tokens=True)) |
|
``` |
|
|
|
|
|
|
|
|
|
|
|
|
