Aixr / README.md
Meforgers's picture
Update README.md
dd683bd verified
|
raw
history blame
2.05 kB
---
language:
- tr
- en
- es
license: apache-2.0
library_name: transformers
tags:
- Generative AI
- text-generation-inference
- text-generation
- peft
- unsloth
- medical
- biology
- code
- space
---
# Model Trained By Meforgers
*This model, named 'Aixr,' is designed for science and artificial intelligence development. You can use it as the foundation for many of your scientific projects and interesting ideas. In short, Aixr is an artificial intelligence model that is based on futurism and innovation.*
- # *Firstly*
-If you intend to use unsloth with Pytorch 1.3.0: Utilize the "ampere" path for newer RTX 30xx GPUs or higher.
```python
pip install "unsloth[cu118-torch230] @ git+https://github.com/unslothai/unsloth.git"
pip install "unsloth[cu121-torch230] @ git+https://github.com/unslothai/unsloth.git"
pip install "unsloth[cu118-ampere-torch230] @ git+https://github.com/unslothai/unsloth.git"
pip install "unsloth[cu121-ampere-torch230] @ git+https://github.com/unslothai/unsloth.git"
```
-Also you can use another system
- # *Usage*
```python
from unsloth import FastLanguageModel
import torch
# Variable side
max_seq_length = 512
dtype = torch.float16
load_in_4bit = True
# Alpaca prompt
alpaca_prompt = """### Instruction:
{0}
### Input:
{1}
### Response:
{2}
"""
model, tokenizer = FastLanguageModel.from_pretrained(
model_name="Meforgers/Aixr",
max_seq_length=max_seq_length,
dtype=dtype,
load_in_4bit=load_in_4bit,
)
FastLanguageModel.for_inference(model)
inputs = tokenizer(
[
alpaca_prompt.format(
"Can u text me basic python code?", # instruction side (You need to change that side)
"", # input
"", # output - leave this blank for generation!
)
],
return_tensors="pt"
).to("cuda")
outputs = model.generate(**inputs, max_new_tokens=128, use_cache=True)
print(tokenizer.batch_decode(outputs))
```