bio-nlp-umass/bioinstruct
Viewer • Updated • 25k • 393 • 24
How to use ELEUTO/bios-cli-smoke-1777891490 with PEFT:
Task type is invalid.
Qwen/Qwen3-4B-Instruct-2507 on bio-nlp-umass/bioinstruct
Trained via BIOS CLI.
| field | value |
|---|---|
| base model | Qwen/Qwen3-4B-Instruct-2507 |
| dataset | bio-nlp-umass/bioinstruct |
| examples | 10 |
| epochs | 3 |
| final loss | 197.2096 |
| checkpoint | a0e6ebba-5cba-53cc-b740-daabc2c83030:train:0/sampler_weights/bios-sft-1777891530 |
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
base = AutoModelForCausalLM.from_pretrained('Qwen/Qwen3-4B-Instruct-2507')
tok = AutoTokenizer.from_pretrained('Qwen/Qwen3-4B-Instruct-2507')
# replace `<your-repo>` with this repo's id
model = PeftModel.from_pretrained(base, '<your-repo>')
Base model
Qwen/Qwen3-4B-Instruct-2507