Hugging Face's logo

Nelathan
/
Qwen2.5-3B-TinyStory-QLora

Transformers
Safetensors
English
text-generation-inference
unsloth
qwen2
trl
Inference Endpoints
Model card Files Community
Edit model card

5k Tinystory QLora(rank=128, alpha=32, lr=5e-5)

  • Developed by: Nelathan
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen2.5-3B-bnb-4bit

Seems to be very overfit but coherent

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model’s pipeline type. Check the docs .

Model tree for Nelathan/Qwen2.5-3B-TinyStory-QLora

Base model

Qwen/Qwen2.5-3B
Quantized
unsloth/Qwen2.5-3B-bnb-4bit
Finetuned
(1)
this model

Dataset used to train Nelathan/Qwen2.5-3B-TinyStory-QLora