Hugging Face's logo

emre570
/
gemma-7b-us-minecraft

PEFT
Safetensors
gemma
Model card Files Community
gemma-7b-us-minecraft / README.md
emre570's picture
emre570
Update README.md
7015247 verified
preview code
|
raw
history blame
No virus
868 Bytes
metadata
library_name: peft
base_model: unsloth/gemma-1.1-7b-it-bnb-4bit
datasets:
  - naklecha/minecraft-question-answer-700k

Gemma 1.1 7B Instruct Minecraft Adapter Model

This model is fine-tuned from Unsloth's Gemma 1.1 7B Instruct quantized model with naklecha's Minecraft Question-Answer dataset. Fine-tuned with 500 steps, it took around 20 minutes with NVIDIA L4. I will share the notebook when model is finished.

Important Notes

  • Model sometimes generates answers with no meanings. I am currently investigating this. This process can be long since I am a beginner in this field. If you have any suggestions, feel free to say it on model's Community page.
  • Model is using bitsandbytes so use it with a CUDA supported GPU.