|
--- |
|
datasets: |
|
- Doctor-Shotgun/capybara-sharegpt |
|
- jtatman/cosmopedia-100k-sharegpt |
|
- jondurbin/airoboros-3.2 |
|
language: |
|
- en |
|
--- |
|
# WARNING. THIS SUCKS AND IS PROBABLY VERY BROKEN |
|
[please use v3 :)](https://huggingface.co/Fizzarolli/sappha-2b-v3) |
|
|
|
# OLD CONTENT BELOW: |
|
|
|
# sappha-2b-v1 |
|
a very experimental qlora finetune of the gemma-2b base model on various instruct datasets. trained with unsloth. |
|
|
|
## MIGHT WORK, MIGHT NOT, YOUR MILEAGE MAY VARY |
|
gemma fp16 exports in unsloth seem relatively busted at the moment so beware, this model may not work properly at the moment |
|
|
|
## prompt |
|
basic chatml format: |
|
``` |
|
<|im_start|>user |
|
What is artificial intelligence?<|im_end|> |
|
<|im_start|>assistant |
|
Artificial intelligence (AI) is a branch of computer science that focuses on creating intelligent machines that can perform tasks that typically require human intelligence.<|im_end|> |
|
``` |
|
|
|
## quants |
|
ggml: soon™️ |
|
|
|
## datasets used |
|
portions of: |
|
- cosmopedia |
|
- capybara |
|
- airoboros-3.2 |
