File size: 925 Bytes
ba5bd35 e28813b 3e5d016 e28813b b669fd0 2dece0b b669fd0 2dece0b 3ecc7de 2dece0b b669fd0 3ecc7de 2dece0b b669fd0 2dece0b b669fd0 2dece0b b669fd0 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 |
---
license: llama2
inference: false
datasets:
- Ash-Hun/Welfare-QA
library_name: peft
pipeline_tag: text-generation
tags:
- torch
- llama2
- domain-specific-lm
---
<div align='left'>
<img src="https://cdn-uploads.huggingface.co/production/uploads/6370a4e53d1bd47a4ebc2120/TQSWE0e3dAO_Ksbb8b5Xd.png" width='30%'/>
<h1>"WelSSiSKo : Welfare Domain Specific Model"</h1>
</div>
---
# Github â–¼
> If you want to get how to use this model, please check my github repository :)
👉 [Github Repo](https://github.com/ash-hun/WelSSISKo)
# What is BaseModel â–¼
> 👉 [beomi/llama-2-ko-7b](https://huggingface.co/beomi/llama-2-ko-7b)
# Training procedure â–¼
The following `bitsandbytes` quantization config was used during training:
- **load_in_4bit**: True
- **bnb_4bit_quant_type**: nf4
- **bnb_4bit_use_double_quant**: False
- **bnb_4bit_compute_dtype**: torch.bfloat16
# Framework versions â–¼
- PEFT 0.8.2. |