File size: 352 Bytes
6f2c65a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---
license: cc-by-nc-4.0
language:
- ko
- en
---

## Base Model:
We made a LLM model with davidkim205/nox-solar-10.7b-v4

## Model Description
We use QDoRA(256, 64) and NEFTune on LLM Fine-tuning lr = 1e-5, NEFTune = 3

## Train Detail
Our changed private data used, 5 epoch train, and parameter changed

## Others
We are making LLM model for Kolon !