README.md

metadata

license: cc-by-nc-4.0
language:
  - ko

A Creative Commons NonCommercial license (CC NC, CC BY-NC or NC license) is a Creative Commons license which a copyright holder can apply to their media to give public permission for anyone to reuse that media only for noncommercial activities. Creative Commons is an organization which develops a variety of public copyright licenses, and the "noncommercial" licenses are a subset of these. Unlike the CC0, CC BY, and CC BY-SA licenses, the CC BY-NC license is considered non-free.

unsloth를 사용하여 meta-llama/Meta-Llama-3.1-8B-Instruct 모델에 LORA 파인튜닝을 완료했습니다.

v02과의 차이점은 per_device_train_batch_size, gradient_accumulation_steps 파라미터의 값을 설정하지 않고, epoch에 맞는 step수를 자연스럽게 찾도록 학습했습니다.

Contact : cgh@tnap.co.kr