daybreak-peft / llama3-70b /CHANGELOG.txt
crestf411's picture
Update llama3-70b/CHANGELOG.txt
63bf4d7 verified
raw
history blame
239 Bytes
* 20240521: Pushed v0.3 LoRA, with more deslopping, and dataset fixes. Also uses HQQ quantization instead of QLoRA, which got training up to 8k context size.
* 20240511: Pushed v0.2 LoRA. Higher context size, and curation/fixes to dataset.