* 20240521: Pushed v0.3 LoRA, with more deslopping, and dataset fixes. Also uses HQQ quantization instead of QLoRA, which got training up to 8k context size. | |
* 20240511: Pushed v0.2 LoRA. Higher context size, and curation/fixes to dataset. |
* 20240521: Pushed v0.3 LoRA, with more deslopping, and dataset fixes. Also uses HQQ quantization instead of QLoRA, which got training up to 8k context size. | |
* 20240511: Pushed v0.2 LoRA. Higher context size, and curation/fixes to dataset. |