Update Readme to include support for Mixtral8X22B (#1518) [skip ci] bcaa923 unverified Atlas commited on Apr 17
Update SaveAxolotlConfigtoWandBCallback to use artifact instead of save (#1483) 5ed2939 unverified tcapelle winglian commited on Apr 9
use locale agnostic seperator to make large nums easier to read (#1503) da9b1a3 unverified winglian commited on Apr 9
WIP: Support table logging for mlflow, too (#1506) 057fa44 unverified DavidFarago Dave Farago winglian commited on Apr 9
Correctly handle splits for datasets.arrow_dataset.Dataset objects (#1504) 8fa0785 unverified scottifer8 winglian commited on Apr 9
Fix the wrong adapter in qwen2-moe-qlora example (#1501) [skip ci] 7f17eff unverified MaziyarPanahi commited on Apr 9
add field to sft dataset pydantic for completion support (#1497) ff01c45 unverified winglian commited on Apr 9
ignore issues with calculating # params when printing (#1493) 2fa65b9 unverified winglian commited on Apr 8
drop empty token from beginning if tokenizer has no bos_token (in the case of qwen) (#1490) 934fc85 unverified winglian commited on Apr 7
feat: validate sample packing requires flash_attention (#1465) bf4cd67 unverified Nanobit commited on Apr 5
refactor utils.data module for line count linter (#1476) e0fcef4 unverified winglian commited on Apr 4
Added pip install ninja to accelerate installation of flash-attn (#1461) cae608f unverified melvinebenezer commited on Apr 2
Support loading datasets saved via save_to_disk (#1432) e634118 unverified fozziethebeat commited on Mar 29
support layer replication for peft and fix rslora integration (#1445) 25afd35 unverified winglian commited on Mar 27
fix for accelerate env var for auto bf16, add new base image and expand torch_cuda_arch_list support (#1413) da265dd unverified winglian commited on Mar 26
make sure to capture non-null defaults from config validation (#1415) 601b77b unverified winglian commited on Mar 26
fix(dataset): normalize tokenizer config and change hash from tokenizer class to tokenizer path (#1298) ff939d8 unverified Nanobit commited on Mar 25
docs: update link to docs of advance topic in README.md (#1437) 324d59e unverified pphuc25 commited on Mar 25