better handling and logging of empty sharegpt turns (#603) a363604 unverified winglian commited on Sep 22, 2023
chore(callback): Remove old peft saving code (#510) d5f8589 unverified Nanobit commited on Sep 22, 2023
run eval on the first step to get a baseline (#617) 2844eb2 unverified winglian commited on Sep 22, 2023
let MAX_JOBS use the default since we're not resource constrained on our self-hosted runners (#427) e85d2eb unverified winglian commited on Sep 22, 2023
skip the gpu memory checks if the device is set to 'auto' (#609) 196ff11 unverified winglian commited on Sep 21, 2023
Only run tests when a change to python files is made (#614) 5d931cc unverified Maxime winglian commited on Sep 21, 2023
update dockerfile to not build evoformer since it fails the build (#607) b53e777 unverified winglian commited on Sep 19, 2023
more sane defaults for openllama 3b used for quickstarts (#602) 674c576 unverified winglian commited on Sep 19, 2023
improve handling for empty text on the tokenization step (#502) 1eebbd0 unverified winglian commited on Sep 19, 2023
btlm and falcon monkey patches for flash attn (#566) 6b9b229 unverified winglian commited on Sep 17, 2023
Feat(data): Allow loading local csv and text (#594) 00dce35 unverified Nanobit commited on Sep 17, 2023
gather/broadcast the max value of the packing efficiency automatically (#463) b15b19e unverified winglian commited on Sep 17, 2023
optionally configure sample packing for evals (#589) 21ec195 unverified winglian commited on Sep 16, 2023
set fsdp state dict (#584) be75668 unverified Jan Philipp Harries Jan Philipp Harries commited on Sep 15, 2023
don't resize embeddings if it's already large enough (#577) 3607882 unverified winglian commited on Sep 15, 2023
support custom field for completion from yml (#580) f7a2263 unverified winglian commited on Sep 15, 2023
prevent cli functions from getting fired on import (#581) 8dcd40a unverified winglian commited on Sep 15, 2023
refactor scripts/finetune.py into new cli modules (#550) 861ceca unverified winglian Nanobit commited on Sep 15, 2023
remove columns after tokenizing for pretraining (#571) 1157950 unverified winglian commited on Sep 14, 2023
set auto for other params that hf trainer sets for ds. include zero1 json (#570) 3b18c96 unverified winglian commited on Sep 14, 2023
fix save_steps so it doesn't get duplicated (#567) 3fbde76 unverified winglian commited on Sep 14, 2023
improve how we setup eval/save strategies and steps (#547) 36e53c7 unverified winglian commited on Sep 13, 2023
gracefully handle length feature used for group by (#565) e7aa7b1 unverified winglian commited on Sep 13, 2023