tweak: use default config file when only one file is present (#501) 36b2e1c unverified Maxime commited on Aug 29, 2023
pad_to_worst_case_seq_len boolean, for testing memory limits (#498) 8e197f6 unverified Birch-san tmm1 commited on Aug 28, 2023
fsdp requires params be the same type too (#493) 98bf76e unverified winglian commited on Aug 28, 2023
Fix(tokenizer): Make sure to add pad for CodeLlamaTokenizer (#489) 4c37bd0 unverified Nanobit commited on Aug 28, 2023
Feat(cfg): Add code-llama configs for all sizes (#479) 3513071 unverified mhenrichsen mhenrichsen commited on Aug 27, 2023
Feat(deepspeed): Add zero2 config (#476) 3fc9006 unverified mhenrichsen mhenrichsen commited on Aug 27, 2023
Merge pull request #486 from OpenAccess-AI-Collective/adam-bnb-simpler f313010 unverified tmm1 commited on Aug 27, 2023
fix: inference did not move the model to the correct device (#483) 17605b8 unverified Maxime commited on Aug 26, 2023
fix: finetune model inference needs the dtype fix to work with flash-attn f311df9 unverified Maxime commited on Aug 26, 2023
Merge pull request #484 from OpenAccess-AI-Collective/reqs 56c4a94 unverified tmm1 commited on Aug 26, 2023
Fix(tokenizer): Fix condition to add pad token (#477) 71bd062 unverified Nanobit commited on Aug 25, 2023
ReLoRA implementation (with quantization) (#322) bde3c5a unverified chargoddard winglian commited on Aug 24, 2023
workaround so training doesn't hang when packed dataloader batches aren't even (#461) c69faee unverified winglian commited on Aug 23, 2023
fix test fixture b/c hf trainer tokenization changed (#464) d5dcf9c unverified winglian commited on Aug 23, 2023
feat: add Metharme prompt strategy (#446) f474650 unverified TearGosling Nanobit commited on Aug 22, 2023
recast loralayer, norm, lmhead + embed token weights per original qlora (#393) 96deb6b unverified winglian commited on Aug 21, 2023
Merge pull request #451 from OpenAccess-AI-Collective/eval-is-causal 5e9c6af unverified tmm1 commited on Aug 21, 2023
fix eval regression caused in 13f7efaf74fcd3c4514277ccb71914c589873f6a a213d99 tmm1 commited on Aug 21, 2023
feat(docs): improve user customized prompts (#443) 04a42b6 unverified Nanobit commited on Aug 21, 2023
feat(doc): add pillow to lambda instructions (#445) 919f4ca unverified Nanobit commited on Aug 21, 2023
support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348) d2e7f27 unverified winglian commited on Aug 20, 2023