fix: finetune model inference needs the dtype fix to work with flash-attn f311df9 unverified Maxime commited on Aug 26, 2023
Merge pull request #484 from OpenAccess-AI-Collective/reqs 56c4a94 unverified tmm1 commited on Aug 26, 2023
Fix(tokenizer): Fix condition to add pad token (#477) 71bd062 unverified Nanobit commited on Aug 25, 2023
ReLoRA implementation (with quantization) (#322) bde3c5a unverified chargoddard winglian commited on Aug 24, 2023
workaround so training doesn't hang when packed dataloader batches aren't even (#461) c69faee unverified winglian commited on Aug 23, 2023
fix test fixture b/c hf trainer tokenization changed (#464) d5dcf9c unverified winglian commited on Aug 23, 2023
feat: add Metharme prompt strategy (#446) f474650 unverified TearGosling Nanobit commited on Aug 22, 2023
recast loralayer, norm, lmhead + embed token weights per original qlora (#393) 96deb6b unverified winglian commited on Aug 21, 2023
Merge pull request #451 from OpenAccess-AI-Collective/eval-is-causal 5e9c6af unverified tmm1 commited on Aug 21, 2023
fix eval regression caused in 13f7efaf74fcd3c4514277ccb71914c589873f6a a213d99 tmm1 commited on Aug 21, 2023
feat(docs): improve user customized prompts (#443) 04a42b6 unverified Nanobit commited on Aug 21, 2023
feat(doc): add pillow to lambda instructions (#445) 919f4ca unverified Nanobit commited on Aug 21, 2023
support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348) d2e7f27 unverified winglian commited on Aug 20, 2023
use save_strategy from config if available (#434) b3f5e00 unverified winglian commited on Aug 19, 2023
flash attn pip install (#426) cf66547 unverified mhenrichsen Ubuntu mhenrichsen Mads Henrichsen winglian commited on Aug 18, 2023
fix fixture for new tokenizer handling in transformers (#428) 8cace80 unverified winglian commited on Aug 17, 2023
Fix(docs): Remove gptq+lora and fix xformer compat list (#423) 3d1f203 unverified Nanobit commited on Aug 16, 2023
Fix(template): Inform to place stack trace to Issue (#417) b7449a9 unverified Nanobit winglian commited on Aug 16, 2023
use inputs for image rather than outputs for docker metadata (#420) 5f80b35 unverified winglian commited on Aug 15, 2023
tag with latest as well for axolotl-runpod (#418) 7af8166 unverified winglian commited on Aug 15, 2023
Merge pull request #413 from mhenrichsen/chore/update-deepseed-config f806e86 unverified mhenrichsen commited on Aug 15, 2023
Feat(doc): Add lr_quadratic_warmup to readme (#412) 2b990eb unverified Nanobit commited on Aug 15, 2023
Fix(config): Update handling of deepspeed config (#404) c01015f unverified Nanobit commited on Aug 15, 2023
Fix(template): Remove iPhone/android from Issue template (#407) 7ad37cb unverified Nanobit commited on Aug 15, 2023