remove with section, doesn't seem to work (#551) c5dedb1 unverified winglian commited on Sep 11, 2023
publish to pypi workflow on tagged release (#549) b56503d unverified winglian commited on Sep 11, 2023
add git environment variables to compose: avoid checkout failure error 128 on build (#534) 78ee2cd unverified SlapDrone commited on Sep 8, 2023
update readme to point to direct link to runpod template, cleanup install instrucitons (#532) 34c0a86 unverified winglian commited on Sep 8, 2023
recommend padding when using sample packing (#531) 3437149 unverified winglian commited on Sep 6, 2023
Add support for GPTQ using native transformers/peft (#468) 3355706 unverified winglian commited on Sep 5, 2023
Merge pull request #520 from bdashore3/sharegpt-fixes daa4fac unverified mhenrichsen commited on Sep 5, 2023
move is_llama_derived_model into normalize_config (#524) 44454ae unverified tmm1 commited on Sep 4, 2023
Fix(doc): Inform Windows users to use WSL/docker (#518) f51c9c5 unverified Nanobit commited on Sep 1, 2023
Debug tokenization output: Add ability to output text only (no tokens), and/or specify num samples to see (#511) 48434be unverified Tom Jobbins commited on Aug 31, 2023
Added advanced DDP args (#515) 396a7a7 unverified Jan Philipp Harries Jan Philipp Harries commited on Aug 31, 2023
Changed Bench Eval to report metrics correctly by split. Added total accuracy and renamed previously used bench_accuracy to bench_average_accuracy. (#512) 42f9642 unverified Alpay Ariyak commited on Aug 31, 2023
set zero3 optimizer betas to auto so they inherit from HF trainer config (#507) 1e07c16 unverified tmm1 commited on Aug 30, 2023
remove --force-reinstall from Dockerfile to ensure correct pytorch version (#492) e356b29 unverified tmm1 commited on Aug 29, 2023
Fix(doc): Clarify no amp to full yaml docs (#496) 48c5647 unverified Nanobit commited on Aug 29, 2023
tweak: use default config file when only one file is present (#501) 36b2e1c unverified Maxime commited on Aug 29, 2023
pad_to_worst_case_seq_len boolean, for testing memory limits (#498) 8e197f6 unverified Birch-san tmm1 commited on Aug 28, 2023
fsdp requires params be the same type too (#493) 98bf76e unverified winglian commited on Aug 28, 2023
Fix(tokenizer): Make sure to add pad for CodeLlamaTokenizer (#489) 4c37bd0 unverified Nanobit commited on Aug 28, 2023
Feat(cfg): Add code-llama configs for all sizes (#479) 3513071 unverified mhenrichsen mhenrichsen commited on Aug 27, 2023
Feat(deepspeed): Add zero2 config (#476) 3fc9006 unverified mhenrichsen mhenrichsen commited on Aug 27, 2023