set fsdp state dict (#584) be75668 unverified Jan Philipp Harries Jan Philipp Harries commited on Sep 15, 2023
don't resize embeddings if it's already large enough (#577) 3607882 unverified winglian commited on Sep 15, 2023
support custom field for completion from yml (#580) f7a2263 unverified winglian commited on Sep 15, 2023
prevent cli functions from getting fired on import (#581) 8dcd40a unverified winglian commited on Sep 15, 2023
refactor scripts/finetune.py into new cli modules (#550) 861ceca unverified winglian Nanobit commited on Sep 15, 2023
remove columns after tokenizing for pretraining (#571) 1157950 unverified winglian commited on Sep 14, 2023
set auto for other params that hf trainer sets for ds. include zero1 json (#570) 3b18c96 unverified winglian commited on Sep 14, 2023
fix save_steps so it doesn't get duplicated (#567) 3fbde76 unverified winglian commited on Sep 14, 2023
improve how we setup eval/save strategies and steps (#547) 36e53c7 unverified winglian commited on Sep 13, 2023
gracefully handle length feature used for group by (#565) e7aa7b1 unverified winglian commited on Sep 13, 2023
check for the existence of the default accelerate config that can create headaches (#561) fdb777b unverified winglian commited on Sep 13, 2023
Add training callback to send predictions to WandB table (#521) 5b67ea9 unverified Glavin001 commited on Sep 13, 2023
Fix pretraining with iterable/streaming Dataset (#556) 2f586d1 unverified Jan Philipp Harries Jan Philipp Harries commited on Sep 13, 2023
document that packaging needs to be installed before flash-attn (#559) 9845c5e unverified winglian commited on Sep 12, 2023
replace tags, build dist for pypi publish (#553) bcbc959 unverified winglian commited on Sep 11, 2023
ergonomic update to optimizer config doc (#548) 6d57f2f unverified The Objective Dad commited on Sep 11, 2023
remove with section, doesn't seem to work (#551) c5dedb1 unverified winglian commited on Sep 11, 2023
publish to pypi workflow on tagged release (#549) b56503d unverified winglian commited on Sep 11, 2023
add git environment variables to compose: avoid checkout failure error 128 on build (#534) 78ee2cd unverified SlapDrone commited on Sep 8, 2023
update readme to point to direct link to runpod template, cleanup install instrucitons (#532) 34c0a86 unverified winglian commited on Sep 8, 2023
recommend padding when using sample packing (#531) 3437149 unverified winglian commited on Sep 6, 2023
Add support for GPTQ using native transformers/peft (#468) 3355706 unverified winglian commited on Sep 5, 2023
Merge pull request #520 from bdashore3/sharegpt-fixes daa4fac unverified mhenrichsen commited on Sep 5, 2023