Remove learning rate scheduler in deepspeed config to avoid conflict (#909) 476a205 unverified Haoxiang-Wang commited on Dec 4, 2023
ensure merged model matches the training dtype (#902) 1d21aa6 unverified winglian commited on Nov 29, 2023
Determine FSDP/deepspeed settings on device select. (#883) 71b7ea3 unverified user735 Karl-Johan Alm winglian commited on Nov 29, 2023
update datasets version to cut down the warnings due to pyarrow arg change (#897) 6a4562a unverified winglian commited on Nov 25, 2023
fix: warning should not show if eval_batch_size not provided (#896) 7ee3c4c unverified Nanobit commited on Nov 25, 2023
chore(doc): Add info on changing role in sharegpt (#886) 9fc29e0 unverified Nanobit commited on Nov 22, 2023
try #2: pin hf transformers and accelerate to latest release, don't reinstall pytorch (#867) 0de1457 unverified winglian commited on Nov 16, 2023
allow overriding of model_config parameters from the YML (#853) 1bc1186 unverified winglian commited on Nov 16, 2023
add e2e tests for checking functionality of resume from checkpoint (#865) b3a61e8 unverified winglian commited on Nov 16, 2023
lint fix that didn't get caught by linter (#866) 332984d unverified winglian commited on Nov 15, 2023
Update data.py for signature generation (#851) 48630f5 unverified MilesQLi winglian commited on Nov 15, 2023
Docs: add instructions to 1-click launching on public clouds (#862) b33c1d5 unverified zongheng commited on Nov 15, 2023
feat(doc): add more info on train_on_split (#855) 306fe19 unverified Nanobit commited on Nov 15, 2023
include the suffix modified string in ascii art (#852) 614cff4 unverified fpreiss commited on Nov 15, 2023
don't compile deepspeed or bitsandbytes from source (#837) f544ab2 unverified winglian commited on Nov 9, 2023
add deepspeed-kernels dependency for deepspeed>=0.12.0 (#827) 8056ecd unverified fpreiss commited on Nov 5, 2023
update table for rwkv4 support, fix process count for dataset (#822) cdc71f7 unverified winglian commited on Nov 5, 2023
fix(tokenizer): update log order after update (#806) 10388a8 unverified Nanobit commited on Oct 31, 2023
fix(config): Set eos/bos to tokenizer if different (#801) 637ed09 unverified Nanobit commited on Oct 29, 2023
refactor neft patch to be more re-usable similar to trl's impl (#796) 827ec3d unverified winglian commited on Oct 29, 2023
Update to adapt to sharegpt datasets with "assistant" rather than "gp… (#774) 0800885 unverified MilesQLi winglian commited on Oct 28, 2023