add new sharegpt, refactor prompt so it can be customized later, add exception if no data is processed aac4b76 winglian commited on Jun 11, 2023
new hf_use_auth_token setting so login to hf isn't required 1c33eb8 winglian commited on May 28, 2023
be able to use adam bnb 8bit and one cycle scheduler w fsdp 9493b1b winglian commited on May 22, 2023
Update src/axolotl/utils/data.py for spelling 98a6781 unverified winglian Nanobit commited on May 22, 2023
pygmalion dataset prompts format, cached tokenized datasets should be hashed on the tokenizer too 2809f3f winglian commited on May 21, 2023
move filter to before saving so it doesn't happen everytime, update runpod manual script 0d28df0 winglian commited on May 14, 2023
optimize dataloading to use cache, fix model token embedding sizes aa3c3f9 winglian commited on May 12, 2023
tweaks to data loading, 8 bit adam, accelerate and deepspeed 097d367 winglian commited on Apr 22, 2023
fix sharegpt handling from hf, don't worry about loading llama if using earlier transformers release 8d43785 winglian commited on Apr 20, 2023
WIP large refactor to make finetune script a little more manageable (#3) 6045345 unverified winglian commited on Apr 18, 2023
winglian
commited on
