swap batch size for gradient accumulation steps to decouple from num gpu

Update wandb_log_model on vicuna_13B_4bit_reflect.yml

Update wandb_log_model on cerebras_1_3B_alpaca.yml

Update wandb_log_model on pythia_1_2B_alpaca.yml

Update wandb_log_model on llama_7B_jeopardy.yml

Update wandb_log_model on llama_65B_alpaca.yml

Update wandb_log_model on llama_13B_alpaca.yml

Update wandb_log_model on llama_7B_alpaca.yml

Update wandb_log_model on galactica_1_3B.yml

Update wandb_log_model on llama_7B_4bit.yml

Update wandb_log_model on stability_3b.yml

Update wandb_log_model on gpt_neox_20b.yml

Update wandb_log_model on quickstart.yml

Update wandb_log_model on sample.yml

refactor(param): rename load_4bit config param by gptq

fix config for parity with previous change

Jeopardy bot! (#17)

update stablelm config

fix dataset handling, support galactica

tweaks to data loading, 8 bit adam, accelerate and deepspeed

fix sharegpt handling from hf, don't worry about loading llama if using earlier transformers release

various bugfixes

quickstart instructions for starting from runpod (#5)

WIP large refactor to make finetune script a little more manageable (#3)

add support for alpaca reflect training (#2)

fix lora target module, require explicit flash attention, fix min logging steps, don't use adam8bit for int4, hash prepared datasets, support hf hub datasets

4bit quantized support (wip)

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

add llama 7b config and fiz lora_fan_in_fan_out for llama (copy pasta bug)

more logging, wandb fixes

improve prepared dataset loading, fix inference

helpful info output

various bugfixes

more fixes and prep for llama training

config chooser, update readme instructions, device config, llama flash attention, debug out the labels, fix config key checks, other bugfixes

make it work with pythia in the cloud

WIP for axolotl trainer