Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / configs /pythia_1_2B_alpaca.yml

Commit History

Update wandb_log_model on pythia_1_2B_alpaca.yml

abddcf4
unverified

Viktorius Suwandi commited on May 29, 2023

4bit quantized support (wip)

77fca25

winglian commited on Apr 17, 2023

deepspeed doesn't work with flash-attn, and the gpu savings w flash attn are better than the deepspeed headaches

d1aed4c

winglian commited on Apr 16, 2023

more logging, wandb fixes

05fffb5

winglian commited on Apr 15, 2023

improve prepared dataset loading, fix inference

b164725

winglian commited on Apr 15, 2023

more fixes and prep for llama training

949a27b

winglian commited on Apr 14, 2023

make it work with pythia in the cloud

8d959a7

winglian commited on Apr 14, 2023

WIP for axolotl trainer

ce24f5e

winglian commited on Apr 14, 2023