Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
qwerrwe / examples /falcon /config-7b-qlora.yml

Commit History

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]
782b6a4
unverified

winglian Nanobit commited on

new evals_per_epoch and saves_per_epoch to make things cleaner (#944)
5f79b82
unverified

winglian commited on

Feat(wandb): Refactor to be more flexible (#767)
a1da39c
unverified

Nanobit commited on

don't compile deepspeed or bitsandbytes from source (#837)
f544ab2
unverified

winglian commited on

fix eval_steps to be a sane default (#797)
8b79ff0
unverified

winglian commited on

simplify by removing duplicate base_model_config (#772)
2d8def6
unverified

winglian commited on

prepared dataset caching, other misc fixes (#665)
e50a64e
unverified

winglian commited on

Feat: Add support for upstream FA2 (#626)
19a600a
unverified

Nanobit commited on

Add wandb_entity to wandb options, update example configs, update README (#361)
7019509
unverified

Morgan McGuire Morgan McGuire winglian commited on

Trim trailing whitespace
79a8f52
unverified

utensil commited on

Default `wandb_project` to empty as suggested
a52f481
unverified

utensil Nanobit commited on

Default micro_batch_size to 1 for a safer start
c9c0503
unverified

utensil commited on

Add comments/alternatives for falcon-qlora configs
ca11ae9
unverified

utensil commited on

falcon + qlora + xformer mbs 40 gas 2 on A6000
fb3d40f
unverified

utensil commited on

Create config-7b-qlora.yml
72bf8aa
unverified

utensil commited on