qwerrwe / examples /falcon

Commit History

Falcon embeddings (#1149) [skip docker]
e799e08
unverified

winglian commited on

set fp16 to false if bf16, update bf16: auto in example YAMLs (#1122) [skip ci]
782b6a4
unverified

winglian Nanobit commited on

new evals_per_epoch and saves_per_epoch to make things cleaner (#944)
5f79b82
unverified

winglian commited on

Feat(wandb): Refactor to be more flexible (#767)
a1da39c
unverified

Nanobit commited on

don't compile deepspeed or bitsandbytes from source (#837)
f544ab2
unverified

winglian commited on

fix eval_steps to be a sane default (#797)
8b79ff0
unverified

winglian commited on

simplify by removing duplicate base_model_config (#772)
2d8def6
unverified

winglian commited on

prepared dataset caching, other misc fixes (#665)
e50a64e
unverified

winglian commited on

Feat: Add support for upstream FA2 (#626)
19a600a
unverified

Nanobit commited on

Add wandb_entity to wandb options, update example configs, update README (#361)
7019509
unverified

Morgan McGuire Morgan McGuire winglian commited on

config fixes
9a58e99

winglian commited on

Trim trailing whitespace
79a8f52
unverified

utensil commited on

Default `wandb_project` to empty as suggested
a52f481
unverified

utensil Nanobit commited on

Default micro_batch_size to 1 for a safer start
c9c0503
unverified

utensil commited on

Add comments/alternatives for falcon-qlora configs
ca11ae9
unverified

utensil commited on

falcon + qlora + xformer mbs 40 gas 2 on A6000
fb3d40f
unverified

utensil commited on

Create config-7b-qlora.yml
72bf8aa
unverified

utensil commited on

Lint and format
392dfd9

Nanobit commited on

sane starter defaults and add lora
157420d

winglian commited on

add example for falcoln support
d5f944c

winglian commited on