Commit History
Default micro_batch_size to 1 for a safer start
c9c0503
unverified
Add comments/alternatives for falcon-qlora configs
ca11ae9
unverified
falcon + qlora + xformer mbs 40 gas 2 on A6000
fb3d40f
unverified
Create config-7b-qlora.yml
72bf8aa
unverified
swap batch size for gradient accumulation steps to decouple from num gpu
c2a0792
Merge pull request #105 from viktoriussuwandi/viktoriussuwandi-patch
4df9da7
unverified
Merge pull request #106 from fearnworks/qlora-openllama-3b-example
2531ea2
unverified
Lint and format
392dfd9
Update examples/qlora-openllama-3b/README.md
6cee881
unverified
Add Readme, Clean up comments
ac85c0e
Add qlora-openllama-3b example
370d057
Update wandb_log_model on config.yml
15e57ba
unverified
Viktorius Suwandi
commited on
Update wandb_log_model on config-3b.yml
4eb68ac
unverified
Viktorius Suwandi
commited on
Update wandb_log_model on config.yml
fad06be
unverified
Viktorius Suwandi
commited on
Merge branch 'main' into refactor/rename-4b-to-gptq
147241c
unverified
sane starter defaults and add lora
157420d
add example for falcoln support
d5f944c
refactor(example): rename 4bit-lora-7b by gptq-lora-7b
7cf07fc
Thytu
commited on
refactor(param): rename load_4bit config param by gptq
dd00657
Thytu
commited on