Commit History

Feat: Add landmark attention
55b8542

Nanobit commited on

Merge pull request #168 from bratao/main
febe902
unverified

winglian commited on

Disable Wandb
f4df266

Bruno Cabral commited on

Merge pull request #167 from NanoCode012/fix/redundant-save-eval-steps
281dc3d
unverified

Nanobit commited on

Refactor out unmodified save_steps and eval_steps
2ef4634

Nanobit commited on

Merge pull request #166 from NanoCode012/fix/seed
7eae903
unverified

Nanobit commited on

Merge pull request #132 from utensil/falcon-7b-qlora
c8242de
unverified

Nanobit commited on

Set to use cfg.seed or 42 for backward compat
2cfe9e9

Nanobit commited on

Trim trailing whitespace
79a8f52
unverified

utensil commited on

Merge pull request #164 from NanoCode012/fix/falcon-fsdp-validate
afaa0d2
unverified

Nanobit commited on

Fix failing test
bfd27ba

Nanobit commited on

Validate falcon with fsdp
babf0fd

Nanobit commited on

Default `wandb_project` to empty as suggested
a52f481
unverified

utensil Nanobit commited on

Merge pull request #163 from NanoCode012/feat/matmul-tf32
81911d1
unverified

Nanobit commited on

Set matmul tf32
52765ac

Nanobit commited on

Merge pull request #143 from NanoCode012/fix/deprecate-prepare-8bit-training
73e9ea4
unverified

Nanobit commited on

Merge pull request #162 from NanoCode012/fix/custom-prompt-readme
f8d3798
unverified

Nanobit commited on

Merge pull request #161 from NanoCode012/fix/peft-setup
04a1b77
unverified

Nanobit commited on

Move custom prompts out of hidden
2097a09

Nanobit commited on

Add peft install for quickstart
cfff94b

Nanobit commited on

Update peft and gptq instruction
2b222de

Nanobit commited on

Fix future deprecate prepare_model_for_int8_training
df9528f

Nanobit commited on

Fix training over existing lora
193c73b
unverified

Angainor Development commited on

Merge pull request #158 from OpenAccess-AI-Collective/prompter-fixes
6abfd87
unverified

winglian commited on

fix camel ai, add guanaco/oasst mapping for sharegpt
59bb219

winglian commited on

Merge pull request #155 from OpenAccess-AI-Collective/misc-fixes
9a02e7e
unverified

winglian commited on

update docs
5b33e29

winglian commited on

new prompters, misc fixes for output dir missing using fsdp, and changing max seq len
4ac9e25

winglian commited on

Default micro_batch_size to 1 for a safer start
c9c0503
unverified

utensil commited on

Add comments/alternatives for falcon-qlora configs
ca11ae9
unverified

utensil commited on

Merge pull request #149 from OpenAccess-AI-Collective/docker-clone-axolotl
328c3bc
unverified

winglian commited on

shallow clone
5cd2126

winglian commited on

clone in docker
12620f3

winglian commited on

Merge pull request #148 from OpenAccess-AI-Collective/fix-device-load
4ab0c8b
unverified

winglian commited on

fix device map
74ebbf4

winglian commited on

Merge pull request #147 from OpenAccess-AI-Collective/winglian-rocker-images
76a70fd
unverified

winglian commited on

Update README.md for correct image tags
618816d
unverified

winglian commited on

Merge pull request #146 from FarisHijazi/main
91992cb
unverified

winglian commited on

added docker-compose file
84169d1

FarisHijazi commited on

Merge pull request #142 from NanoCode012/feat/custom-prompt-readme
ecfe8d0
unverified

winglian commited on

Merge pull request #141 from NanoCode012/feat/lambdalabs-readme
eee44a3
unverified

winglian commited on

Remove redundant instruction
078a43e

Nanobit commited on

Add pygmalion
33e1890

Nanobit commited on

Add other prompt_strategies
1c38253

Nanobit commited on

Add short instruction for custom prompts
496b83f

Nanobit commited on

Add lambdalabs instruction
ff68a95

Nanobit commited on

falcon + qlora + xformer mbs 40 gas 2 on A6000
fb3d40f
unverified

utensil commited on

Merge pull request #135 from NanoCode012/fix/grad-accu-readme
288fd62
unverified

Nanobit commited on

Update doc for grad_accu and add validation tests for batch size
3c71c8d

Nanobit commited on

Merge pull request #134 from OpenAccess-AI-Collective/gas-batch-fix
a6f5e5e
unverified

winglian commited on