Update doc for grad_accu and add validation tests for batch size 3c71c8d Nanobit commited on May 31, 2023
Merge pull request #134 from OpenAccess-AI-Collective/gas-batch-fix a6f5e5e unverified winglian commited on May 31, 2023
Merge pull request #130 from OpenAccess-AI-Collective/gas f94dd62 unverified winglian commited on May 31, 2023
Merge pull request #131 from OpenAccess-AI-Collective/fix-packing-mask 5079753 unverified winglian commited on May 31, 2023
fix packing so that concatenated sequences reset the attention 9b8585d winglian commited on May 31, 2023
Merge pull request #129 from OpenAccess-AI-Collective/builder-badge 8eb5811 unverified winglian commited on May 31, 2023
Merge pull request #127 from OpenAccess-AI-Collective/py310-docker-runpod 6e9e987 unverified winglian commited on May 31, 2023
swap batch size for gradient accumulation steps to decouple from num gpu c2a0792 winglian commited on May 31, 2023
Merge pull request #119 from NanoCode012/feat/update-inference fac4600 unverified Nanobit commited on May 31, 2023
Merge pull request #114 from OpenAccess-AI-Collective/accelerate-dep dcb03d6 unverified winglian commited on May 31, 2023
Merge pull request #118 from NanoCode012/feat/torch-readme 0e4be62 unverified Nanobit commited on May 31, 2023
Merge pull request #124 from OpenAccess-AI-Collective/xformers-fix 2d0ba3b unverified winglian commited on May 31, 2023
Merge pull request #120 from OpenAccess-AI-Collective/model-from-path c7021e1 unverified winglian commited on May 31, 2023
Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py 1076bcb unverified winglian Nanobit commited on May 31, 2023
Update src/axolotl/monkeypatch/llama_attn_hijack_xformers.py 2daa683 unverified winglian Nanobit commited on May 31, 2023
Merge pull request #123 from OpenAccess-AI-Collective/bas-batch 876edd8 unverified winglian commited on May 31, 2023
copy xformers attn from ooba since we removed dep on alpaca_lora_4bit 6cb2310 winglian commited on May 31, 2023
split up llama model loading so config can be loaded from base config and models can be loaded from a path 2520ecd winglian commited on May 31, 2023
Merge pull request #115 from OpenAccess-AI-Collective/docker-version-fixes 0abcd71 unverified winglian commited on May 30, 2023
Merge pull request #108 from OpenAccess-AI-Collective/docker-gptq bbc5bc5 unverified winglian commited on May 30, 2023
Merge pull request #105 from viktoriussuwandi/viktoriussuwandi-patch 4df9da7 unverified winglian commited on May 30, 2023
Merge pull request #106 from fearnworks/qlora-openllama-3b-example 2531ea2 unverified winglian commited on May 30, 2023
Merge pull request #98 from NanoCode012/feat/pre-commit 01a75fd unverified winglian commited on May 30, 2023