Commit History
bump flash-attn to 2.0.4 for the base docker image (#382)
ffac902
unverified
winglian
commited on
add peft install back since it doesn't get installed by setup.py (#331)
db2a358
unverified
winglian
commited on
pin accelerate so it works with llama2 (#330)
6c9a87c
unverified
winglian
commited on
Prune cuda117 (#327)
2c37bf6
unverified
winglian
commited on
add runpod envs to .bashrc, fix bnb env (#316)
cf62cfd
unverified
winglian
commited on
pin flash attention 2 to the fix for backwards pass
cdf85fd
winglian
commited on
flash attention 2
9b790d3
winglian
commited on
explicitly pin flash attention 1 to v1.0.9
b06d3e3
winglian
commited on
misc fixes
d75adb9
winglian
commited on
set transformers cache env var in docker image
f162f3c
winglian
commited on
git fetch fix for docker
eca3531
winglian
commited on
pin pydantic so deepspeed isn't broken
7145695
winglian
commited on
update pip install command for apex
530809f
winglian
commited on
shallow clone
5cd2126
winglian
commited on
clone in docker
12620f3
winglian
commited on
py310, fix cuda arg in deepspeed
c43c5c8
winglian
commited on
Merge pull request #108 from OpenAccess-AI-Collective/docker-gptq
bbc5bc5
unverified
winglian
commited on
Lint and format
392dfd9
Nanobit
commited on
cleanup from pr feedback
48612f8
winglian
commited on
default to qlora support, make gptq specific image
6ef96f5
winglian
commited on
move CUDA_VERSION_BNB arg inside of stage build scope
e43bcc6
winglian
commited on
fix CUDA_VERSION_BNB env var
00323f0
winglian
commited on
bnb fixes
21f17cc
winglian
commited on
use python setup install, bdist wheel is unreliable in installing extension
809cceb
winglian
commited on
ensure libbitsandbytes*.so gets included with wheel
a798ba1
winglian
commited on
fix missing run coninuation
cf37980
winglian
commited on
update docker to compile latest bnb to properly support qlora
312b8d5
winglian
commited on
fix wheel install glob
c3d2562
winglian
commited on
fix wheel blobs in dockerfile
1fc9b44
winglian
commited on
fix xentropy wheel name typo
259262b
winglian
commited on
fix relative path in flash-attn build:
8d6a289
winglian
commited on
fix cd within flash-attn
f5fa3d1
winglian
commited on
optionally be able to specify alpaca or chat style prompts
1d5ab84
winglian
commited on
update entrypoint and force min accelerate
fa8bd14
winglian
commited on
use printf instead of echo in dockerfile for portability
709be5a
winglian
commited on
fix path name to sorkspace
807cca8
winglian
commited on
setup runpod images
79deb35
winglian
commited on
fix to cd to path in docker
7576d85
winglian
commited on
use existing state of repo to build, not the checkout
3b4b476
winglian
commited on
fix base for dockerfile
b5fe063
winglian
commited on
whoops, build from base image
a31746b
winglian
commited on
hanging slash typo
17345c8
winglian
commited on
docker layer caching, build w axolotl from base build
990bec6
winglian
commited on
typo in git repo for pip
0c46806
winglian
commited on
add huggingface packages and awscli
66fa751
winglian
commited on
fix typo and add apex
21b7439
winglian
commited on
needs libaio-dev from apt
3f11b47
winglian
commited on
pip install packaging dep
ece46b2
winglian
commited on
build dependencies and aws-cli
92d800a
winglian
commited on