qwerrwe / docker

Commit History

update readme to point to direct link to runpod template, cleanup install instrucitons (#532)
34c0a86
unverified

winglian commited on

Add support for GPTQ using native transformers/peft (#468)
3355706
unverified

winglian commited on

remove --force-reinstall from Dockerfile to ensure correct pytorch version (#492)
e356b29
unverified

tmm1 commited on

flash attn pip install (#426)
cf66547
unverified

mhenrichsen Ubuntu mhenrichsen Mads Henrichsen winglian commited on

bump flash-attn to 2.0.4 for the base docker image (#382)
ffac902
unverified

winglian commited on

add peft install back since it doesn't get installed by setup.py (#331)
db2a358
unverified

winglian commited on

pin accelerate so it works with llama2 (#330)
6c9a87c
unverified

winglian commited on

Prune cuda117 (#327)
2c37bf6
unverified

winglian commited on

add runpod envs to .bashrc, fix bnb env (#316)
cf62cfd
unverified

winglian commited on

pin flash attention 2 to the fix for backwards pass
cdf85fd

winglian commited on

flash attention 2
9b790d3

winglian commited on

explicitly pin flash attention 1 to v1.0.9
b06d3e3

winglian commited on

misc fixes
d75adb9

winglian commited on

set transformers cache env var in docker image
f162f3c

winglian commited on

git fetch fix for docker
eca3531

winglian commited on

pin pydantic so deepspeed isn't broken
7145695

winglian commited on

update pip install command for apex
530809f

winglian commited on

shallow clone
5cd2126

winglian commited on

clone in docker
12620f3

winglian commited on

py310, fix cuda arg in deepspeed
c43c5c8

winglian commited on

Merge pull request #108 from OpenAccess-AI-Collective/docker-gptq
bbc5bc5
unverified

winglian commited on

Lint and format
392dfd9

Nanobit commited on

cleanup from pr feedback
48612f8

winglian commited on

default to qlora support, make gptq specific image
6ef96f5

winglian commited on

move CUDA_VERSION_BNB arg inside of stage build scope
e43bcc6

winglian commited on

fix CUDA_VERSION_BNB env var
00323f0

winglian commited on

bnb fixes
21f17cc

winglian commited on

use python setup install, bdist wheel is unreliable in installing extension
809cceb

winglian commited on

ensure libbitsandbytes*.so gets included with wheel
a798ba1

winglian commited on

fix missing run coninuation
cf37980

winglian commited on

update docker to compile latest bnb to properly support qlora
312b8d5

winglian commited on

fix wheel install glob
c3d2562

winglian commited on

fix wheel blobs in dockerfile
1fc9b44

winglian commited on

fix xentropy wheel name typo
259262b

winglian commited on

fix relative path in flash-attn build:
8d6a289

winglian commited on

fix cd within flash-attn
f5fa3d1

winglian commited on

optionally be able to specify alpaca or chat style prompts
1d5ab84

winglian commited on

update entrypoint and force min accelerate
fa8bd14

winglian commited on

use printf instead of echo in dockerfile for portability
709be5a

winglian commited on

fix path name to sorkspace
807cca8

winglian commited on

setup runpod images
79deb35

winglian commited on

fix to cd to path in docker
7576d85

winglian commited on

use existing state of repo to build, not the checkout
3b4b476

winglian commited on

fix base for dockerfile
b5fe063

winglian commited on

whoops, build from base image
a31746b

winglian commited on

hanging slash typo
17345c8

winglian commited on

docker layer caching, build w axolotl from base build
990bec6

winglian commited on

typo in git repo for pip
0c46806

winglian commited on

add huggingface packages and awscli
66fa751

winglian commited on

fix typo and add apex
21b7439

winglian commited on