Commit History

Merge pull request #19 from NanoCode012/feat/callback-save-lora
bcbc99e
unverified

winglian commited on

Merge pull request #22 from NanoCode012/patch-2
b0d2594
unverified

winglian commited on

Fix BNB OOM by pinning version
fe582df
unverified

Nanobit commited on

Update trainer.py
36aaea0
unverified

Nanobit commited on

Fix condition scheduler
5b6690a
unverified

Nanobit commited on

add support for trust_remote_code for mpt models
a125693

winglian commited on

use printf instead of echo in dockerfile for portability
709be5a

winglian commited on

Add callbacks to Trainer
cc77bab

Nanobit commited on

Add callback save peft_model on_save
0d6708b

Nanobit commited on

fix path name to sorkspace
807cca8

winglian commited on

setup runpod images
79deb35

winglian commited on

fix to cd to path in docker
7576d85

winglian commited on

use existing state of repo to build, not the checkout
3b4b476

winglian commited on

fix base for dockerfile
b5fe063

winglian commited on

Jeopardy bot! (#17)
a12fb0a
unverified

winglian commited on

fix #16 load best model setting when using 8bit
a4329b1

winglian commited on

use micro batch size for eval size if not specified
550502b

winglian commited on

blah, wrong base tag
fae36c7

winglian commited on

whoops, build from base image
a31746b

winglian commited on

hanging slash typo
17345c8

winglian commited on

build on self hosted GPU runners
9cd5d3f

winglian commited on

docker layer caching, build w axolotl from base build
990bec6

winglian commited on

typo in git repo for pip
0c46806

winglian commited on

add huggingface packages and awscli
66fa751

winglian commited on

fix typo and add apex
21b7439

winglian commited on

needs libaio-dev from apt
3f11b47

winglian commited on

pip install packaging dep
ece46b2

winglian commited on

build dependencies and aws-cli
92d800a

winglian commited on

build base separately
2734e3f

winglian commited on

build base too
14ebd2e

winglian commited on

fix push to docker hub
4a79dab

winglian commited on

fix whitespace and instruction on inference
47ad389

winglian commited on

push to docker hub
76b24bc

winglian commited on

TORCH_CUDA_ARCH_LIST should be an ARG
73450d9

winglian commited on

run this on self hosted runner for now
97cf778

winglian commited on

runs on larger git runner?
e2599ed

winglian commited on

don't push the image
75bc856

winglian commited on

run on git commit
15bdbae

winglian commited on

try docker build on gitlab
6603b37

winglian commited on

build dockerfile in gha
2634689

winglian commited on

update stablelm config
4818380

winglian commited on

refactor inference, warn if model is frozen
247825b

winglian commited on

Merge pull request #13 from winglian/dev
cb9a887
unverified

winglian commited on

Merge pull request #12 from NanoCode012/feat/eval_config
a15d823
unverified

winglian commited on

Add eval_batch_size for evaluation
0e74b64

Nanobit commited on

fix log sweep lr
a10a826

winglian commited on

support for multi line inference input, log sweep over learning rates
9105935

winglian commited on

fix adam bnb optimizer grouped parameters, fix peft model 8bit conversion logic, black formatting
7748f3d

winglian commited on

install peft from main branch
fe9c29d

winglian commited on

support llama-adapter zero init attention
2255bb7

winglian commited on