Commit History

add logging and make sure model unloads to float16
a5bf838

winglian commited on

update readme and add typehints
a4f1241

winglian commited on

fix validation for qlora merge
48f4c05

winglian commited on

qlora and 4bit check so we are able to merge and unload
1987e5c

winglian commited on

fix bool args according to python fire docs
e7e1a77

winglian commited on

fix merge conflict failure, black format
7b5e762

winglian commited on

qlora merge and load requires that base model isn't loaded in 4 or 8 bit
3f6017d

winglian commited on

fixes to make qlora actually work
34c99f9

winglian commited on

fix xentropy wheel name typo
259262b

winglian commited on

another fix for shard and train split
2e56203

winglian commited on

Merge pull request #58 from OpenAccess-AI-Collective/shards-fix
be3d396
unverified

winglian commited on

shard fix
ac79360

winglian commited on

Merge pull request #54 from OpenAccess-AI-Collective/winglian-patch-1
b2fb618
unverified

winglian commited on

Merge branch 'main' into winglian-patch-1
71d600f
unverified

winglian commited on

Merge pull request #57 from OpenAccess-AI-Collective/fixes-for-basic-samples
4fd0c2d
unverified

winglian commited on

missed ...
943961f

winglian commited on

change auth token setting back
d2a6f79

winglian commited on

pr comments addressed
98b1bce

winglian commited on

Update src/axolotl/prompters.py
0048202
unverified

winglian Nanobit commited on

fix relative path in flash-attn build:
8d6a289

winglian commited on

fix tokenizer loading, got openllama 3b working
e396654

winglian commited on

fixes w/ example for super basic lora starter
a5d739b

winglian commited on

Merge pull request #56 from OpenAccess-AI-Collective/fix-build-flash-attn
951facb
unverified

winglian commited on

fix cd within flash-attn
f5fa3d1

winglian commited on

Merge pull request #48 from NanoCode012/feat/update-readme
7ec1050
unverified

Nanobit commited on

Update 4bit notes
a9e502e

Nanobit commited on

Merge pull request #49 from NanoCode012/feat/gitignore
68f0c71
unverified

Nanobit commited on

Update gitignore using standard Python template
52fb6d8

Nanobit commited on

Fix missing closing code block
f92245d

Nanobit commited on

Add more detail on minimum GPU
e65c203

Nanobit commited on

Add info on Runtime Error
1377400

Nanobit commited on

Update dataset type
2c34f8d

Nanobit commited on

Add more data formats
7bc28eb

Nanobit commited on

Add other minor configs
29273b5

Nanobit commited on

Update scheduler configs
05c1834

Nanobit commited on

Update bf16 options
5b712af

Nanobit commited on

Update lora config
9083910

Nanobit commited on

Improve Inference instruction
8552218

Nanobit commited on

Merge pull request #55 from OpenAccess-AI-Collective/missing-validation-file
de2a733
unverified

winglian commited on

add missing file
1d7da3b

winglian commited on

add discord link to #axolotl-help channel
e07bd8a
unverified

winglian commited on

Merge pull request #52 from OpenAccess-AI-Collective/bugfix-cfg-cfg
d092cdb
unverified

winglian commited on

stray s
f523a08

winglian commited on

cfg.cfg fix, also de-dupe lora module list
676d7da

winglian commited on

Merge pull request #44 from OpenAccess-AI-Collective/qlora-add-modules-tuple
a617f1b
unverified

winglian commited on

fix tuple add to list
a8771b0

winglian commited on

Merge pull request #41 from OpenAccess-AI-Collective/qlora-modules
cf48ff7
unverified

winglian commited on

Update src/axolotl/utils/models.py
1cf21da
unverified

winglian Nanobit commited on

attempt to find linear modules for qlora
ffd1043

winglian commited on

Merge pull request #39 from OpenAccess-AI-Collective/dev
3369c4d
unverified

winglian commited on