qwerrwe / README.md

Commit History

add new sharegpt, refactor prompt so it can be customized later, add exception if no data is processed
aac4b76

winglian commited on

Add save_steps and eval_steps to Readme
4cd1dee
unverified

Nanobit commited on

gptq lora llama is obviously good
336aa3f

winglian commited on

update openllama and clean up paths
d0d7eaa

winglian commited on

fix table formatting
a6ebf57

winglian commited on

more matrix updates
280832c

winglian commited on

update the support matrix
a43bae9

winglian commited on

pass a prompt in from stdin for inference
c4e4f81

winglian commited on

add streaming dataset support for pretraining datasets
eea2731

winglian commited on

add option to readme
5878bb1

winglian commited on

Update README.md to reflect current gradient checkpointing support
16f9e28
unverified

PocketDoc commited on

Merge pull request #169 from NanoCode012/feat/landmark
b5aa8d8
unverified

Nanobit commited on

Fix falcon support lora
b242b69
unverified

Nanobit commited on

Improve lambda labs instruction
2e13cef
unverified

Nanobit commited on

Feat: Add landmark attention
55b8542

Nanobit commited on

Merge pull request #132 from utensil/falcon-7b-qlora
c8242de
unverified

Nanobit commited on

Merge pull request #162 from NanoCode012/fix/custom-prompt-readme
f8d3798
unverified

Nanobit commited on

Move custom prompts out of hidden
2097a09

Nanobit commited on

Add peft install for quickstart
cfff94b

Nanobit commited on

Update peft and gptq instruction
2b222de

Nanobit commited on

update docs
5b33e29

winglian commited on

Update README.md for correct image tags
618816d
unverified

winglian commited on

added docker-compose file
84169d1

FarisHijazi commited on

Merge pull request #142 from NanoCode012/feat/custom-prompt-readme
ecfe8d0
unverified

winglian commited on

Remove redundant instruction
078a43e

Nanobit commited on

Add pygmalion
33e1890

Nanobit commited on

Add other prompt_strategies
1c38253

Nanobit commited on

Add short instruction for custom prompts
496b83f

Nanobit commited on

Add lambdalabs instruction
ff68a95

Nanobit commited on

Update doc for grad_accu and add validation tests for batch size
3c71c8d

Nanobit commited on

Merge pull request #130 from OpenAccess-AI-Collective/gas
f94dd62
unverified

winglian commited on

Axolotl supports falcon + qlora
8afb0fb
unverified

utensil commited on

swap batch size for gradient accumulation steps to decouple from num gpu
c2a0792

winglian commited on

add badge info to readme
b267d24

winglian commited on

Merge pull request #118 from NanoCode012/feat/torch-readme
0e4be62
unverified

Nanobit commited on

Update README.md
bdc4bd7
unverified

Nanobit commited on

Merge pull request #124 from OpenAccess-AI-Collective/xformers-fix
2d0ba3b
unverified

winglian commited on

update readme for SDP
2675fb7

winglian commited on

remove unused import and update readme
e3c494c

winglian commited on

FIx(readme): Fix torch missing from readme
cf61f14

Nanobit commited on

Merge pull request #108 from OpenAccess-AI-Collective/docker-gptq
bbc5bc5
unverified

winglian commited on

Update pip install to also setup tests
b1cc54b

Nanobit commited on

Add badge and update contribution section
afb31e1

Nanobit commited on

cleanup from pr feedback
48612f8

winglian commited on

update docs
d91a769

winglian commited on

default to qlora support, make gptq specific image
6ef96f5

winglian commited on

new hf_use_auth_token setting so login to hf isn't required
1c33eb8

winglian commited on

Add `dataset_shard_num` and `dataset_shard_idx`
8626b54

Nanobit commited on

Merge branch 'main' into refactor/rename-4b-to-gptq
147241c
unverified

winglian commited on

add example for falcoln support
d5f944c

winglian commited on