Commit History
Standardize system prompt format for AlpacaPrompter (#1190) [skip ci]
af02430
unverified
Oleh Kuznetsov
commited on
fix: remove excessive newlines in system prompt(s) for alpaca (#936)
450e04d
unverified
kallewoof
commited on
various bugfixes (#856)
1470650
unverified
winglian
commited on
cleanup the old multipack dataloader (#841)
1a6309c
unverified
winglian
commited on
Create preprocess CLI (#785)
e50ab07
unverified
casperhansen
commited on
misc sharegpt fixes (#723)
f30afe4
unverified
winglian
commited on
use fastchat conversations template (#578)
e7d3e2d
unverified
winglian
commited on
split completion text to sequence_len (#616)
97d3776
unverified
winglian
commited on
Prompters: ShareGPT: Allow for custom system prompts
995557b
kingbri
commited on
support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348)
d2e7f27
unverified
winglian
commited on
Error msg for sharegpt if conv has less than 2 msg (#379)
63fdb5a
unverified
flotos
commited on
Attention mask and position id fixes for packing (#285)
2bb0b78
unverified
winglian
commited on
Fix(message): Improve error message for bad format (#365)
e37d935
unverified
Nanobit
commited on
Fixed pre-commit problems, fixed small bug in logging_config to handle LOG_LEVEL env var
b1f4f7a
theobjectivedad
commited on
Adding logging enhancement
553a86b
theobjectivedad
commited on
add tests and supoort for loader for sys prompt data
3a38271
winglian
commited on
initial wip to get sys prompt from dataset
8d20e0a
winglian
commited on
add typehints
c7dee56
winglian
commited on
add new sharegpt, refactor prompt so it can be customized later, add exception if no data is processed
aac4b76
winglian
commited on
Fix sharegpt prompt
25eeeeb
Nanobit
commited on
Apply isort then black
37293dc
Nanobit
commited on
Fix mypy typing
e9650d3
Nanobit
commited on
Remove fixme disable
69722ae
Nanobit
commited on
Remove disable too many arg
5658717
Nanobit
commited on
Lint prompters.py
cb4f0e9
Nanobit
commited on
Fix: Remove base class inherit for CompletionPrompter
9ac1884
unverified
Nanobit
commited on
fixes w/ example for super basic lora starter
a5d739b
winglian
commited on
apply black formatting
ce34d64
winglian
commited on
more qlora support
e8aacfb
winglian
commited on
optionally be able to specify alpaca or chat style prompts
1d5ab84
winglian
commited on
concise multiple choice and tldr summarize
1365073
winglian
commited on
add alpaca multiple choice instruct dataset support
b46bc02
winglian
commited on
fix prompters, especially the sharegpt prompter
5e37144
winglian
commited on
black formatting
2bc1a5b
winglian
commited on
Rename variable to use same convention
174b74d
Nanobit
commited on
Add CompletionPrompt type
cf68153
Nanobit
commited on
Jeopardy bot! (#17)
a12fb0a
unverified
winglian
commited on
fix sharegpt tokenization, refactor tokenization debugging
5159d00
winglian
commited on
fix sharegpt handling from hf, don't worry about loading llama if using earlier transformers release
8d43785
winglian
commited on
WIP large refactor to make finetune script a little more manageable (#3)
6045345
unverified
winglian
commited on
add support for alpaca reflect training (#2)
81de0ef
unverified
winglian
commited on
black formatting
a6028d3
winglian
commited on
make it work with pythia in the cloud
8d959a7
winglian
commited on
WIP for axolotl trainer
ce24f5e
winglian
commited on