qwerrwe / src

Commit History

Merge pull request #274 from OpenAccess-AI-Collective/NanoCode012-patch-2
168a7a0
unverified

Nanobit commited on

Update log message format, IMO this is easier to read.
9234b75

theobjectivedad commited on

Feat: Add save_safetensors
5491278

Nanobit commited on

Set push to hub as private by default
1514739
unverified

Nanobit commited on

support for loading a model by git revision
69a2350

winglian commited on

Merge branch 'main' into quadratic-warmup
c4cf567
unverified

winglian commited on

better configuration for quadratic warmup
c49729d

winglian commited on

params are adam_*, not adamw_*
19cf0bd

winglian commited on

skip explicit model type too if using trust_remote_code
d69da99

winglian commited on

don't use llama if trust_remote_code is set since that needs to use AutoModel path
66afb76

winglian commited on

Merge pull request #221 from utensil/local_dataset
b9b7d4c
unverified

winglian commited on

Fix future deprecation push_to_hub_model_id
e79c8e6

Nanobit commited on

Merge pull request #255 from OpenAccess-AI-Collective/open-orca-prompts
1e5014a
unverified

winglian commited on

Merge pull request #246 from OpenAccess-AI-Collective/sys-prompts-instruct
4066c78
unverified

winglian commited on

open orca support
78a1e1f

winglian commited on

Fix typing list
77bdb7d
unverified

Nanobit commited on

add option for instruct w sys prompts
924bbfd

winglian commited on

Merge pull request #224 from OpenAccess-AI-Collective/system-prompt-data
f150c02
unverified

winglian commited on

push intermediate model checkpoints to hub
612aabd

winglian commited on

skip the system prompt
05ab909

winglian commited on

pylint for duplicated code for system prompts
7b57ed7

winglian commited on

add tests and supoort for loader for sys prompt data
3a38271

winglian commited on

initial wip to get sys prompt from dataset
8d20e0a

winglian commited on

optionally define whether to use_fast tokenizer
47d601f

winglian commited on

Support loading data files from a local directory
9bdd30c

utensil commited on

add validation and tests for adamw hyperparam
cb9d3af

winglian commited on

support adamw and grad norm hyperparams
6d0ee4b

winglian commited on

Merge pull request #212 from OpenAccess-AI-Collective/doc-20230615-v1
a81f52d
unverified

winglian commited on

Merge pull request #214 from OpenAccess-AI-Collective/fix-tokenizing-labels
1925eaf
unverified

winglian commited on

add float16 docs and tweak typehints
88e17ff

winglian commited on

bugfix for potential off by one
7925ddc

winglian commited on

style correction
136522f

maciej.karasek commited on

issue #205 bugfix
556fe40

maciej.karasek commited on

update alpaca_chat prompts for instructions to explainn the conversation
4b43a66

winglian commited on

add axolotl trainer and quadratic warmup
7dc580b

winglian commited on

Merge branch 'main' into flash-optimum
fd2c981
unverified

winglian commited on

Merge pull request #187 from OpenAccess-AI-Collective/strip-peft-device-map
93dacba
unverified

winglian commited on

Merge pull request #177 from NanoCode012/fix/landmark-patch
8002ffb
unverified

winglian commited on

Merge pull request #192 from OpenAccess-AI-Collective/sharegpt-custom-prompt
74ef5cc
unverified

winglian commited on

Merge branch 'main' into strip-peft-device-map
5e616d9
unverified

winglian commited on

Merge pull request #159 from AngainorDev/patch-1
8e568bb
unverified

Nanobit commited on

add typehints
c7dee56

winglian commited on

add new sharegpt, refactor prompt so it can be customized later, add exception if no data is processed
aac4b76

winglian commited on

add check for attr
c9a149f

winglian commited on

new validation for mpt w grad checkpoints
14668fa

winglian commited on

Fix strict and Lint
b565ecf

Angainor commited on

match up gradient checkpointing when using lora w config
fe0b768

winglian commited on

Fix set mem_id for inference and refactor
974dc00

Nanobit commited on

Clean up landmark patching
a6190c8

Nanobit commited on