Commit History

Merge branch 'main' into quadratic-warmup
c4cf567
unverified

winglian commited on

better configuration for quadratic warmup
c49729d

winglian commited on

Merge pull request #268 from OpenAccess-AI-Collective/fix-adam-args
13ac4d8
unverified

winglian commited on

params are adam_*, not adamw_*
19cf0bd

winglian commited on

Merge pull request #266 from OpenAccess-AI-Collective/trust-remote-no-llama
f74edd5
unverified

winglian commited on

skip explicit model type too if using trust_remote_code
d69da99

winglian commited on

don't use llama if trust_remote_code is set since that needs to use AutoModel path
66afb76

winglian commited on

Merge pull request #264 from OpenAccess-AI-Collective/NanoCode012-patch-1
a692ad3
unverified

Nanobit commited on

Fix for linter
41da98b
unverified

Nanobit commited on

Fix local path loading and custom strategy type
9e64f42
unverified

Nanobit commited on

Merge pull request #221 from utensil/local_dataset
b9b7d4c
unverified

winglian commited on

Merge pull request #258 from NanoCode012/fix/deprecate-push
9bed281
unverified

winglian commited on

Fix future deprecation push_to_hub_model_id
e79c8e6

Nanobit commited on

pin pydantic so deepspeed isn't broken
7145695

winglian commited on

Merge pull request #247 from OpenAccess-AI-Collective/fix-apex-base
3a783c0
unverified

winglian commited on

Merge pull request #255 from OpenAccess-AI-Collective/open-orca-prompts
1e5014a
unverified

winglian commited on

11.7.0 nvidia/cuda docker images are deprecated, move to 11.7.1
a10da1c

winglian commited on

Merge pull request #246 from OpenAccess-AI-Collective/sys-prompts-instruct
4066c78
unverified

winglian commited on

open orca support
78a1e1f

winglian commited on

Merge pull request #249 from OpenAccess-AI-Collective/NanoCode012-patch-1
bc8a2e5
unverified

Nanobit commited on

Merge pull request #252 from OpenAccess-AI-Collective/NanoCode012-readme-fix
910ebe4
unverified

Nanobit commited on

Update README.md
c146880
unverified

Nanobit commited on

Fix typing list
77bdb7d
unverified

Nanobit commited on

update pip install command for apex
530809f

winglian commited on

add option for instruct w sys prompts
924bbfd

winglian commited on

Merge pull request #224 from OpenAccess-AI-Collective/system-prompt-data
f150c02
unverified

winglian commited on

Merge pull request #244 from OpenAccess-AI-Collective/push-to-hub
5c39c00
unverified

winglian commited on

push intermediate model checkpoints to hub
612aabd

winglian commited on

Merge pull request #243 from OpenAccess-AI-Collective/unprompted-instruct
af05883
unverified

winglian commited on

skip the system prompt
05ab909

winglian commited on

pylint for duplicated code for system prompts
7b57ed7

winglian commited on

add tests and supoort for loader for sys prompt data
3a38271

winglian commited on

initial wip to get sys prompt from dataset
8d20e0a

winglian commited on

Merge pull request #240 from OpenAccess-AI-Collective/tokenizer-fast
de8ed22
unverified

winglian commited on

Merge pull request #241 from OpenAccess-AI-Collective/py3-pre-commit
478d8c7
unverified

winglian commited on

better py3 support w pre-commit
645c135

winglian commited on

optionally define whether to use_fast tokenizer
47d601f

winglian commited on

Merge pull request #218 from OpenAccess-AI-Collective/no-fail-fast
756dfba
unverified

winglian commited on

Merge pull request #235 from msinha251/Fixing-data-readme
91ab059
unverified

winglian commited on

Fixing Data Readme
0aeb7c7

Mahesh Sinha commited on

Support loading data files from a local directory
9bdd30c

utensil commited on

don't fail fast
d35278a

winglian commited on

Merge pull request #215 from OpenAccess-AI-Collective/adamw-hyperparams-cfg
9492d4e
unverified

winglian commited on

Additional test case per pr
ad5ca4f

winglian commited on

add validation and tests for adamw hyperparam
cb9d3af

winglian commited on

add docs
c969f0a

winglian commited on

support adamw and grad norm hyperparams
6d0ee4b

winglian commited on

Merge pull request #212 from OpenAccess-AI-Collective/doc-20230615-v1
a81f52d
unverified

winglian commited on

Merge pull request #214 from OpenAccess-AI-Collective/fix-tokenizing-labels
1925eaf
unverified

winglian commited on

fix test name
1ab3bf3

winglian commited on