Commits · Dovakiins/qwerrwe

Pretrain transforms (#1261)

c7cf381
unverified

winglian commited on Feb 6

relora: magnitude pruning of the optimizer (#1245)

8c2e05a
unverified

winglian commited on Feb 6

precompute dpo logprobs setting and fixes (#1199) [skip ci]

33e1170
unverified

winglian commited on Jan 25

Feat/chatml add system message (#1117)

98b4762
unverified

mhenrichsen Mads Henrichsen

winglian commited on Jan 25

DPO cleanup (#1126)

7523d1f
unverified

winglian

plaguss HF staff commited on Jan 23

add ultrachat prompt strategies (#996)

ba043a3
unverified

winglian commited on Dec 29, 2023

Respect sequence_len in config for `type: llama2_chat` (#926)

f1de29d
unverified

hamel commited on Dec 12, 2023

fixing prompt template of chatml by removal of linebreak (#922)

03c6318
unverified

timlim123 Timothy Lim commited on Dec 9, 2023

Update to adapt to sharegpt datasets with "assistant" rather than "gp… (#774)

0800885
unverified

MilesQLi

winglian commited on Oct 28, 2023

fixes for alpaca w chatml, and don't include attention_mask w mistral for flash attention (#728)

3553172
unverified

winglian commited on Oct 14, 2023

add support for defined train split (#654)

409ca0f
unverified

winglian commited on Sep 29, 2023

use fastchat conversations template (#578)

e7d3e2d
unverified

winglian commited on Sep 27, 2023

split completion text to sequence_len (#616)

97d3776
unverified

winglian commited on Sep 22, 2023

support custom field for completion from yml (#580)

f7a2263
unverified

winglian commited on Sep 15, 2023

feat: add Metharme prompt strategy (#446)

f474650
unverified

TearGosling

Nanobit commited on Aug 22, 2023

support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348)

d2e7f27
unverified

winglian commited on Aug 20, 2023

fix orca prompts (#422)

1b7e860
unverified

winglian commited on Aug 16, 2023

Attention mask and position id fixes for packing (#285)

2bb0b78
unverified

winglian commited on Aug 12, 2023

Fix(message): Improve error message for bad format (#365)

e37d935
unverified

Nanobit commited on Aug 12, 2023

experimental llama 2 chat support (#296)

3392270
unverified

Jan Philipp Harries Jan Philipp Harries commited on Aug 6, 2023

Added Orca Mini prompt strategy (#263)

c93655c
unverified

Jan Philipp Harries Jan Philipp Harries commited on Aug 5, 2023

update prompts for open orca to match the paper (#317)

3d4984b
unverified

winglian commited on Jul 22, 2023

Fixed pre-commit problems, fixed small bug in logging_config to handle LOG_LEVEL env var

b1f4f7a

theobjectivedad commited on Jul 15, 2023

Adding logging enhancement

553a86b

theobjectivedad commited on Jul 14, 2023

Merge pull request #255 from OpenAccess-AI-Collective/open-orca-prompts

1e5014a
unverified

winglian commited on Jul 1, 2023

open orca support

78a1e1f

winglian commited on Jul 1, 2023

add option for instruct w sys prompts

924bbfd

winglian commited on Jun 29, 2023

Merge pull request #224 from OpenAccess-AI-Collective/system-prompt-data

f150c02
unverified

winglian commited on Jun 27, 2023

push intermediate model checkpoints to hub

612aabd

winglian commited on Jun 27, 2023

skip the system prompt

05ab909

winglian commited on Jun 26, 2023

pylint for duplicated code for system prompts

7b57ed7

winglian commited on Jun 18, 2023

add tests and supoort for loader for sys prompt data

3a38271

winglian commited on Jun 18, 2023

initial wip to get sys prompt from dataset

8d20e0a

winglian commited on Jun 17, 2023

bugfix for potential off by one

7925ddc

winglian commited on Jun 15, 2023

update alpaca_chat prompts for instructions to explainn the conversation

4b43a66

winglian commited on Jun 12, 2023

add new sharegpt, refactor prompt so it can be customized later, add exception if no data is processed

aac4b76

winglian commited on Jun 11, 2023

fix camel ai, add guanaco/oasst mapping for sharegpt

59bb219

winglian commited on Jun 7, 2023

new prompters, misc fixes for output dir missing using fsdp, and changing max seq len

4ac9e25

winglian commited on Jun 6, 2023