Spaces:

Dovakiins
/

qwerrwe

Build error

App Files Files Community

qwerrwe / tests /fixtures

100 contributors

History: 5 commits

winglian's picture

fix fixture for new tokenizer handling in transformers (#428)

8cace80 unverified over 1 year ago

alpaca
fix packing so that concatenated sequences reset the attention over 1 year ago
conversation.json

9.03 kB

add unit test for sharegpt tokenization over 1 year ago
conversation.tokenized.json

28.5 kB

Fix pre-commit for rebased files over 1 year ago
conversation.tokenized_llama2chat.json

77.4 kB

fix fixture for new tokenizer handling in transformers (#428) over 1 year ago