test-flex-gpt / tokenizer_config.json

Commit History

override input_ids
bfe22ad

oweller2 commited on

new
edc8b9b

oweller2 commited on

add
35204e9

oweller2 commited on

tokenizer
08d8d00

oweller2 commited on

switch to gpt2
6a03105

oweller2 commited on

add eos token
3512ae1

oweller2 commited on

init
c46937d

oweller2 commited on