test-flex-gpt / tokenizer_config.json

Commit History

tokenizer
74aad37

oweller2 commited on

update
38e83eb

oweller2 commited on

update
0157fcc

oweller2 commited on

update
efef38a

oweller2 commited on

override input_ids
bfe22ad

oweller2 commited on

new
edc8b9b

oweller2 commited on

add
35204e9

oweller2 commited on

tokenizer
08d8d00

oweller2 commited on

switch to gpt2
6a03105

oweller2 commited on

add eos token
3512ae1

oweller2 commited on

init
c46937d

oweller2 commited on