Spaces:
Duplicated from mocomoco-inc/ChatGPTTokenComparison

gojiteji
/

llm-jp-tokenizer-100k.ver3.0b1

Sleeping

App Files Files Community

llm-jp-tokenizer-100k.ver3.0b1 / requirements.txt

gojiteji's picture

Update requirements.txt

bba2d8e verified 3 months ago

72 Bytes

	tiktoken==0.7.0
	transformers==4.41.2
	gradio==4.37.2
	sentencepiece==0.2.0