Spaces:
Duplicated from xzuyn/Token-Count-Comparison

concedo
/

WebTokenizer

Running

App Files Files Community

WebTokenizer / requirements.txt

xzuyn's picture

Update requirements.txt

42aaa6e verified 9 months ago

33 Bytes

	gradio
	transformers
	sentencepiece