Spaces:

Taranosaurus
/

Tokenizaminer

Running

App Files Files Community

Tokenizaminer / app.py

Commit History

Changed "Unknown Token" token to "Token 0"

507d429

Taranosaurus commited on Jan 3

Re-adjusting how the tokenizer and vocabulary loading

7dae6b7

Taranosaurus commited on Jan 3

Refactored how the model gets loaded

ce49ae8

Taranosaurus commited on Jan 3

Formatting and legibility changes

2488d19

Taranosaurus commited on Jan 3

Initial commit of the app.py

a5212f9

Taranosaurus commited on Jan 3