qgyd2021 commited on
Commit
ed4318d
1 Parent(s): 03a4807
Files changed (1) hide show
  1. requirements.txt +1 -1
requirements.txt CHANGED
@@ -14,4 +14,4 @@ datasets
14
  python-dotenv==1.0.0
15
  sentencepiece==0.1.99
16
  scipy==1.10.1
17
- toktoken
 
14
  python-dotenv==1.0.0
15
  sentencepiece==0.1.99
16
  scipy==1.10.1
17
+ tiktoken==0.5.1