qgyd2021 commited on
Commit
03a4807
1 Parent(s): 2d61ce0
Files changed (1) hide show
  1. requirements.txt +1 -1
requirements.txt CHANGED
@@ -14,4 +14,4 @@ datasets
14
  python-dotenv==1.0.0
15
  sentencepiece==0.1.99
16
  scipy==1.10.1
17
- toktoken==0.5.1
 
14
  python-dotenv==1.0.0
15
  sentencepiece==0.1.99
16
  scipy==1.10.1
17
+ toktoken