chargoddard commited on
Commit
3c3d02c
1 Parent(s): e65c456

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -1,3 +1,3 @@
1
  [01-ai/Yi-34B](https://huggingface.co/01-ai/Yi-34B/tree/main) with tensors renamed to match standard Llama modelling code. Model can be loaded without trust_remote_code, but the tokenizer can not.
2
 
3
- The branch `llama-tokenizer` uses the Llama tokenizer class as well, but *does not* work with LlamaTokenizerFast.
 
1
  [01-ai/Yi-34B](https://huggingface.co/01-ai/Yi-34B/tree/main) with tensors renamed to match standard Llama modelling code. Model can be loaded without trust_remote_code, but the tokenizer can not.
2
 
3
+ The branch `llama-tokenizer` uses the Llama tokenizer class as well.