chargoddard
commited on
Commit
•
e65c456
1
Parent(s):
3014199
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
[01-ai/Yi-34B](https://huggingface.co/01-ai/Yi-34B/tree/main) with tensors renamed to match standard Llama modelling code. Model can be loaded without trust_remote_code, but the tokenizer can not.
|
2 |
+
|
3 |
+
The branch `llama-tokenizer` uses the Llama tokenizer class as well, but *does not* work with LlamaTokenizerFast.
|