McGill-NLP
/

LLM2Vec-Meta-Llama-3-8B-Instruct-mntp-supervised

Model card Files Files and versions Community

Mathux commited on Jul 29

Commit

44f17ad

•

1 Parent(s): baa8ebf

Update README.md

Replace Mistral by Llama3 in one comment

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -2540,7 +2540,7 @@ import torch
 from transformers import AutoTokenizer, AutoModel, AutoConfig
 from peft import PeftModel
-# Loading base Mistral model, along with custom code that enables bidirectional connections in decoder-only LLMs. MNTP LoRA weights are merged into the base model.
 tokenizer = AutoTokenizer.from_pretrained(
     "McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp"
 )

 from transformers import AutoTokenizer, AutoModel, AutoConfig
 from peft import PeftModel
+# Loading base Llama-3 model, along with custom code that enables bidirectional connections in decoder-only LLMs. MNTP LoRA weights are merged into the base model.
 tokenizer = AutoTokenizer.from_pretrained(
     "McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp"
 )