McGill-NLP
/

LLM2Vec-Meta-Llama-3-8B-Instruct-mntp-supervised

Model card Files Files and versions Community

Update README.md

#5

by Mathux - opened Jul 29

base: refs/heads/main

←

from: refs/pr/5

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -2540,7 +2540,7 @@ import torch
 from transformers import AutoTokenizer, AutoModel, AutoConfig
 from peft import PeftModel
-# Loading base Mistral model, along with custom code that enables bidirectional connections in decoder-only LLMs. MNTP LoRA weights are merged into the base model.
 tokenizer = AutoTokenizer.from_pretrained(
     "McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp"
 )

 from transformers import AutoTokenizer, AutoModel, AutoConfig
 from peft import PeftModel
+# Loading base Llama-3 model, along with custom code that enables bidirectional connections in decoder-only LLMs. MNTP LoRA weights are merged into the base model.
 tokenizer = AutoTokenizer.from_pretrained(
     "McGill-NLP/LLM2Vec-Meta-Llama-3-8B-Instruct-mntp"
 )