README.md

metadata

license: mit
datasets:
  - rhyliieee/notes-completion-set
base_model:
  - aaditya/Llama3-OpenBioLLM-8B
pipeline_tag: text-generation
library_name: transformers

Finetuned a pretrained Model with Lora, resize the base model's embeddings, then load Peft Model with the resized base model.

"""

add special tokens to the tokenizer and base model before merging peft with base

open_tokenizer.add_special_tokens({ "additional_special_tokens": ["<|start_header_id|>", "<|end_header_id|>", "<|eot_id|>"] }) base_model.resize_token_embeddings(len(open_tokenizer))

reload the peft model with resized token embedding of base model

peft_model = PeftModel.from_pretrained(base_model, "rhyliieee/LLaMA3-8Bit-Lora-Med-v2",)

perform merging

merged_peft_base_with_special_tokens = peft_model.merge_and_unload() """