starfishmedical
/

SFDocumentOracle-open_llama_7b_700bt_lora

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ttronrud commited on Jun 5, 2023

Commit

190ca1e

•

1 Parent(s): 72bc16a

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -34,7 +34,7 @@ Both the combined model and adapter weights are available.
 The combined model can be loaded and used right out of the box:
 ```
-BASE_MODEL = "StarFish-DocOracle"
 model = LlamaForCausalLM.from_pretrained(
     BASE_MODEL,
@@ -55,7 +55,7 @@ bmodel = LlamaForCausalLM.from_pretrained(
     device_map="sequential"
 )
-peft_model_id = "starfishmedical/SFDocumentOracle-open_llama_7b_lora"
 tokenizer = LlamaTokenizer.from_pretrained(peft_model_id)
 model = PeftModel.from_pretrained(bmodel, peft_model_id)

 The combined model can be loaded and used right out of the box:
 ```
+BASE_MODEL = "starfishmedical/SFDocumentOracle-open_llama_7b_700bt_lora"
 model = LlamaForCausalLM.from_pretrained(
     BASE_MODEL,
     device_map="sequential"
 )
+peft_model_id = "starfishmedical/SFDocumentOracle-open_llama_7b_700bt_lora"
 tokenizer = LlamaTokenizer.from_pretrained(peft_model_id)
 model = PeftModel.from_pretrained(bmodel, peft_model_id)