monuminu
/

llama-2-7b-miniguanaco

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

monuminu commited on Aug 28, 2023

Commit

0d6c1f2

•

1 Parent(s): 81b60c0

Update README.md

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -1,4 +1,5 @@
-```model = AutoModelForCausalLM.from_pretrained(
     model_name,
     low_cpu_mem_usage=True,
     return_dict=True,
@@ -13,4 +14,5 @@ pipe = pipeline(task="text-generation", model=model, tokenizer=tokenizer, do_sam
         eos_token_id=tokenizer.eos_token_id,
         max_length=1028, )
 result = pipe(f"<s>[INST] {prompt} [/INST]")
-print(result[0]['generated_text'])```

+```
+model = AutoModelForCausalLM.from_pretrained(
     model_name,
     low_cpu_mem_usage=True,
     return_dict=True,
         eos_token_id=tokenizer.eos_token_id,
         max_length=1028, )
 result = pipe(f"<s>[INST] {prompt} [/INST]")
+print(result[0]['generated_text'])
+```