ruwan
/

open-llama-sharded-3GB-7B-alpaca-vmware

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

ruwan commited on Jun 8, 2023

Commit

23154bc

·

1 Parent(s): 832577d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,6 +9,6 @@ model_path = 'ruwan/open-llama-sharded-1GB-7B-alpaca-vmware'
 tokenizer = LlamaTokenizer.from_pretrained("openlm-research/open_llama_7b")
 model = LlamaForCausalLM.from_pretrained(
-    model_path, torch_dtype=torch.float16, device_map='auto',load_in_8bit=True
 )

 tokenizer = LlamaTokenizer.from_pretrained("openlm-research/open_llama_7b")
 model = LlamaForCausalLM.from_pretrained(
+    model_path, torch_dtype=torch.float16, device_map='auto'
 )