anslin-raj
/

Llama-2-7b-chat-hf-8-bit

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

anslin-raj commited on Jan 4, 2024

Commit

e2cb68d

·

1 Parent(s): f01a66e

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -1,5 +1,5 @@
 ---
-license: cc-by-nc-4.0
 language:
 - en
 library_name: transformers
@@ -13,4 +13,4 @@ HF_MODEL_REPO = "anslin-raj/Llama-2-7b-chat-hf-8-bit"
 tokenizer = AutoTokenizer.from_pretrained(HF_MODEL_REPO, device=device)
 model = AutoModelForCausalLM.from_pretrained(HF_MODEL_REPO, device_map=device, load_in_8bit=True)
-```

 ---
+license: bsd-3-clause
 language:
 - en
 library_name: transformers
 tokenizer = AutoTokenizer.from_pretrained(HF_MODEL_REPO, device=device)
 model = AutoModelForCausalLM.from_pretrained(HF_MODEL_REPO, device_map=device, load_in_8bit=True)
+```