Satwik11
/

Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit

Text Generation

4-bit precision

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Satwik11 commited on 18 days ago

Commit

c498661

•

1 Parent(s): ca0d26a

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -12,6 +12,8 @@ tags:
 datasets:
 - meta-llama/Llama-3.3-70B-Instruct
 library_name: transformers
 ---
 # Llama 3.3 70B Instruct (AutoRound GPTQ 4-bit)
@@ -87,4 +89,4 @@ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
 outputs = model.generate(**inputs, max_length=200)
 print(tokenizer.decode(outputs[0], skip_special_tokens=True))
-```

 datasets:
 - meta-llama/Llama-3.3-70B-Instruct
 library_name: transformers
+base_model:
+- meta-llama/Llama-3.3-70B-Instruct
 ---
 # Llama 3.3 70B Instruct (AutoRound GPTQ 4-bit)
 outputs = model.generate(**inputs, max_length=200)
 print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+```