llmixer
/

Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Meta-Llama-3-70B-Instruct-8.0bpw-h8-exl2

Commit History

Update README.md

284a4f0
verified

llmixer commited on May 5, 2024

Create README.md

10fffd2
verified

llmixer commited on May 5, 2024

Re-quant with exllamav2 0.0.19, fixed EOS token ID

4c6717f
verified

llmixer commited on Apr 19, 2024

Model upload

7ceba9c
verified

llmixer commited on Apr 18, 2024

initial commit

862f987
verified

llmixer commited on Apr 18, 2024