llmixer
/

Meta-Llama-3.1-70B-Instruct-8.1bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-8.1bpw-h8-exl2

File size: 152 Bytes

c6d1ff3

---
pipeline_tag: text-generation
---
8.1 bpw exl2 quant of [Meta-Llama-3.1-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-70B-Instruct)