llmixer
/

Meta-Llama-3.1-70B-Instruct-8.1bpw-h8-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-8.1bpw-h8-exl2 / README.md

llmixer's picture

Create README.md

c6d1ff3 verified 4 months ago

|

history blame contribute delete

152 Bytes

	---
	pipeline_tag: text-generation
	---
	8.1 bpw exl2 quant of [Meta-Llama-3.1-70B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-70B-Instruct)