denru
/

Tess-v2.5.2-Qwen2-72B-4_0bpw-h6-exl2-pippa

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Tess-v2.5.2-Qwen2-72B-4_0bpw-h6-exl2-pippa / README.md

denru's picture

Update README.md

33b56be verified 3 months ago

|

history blame contribute delete

No virus

299 Bytes

metadata

library_name: transformers
tags: []

Exllama v2 Quantizations of Tess-v2.5.2-Qwen2-72B

Using turboderp's ExLlamaV2 v0.0.21 for quantization.

Original model: https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B