denru
/

Tess-v2.5.2-Qwen2-72B-4_0bpw-h6-exl2-pippa

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Edit model card

Exllama v2 Quantizations of Tess-v2.5.2-Qwen2-72B

Using turboderp's ExLlamaV2 v0.0.21 for quantization.

Original model: https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B

Downloads last month: 1

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.