8.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2

8bit heads. Default measurement dataset.

Downloads last month
6
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for MarsupialAI/EVA-Qwen2.5-14B-v0.2_EXL2_8.0BPW_H8

Base model

Qwen/Qwen2.5-14B
Quantized
(73)
this model