license: apache-2.0 | |
language: | |
- en | |
base_model: EVA-UNIT-01/EVA-D-Qwen2.5-1.5B-v0.0 | |
base_model_relation: quantized | |
library_name: mlc-llm | |
pipeline_tag: text-generation | |
tags: | |
- chat | |
4-bit [GPTQ](https://arxiv.org/abs/2210.17323) quantized version of [EVA-D-Qwen2.5-1.5B-v0.0](https://huggingface.co/EVA-UNIT-01/EVA-D-Qwen2.5-1.5B-v0.0) for inference with the [Private LLM](https://privatellm.app/) app. | |