Exl2 quants for Qwen1.5-0.5B-Chat
Automatically quantized using the auto quant script from hf-scripts
Created as an example for Auto EXL2 HF upload
BPW:
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The HF Inference API does not support text-generation models for ExLlamaV2 library.
Model tree for Anthonyg5005/Qwen1.5-0.5B-Chat-exl2
Base model
Qwen/Qwen1.5-0.5B-Chat