Qwopus3.5-v3-oQ-Quantization
Collection
2 items • Updated
How to use zesming/Qwopus3.5-27B-v3-oQ4e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwopus3.5-27B-v3-oQ4e zesming/Qwopus3.5-27B-v3-oQ4e
This model was quantized using oQ mixed-precision quantization.
4-bit