well, nothing. Just a test model, maybe good. you can use GGUF from my friend, he do many quant :)
https://huggingface.co/mradermacher/Inixion-2x8B-GGUF
thank for AWQ version, I didn't know that my model have AWQ version too:
- Downloads last month
- 11
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.