5bit gguf of https://huggingface.co/CyberNative-AI/CreativeSocialAgent_GLM_4.7_Flash

Perfect to run on 3090 with 90k q8 context

Downloads last month
63
GGUF
Model size
30B params
Architecture
deepseek2
Hardware compatibility
Log In to add your hardware

5-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support