This is the Q8_0 quantum model for llama.cpp:

https://github.com/ggerganov/llama.cpp/pull/6515

Downloads last month
3
GGUF
Model size
132B params
Architecture
dbrx

8-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including phymbert/dbrx-16x12b-instruct-q8_0-gguf