This repo includes the GGUF versions of MiniCPM3-4B:

  • minicpm3-4b-fp16.gguf
  • minicpm3-4b-q4_k_m.gguf

For usage and more information, please check our GitHub repo.

Downloads last month
6,712
GGUF
Model size
4.07B params
Architecture
minicpm3

4-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for openbmb/MiniCPM3-4B-GGUF

Quantized
(8)
this model
Quantizations
2 models

Collection including openbmb/MiniCPM3-4B-GGUF