Johnson8187
/

Megrez-3B-Instruct-Q4_K_M-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Megrez-3B-Instruct-Q4_K_M-GGUF

This is the GGUF Q_4_K_M version of the Infinigence/Megrez-3B-Instruct model.

Downloads last month: 33

GGUF

Model size

2.92B params

Architecture

llama

4-bit

Inference Examples

Text Generation

Unable to determine this model's library. Check the docs .

Model tree for Johnson8187/Megrez-3B-Instruct-Q4_K_M-GGUF

Base model

Infinigence/Megrez-3B-Instruct

Quantized

(2)

this model