Edit model card

YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

GPTQ Quantized model of KULLM3 Korea University NLP AI Lab.

I did the conversion to GPTQ, the whole model was built by NLP AI Lab, therefore, all my credits to them.

The model seems to work really well in GPTQ and it seems a new step towards a fully usable korean LLM.

It was converted using 500 samples of korean wiki and 500 samples of english wiki.

Amazing work!

The original repo: https://huggingface.co/nlpai-lab/KULLM3

Downloads last month: 0

Safetensors

Model size

1.67B params

Tensor type

I32

FP16

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.