README.md

metadata

license: other
license_name: deepseek
library_name: gguf
license_link: >-
  https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct/blob/main/LICENSE
pipeline_tag: text-generation

GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.

Layers	Context	Template
62	16384	{instructions} ### Instruction: {prompt} ### Response: {response}