README.md · dranger003/deepseek-coder-33b-instruct-iMat.GGUF at main

metadata

license: other
license_name: deepseek
library_name: gguf
license_link: >-
  https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct/blob/main/LICENSE
pipeline_tag: text-generation

GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.

2024-03-13: Updated IQ1_S using latest commit 19885d20. More info here and here.

Layers	Context	Template
62	16384	{instructions} ### Instruction: {prompt} ### Response: {response}