Some of my own quants:

Pygmalion-2-13b-SuperCOT_Q4_K_M.gguf
Pygmalion-2-13b-SuperCOT_Q5_K_M.gguf

Source: royallab

Source Model: Pygmalion-2-13b-SuperCOT

Source models for royallab/Pygmalion-2-13b-SuperCOT (Merge)

PygmalionAI/pygmalion-2-13b (Ref)
ausboss/llama2-13b-supercot-loras (Lora)

Downloads last month: 2

GGUF

Model size

13B params

Architecture

llama

4-bit

5-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.