Some of my own quants:

spicyboros-13b-2.2_Q5_1.gguf

Source: jondurbin

Source Model: spicyboros-13b-2.2

Source models for jondurbin/spicyboros-13b-2.2 (Finetune, jondurbin/airoboros-2.2)

meta-llama/Llama-2-13b-hf (Ref)

Downloads last month: 1

GGUF

Model size

13B params

Architecture

llama

5-bit

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.