Hugging Face's logo

CalderaAI
/
13B-Ouroboros-GPTQ4bit-128g-CUDA

Text Generation
Transformers
PyTorch
English
llama
alpaca
vicuna
uncensored
Merge
mix
airoboros
openorca
orcamini
orca
instruct
mixtune
GPTQ
quantized
4bit
cuda
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

GPTQ 4 bit 128 groupsize CUDA quantization of CalderaAI's 13B Ouroboros:

https://huggingface.co/CalderaAI/13B-Ouroboros

Downloads last month
6
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Datasets used to train CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA