complexinteractive
/

openerotica-Occult-Roleplay-Mixtral-4x7b-GGUF

Text Generation

text-generation-inference

Not-For-All-Audiences

nsfw

Inference Endpoints

Model card Files Files and versions Community

Edit model card

GGUF quant of https://huggingface.co/openerotica/Occult-Roleplay-Mixtral-4x7B

Only Q5_K and FP16 for now, given it seems to be under active development

Prompt format: ChatML, possibly others

All credit to openerotica et al

Downloads last month: 124

GGUF

Model size

24.2B params

Architecture

llama

5-bit

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.