metadata
tags:
- roleplay
- llama3
- sillytavern
language:
- en
This is a Llama-3 land now, cowboys!
"Dolphin time"
GGUF-IQ-Imatrix quants for ChaoticNeutrals/Poppy_Porpoise-v0.4-L3-8B.
Recommended presets here or here. Read the model information.
Use the latest version of KoboldCpp. Use the provided presets.
This is all still highly experimental, modified configs were used to avoid the tokenizer issues, let the authors know how it performs for you, feedback is more important than ever now.
For 8GB VRAM GPUs, I recommend the Q4_K_M-imat quant for up to 12288 context sizes.
Original model information: