3bpw exl2 quant of: https://huggingface.co/TheDrummer/Nautilus-70B-v0.1
BeaverAI proudly presents...
Nautilus 70B v1 🔱
A finetune of Nvidia's Llama 3.1 Nemotron 70B
Its breath is pure and healthy. It is an immense desert, where man is never lonely, for he feels life stirring on all sides.
Description
"Q6 is pretty good" - Bertro
Links
- Original: https://huggingface.co/TheDrummer/Nautilus-70B-v0.1
- GGUF: https://huggingface.co/TheDrummer/Nautilus-70B-v0.1-GGUF
Arsenal (Supported Chat Templates)
- Metharme (Pygmalion in ST) (Recommended unless you don't like its output)
- Llama 3
Favorite RP Format
*action* Dialogue *thoughts* Dialogue *narration* in 1st person PoV
Special Thanks
Thank you Gargy!
- Downloads last month
- 8
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for Jellon/Nautilus-70B-v0.1-exl2-3bpw
Base model
TheDrummer/Nautilus-70B-v0.1