Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
knifeayumu
/
LLM_Collection
like
5
GGUF
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
1
Deploy
Use this model
Edit model card
YAML Metadata Warning:
empty or missing yaml metadata in repo card (
https://huggingface.co/docs/hub/model-cards#model-card-metadata
)
Notable Deleted Models:
Notable Deleted Models:
OnlyChat-Miqu-v1.q4_k_m.gguf
(It was up for few hours [?] by OnlyThings and got deleted on HF)
NeteLegacy-13B.q5_k_m.gguf
(I believe it's the first version of Nete by Undi95, deleted due to of being too NovelAI)
Downloads last month
3,734
GGUF
Model size
70.6B params
Architecture
llama
4-bit
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
Q4_K_M
5-bit
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
Q5_K_M
6-bit
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
Q6_K
8-bit
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
Q8_0
16-bit
F16
Inference API
Unable to determine this model's library. Check the
docs
.
Collection including
knifeayumu/LLM_Collection
Archives
Collection
3 items
•
Updated
28 days ago