Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Sdff-Ltba
/
LightChatAssistant-2x7B-GGUF
like
13
Text Generation
GGUF
Japanese
mistral
mixtral
Merge
Mixture of Experts
Not-For-All-Audiences
nsfw
Inference Endpoints
Model card
Files
Files and versions
Community
Deploy
Use this model
dccdb1e
LightChatAssistant-2x7B-GGUF
1 contributor
History:
19 commits
Sdff-Ltba
Update README.md
dccdb1e
verified
8 months ago
.gitattributes
2.59 kB
Rename LightChatAssistant-2x7B_iq4xs.gguf to LightChatAssistant-2x7B_iq4xs_imatrix.gguf
8 months ago
LightChatAssistant-2x7B_iq3s_imatrix.gguf
5.61 GB
LFS
Rename LightChatAssistant-2x7B_iq3s.gguf to LightChatAssistant-2x7B_iq3s_imatrix.gguf
8 months ago
LightChatAssistant-2x7B_iq3xxs_imatrix.gguf
4.99 GB
LFS
Rename LightChatAssistant-2x7B_iq3xxs.gguf to LightChatAssistant-2x7B_iq3xxs_imatrix.gguf
8 months ago
LightChatAssistant-2x7B_iq4xs_imatrix.gguf
6.9 GB
LFS
Rename LightChatAssistant-2x7B_iq4xs.gguf to LightChatAssistant-2x7B_iq4xs_imatrix.gguf
8 months ago
LightChatAssistant-2x7B_q4_k_m.gguf
7.78 GB
LFS
Upload LightChatAssistant-2x7B_q4_k_m.gguf
8 months ago
LightChatAssistant-2x7B_q4_k_s.gguf
7.34 GB
LFS
Upload LightChatAssistant-2x7B_q4_k_s.gguf
8 months ago
LightChatAssistant-2x7B_q5_k_m.gguf
9.13 GB
LFS
Upload 2 files
8 months ago
LightChatAssistant-2x7B_q6_k.gguf
10.6 GB
LFS
Rename LightChatAssistant-2x7B_q6_K.gguf to LightChatAssistant-2x7B_q6_k.gguf
8 months ago
LightChatAssistant-2x7B_q8.gguf
13.7 GB
LFS
Upload 2 files
8 months ago
README.md
1.24 kB
Update README.md
8 months ago
imatrix_LightChatAssistant-2x7B.imatrix
8.4 MB
LFS
Rename imatrix_chatntq_chatvector-MoE-Antler_chatvector-2x7B.imatrix to imatrix_LightChatAssistant-2x7B.imatrix
8 months ago