Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MarsupialAI
/
llama-3-70B-Instruct-abliterated_iMatrix_GGUF
like
0
Transformers
GGUF
Inference Endpoints
conversational
License:
llama3
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
llama-3-70B-Instruct-abliterated_iMatrix_GGUF
1 contributor
History:
18 commits
MarsupialAI
Upload llama-3-70B-Instruct-abliterated_iQ2xs.gguf
dead239
verified
7 months ago
.gitattributes
3.4 kB
Upload llama-3-70B-Instruct-abliterated_iQ2xs.gguf
7 months ago
README.md
264 Bytes
Create README.md
7 months ago
groups_merged.txt
201 kB
Upload groups_merged.txt
7 months ago
llama-3-70B-Instruct-abliterated-imatrix.dat
24.9 MB
LFS
Upload llama-3-70B-Instruct-abliterated-imatrix.dat
7 months ago
llama-3-70B-Instruct-abliterated_Q2k.gguf
26.4 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q3km.gguf
34.3 GB
LFS
Upload llama-3-70B-Instruct-abliterated_Q3km.gguf
7 months ago
llama-3-70B-Instruct-abliterated_Q3ks.gguf
30.9 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q4km.gguf
42.5 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q4ks.gguf
40.3 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q5km.gguf
49.9 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q5ks.gguf
48.7 GB
LFS
Upload llama-3-70B-Instruct-abliterated_Q5ks.gguf
7 months ago
llama-3-70B-Instruct-abliterated_Q6k.gguf-00001-of-00002.gguf
48.3 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q6k.gguf-00002-of-00002.gguf
9.6 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q8.gguf-00001-of-00002.gguf
48.3 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_Q8.gguf-00002-of-00002.gguf
26.7 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_fp16.gguf-00001-of-00003.gguf
48.3 GB
LFS
Upload llama-3-70B-Instruct-abliterated_fp16.gguf-00001-of-00003.gguf
7 months ago
llama-3-70B-Instruct-abliterated_fp16.gguf-00002-of-00003.gguf
47.9 GB
LFS
Upload llama-3-70B-Instruct-abliterated_fp16.gguf-00002-of-00003.gguf
7 months ago
llama-3-70B-Instruct-abliterated_fp16.gguf-00003-of-00003.gguf
44.9 GB
LFS
Upload llama-3-70B-Instruct-abliterated_fp16.gguf-00003-of-00003.gguf
7 months ago
llama-3-70B-Instruct-abliterated_iQ2m.gguf
24.1 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_iQ2xs.gguf
21.1 GB
LFS
Upload llama-3-70B-Instruct-abliterated_iQ2xs.gguf
7 months ago
llama-3-70B-Instruct-abliterated_iQ2xxs.gguf
19.1 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_iQ3m.gguf
31.9 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_iQ3xxs.gguf
27.5 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_iQ4nl.gguf
40.1 GB
LFS
Upload 2 files
7 months ago
llama-3-70B-Instruct-abliterated_iQ4xs.gguf
37.9 GB
LFS
Upload 2 files
7 months ago
