PrunaAI
/

Llama-3-Soliloquy-8B-HQQ-2bit-smashed

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3-Soliloquy-8B-HQQ-2bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996

b170365 verified 6 months ago

.gitattributes

1.52 kB

initial commit 6 months ago
README.md

5.51 kB

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago
config.json

764 Bytes

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago
plots.png

426 kB

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago
qmodel.pt
Detected Pickle imports (8)
- "torch.float16",
- "torch.HalfStorage",
- "torch.uint8",
- "torch.ByteStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_parameter",
- "torch.Size",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
4.01 GB
LFS

6566af962143cd437e898eea70d68ea9589df44fb5263438dbe136c3cbf96788 6 months ago
results.json

1.7 kB

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago
smash_config.json

1.02 kB

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago
special_tokens_map.json

449 Bytes

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago
tokenizer.json

9.08 MB

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago
tokenizer_config.json

51 kB

6d9fea6c80946606c794e48457a53e326486520436a91ecaf39a8d6a7ac5e996 6 months ago