PrunaAI
/

mattshumer-Llama-3-8B-16K-bnb-4bit-smashed

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mattshumer-Llama-3-8B-16K-bnb-4bit-smashed

1 contributor

History: 3 commits

sharpenb's picture

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb

fcbbc0f verified 7 months ago

.gitattributes

1.52 kB

initial commit 7 months ago
README.md

5.33 kB

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago
config.json

1.19 kB

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago
generation_config.json

142 Bytes

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago
model-00001-of-00002.safetensors

4.98 GB
LFS

089dbff68a58e4e92443d463ea372ebeac978b209550d38ea59b71774d4e779d 7 months ago
model-00002-of-00002.safetensors

1.05 GB
LFS

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago
model.safetensors.index.json

89 kB

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago
plots.png

436 kB

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago
results.json

1.49 kB

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago
smash_config.json

1.02 kB

81b7bedbbef8c4d9c8b30d2443ec0d1df8a7016f0b8e57757082f5c890ee80bb 7 months ago