Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
Meta-Llama-3.1-405B-Instruct-FP8-dynamic
like
14
Follow
Neural Magic
256
Text Generation
Transformers
Safetensors
8 languages
llama
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
c2358a5
Meta-Llama-3.1-405B-Instruct-FP8-dynamic
Commit History
Updated compression_config to quantization_config
c2358a5
verified
mgoin
commited on
Oct 9
Update README.md
cd22294
verified
Lin-K76
commited on
Aug 22
Update README.md
55d57ff
verified
Lin-K76
commited on
Aug 22
Update README.md
5e2d102
verified
Lin-K76
commited on
Aug 22
Upload folder using huggingface_hub
1017899
verified
Lin-K76
commited on
Aug 21
Upload folder using huggingface_hub
622b0f8
verified
Lin-K76
commited on
Aug 21
Update README.md
89397e6
verified
alexmarques
commited on
Aug 13
Update README.md
c27accb
verified
alexmarques
commited on
Jul 30
Update README.md
71fb5c0
verified
Lin-K76
commited on
Jul 27
Update README.md
6e463b1
verified
Lin-K76
commited on
Jul 27
Fix typo
459ee6c
verified
ekurtic
commited on
Jul 27
Update README.md
46557f3
verified
Lin-K76
commited on
Jul 26
Update README.md
2872cfa
verified
Lin-K76
commited on
Jul 26
Upload folder using huggingface_hub
c7a1cae
verified
Lin-K76
commited on
Jul 26
Upload folder using huggingface_hub
982ba1f
verified
Lin-K76
commited on
Jul 26
Update README.md
4703726
verified
Lin-K76
commited on
Jul 25
Update README.md
03ac659
verified
Lin-K76
commited on
Jul 24
Update README.md
2b63bb8
verified
Lin-K76
commited on
Jul 24
Update README.md
894589f
verified
Lin-K76
commited on
Jul 24
Update README.md
aace9b8
verified
Lin-K76
commited on
Jul 24
Update README.md
6c0fcdd
verified
Lin-K76
commited on
Jul 24
Update README.md
e32ba06
verified
Lin-K76
commited on
Jul 24
Update README.md
f18b9c8
verified
Lin-K76
commited on
Jul 24
Create README.md
0b0dbe1
verified
Lin-K76
commited on
Jul 24
Upload folder using huggingface_hub
90da764
verified
Lin-K76
commited on
Jul 24
initial commit
656ec87
verified
Lin-K76
commited on
Jul 23
mgoin
commited on
