Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
DeepInfra
/
Llama-2-70b-chat-hf-trt-fp8
like
0
Follow
Deep Infra Inc.
5
License:
llama2
Model card
Files
Files and versions
Community
2d64b65
Llama-2-70b-chat-hf-trt-fp8
/
tensorrt_llm
/
1
2 contributors
History:
4 commits
yessenzhar
add weights compiled by 0.6.1 trtllm
2d64b65
about 1 year ago
config.json
1.52 kB
add weights compiled by 0.6.1 trtllm
about 1 year ago
llama_float16_tp4_rank0.engine
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
llama_float16_tp4_rank1.engine
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
llama_float16_tp4_rank2.engine
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
llama_float16_tp4_rank3.engine
17.8 GB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
model.cache
13.8 MB
LFS
add weights compiled by 0.6.1 trtllm
about 1 year ago
