Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
DeepInfra
/
Llama-2-70b-chat-hf-trt-fp8
like
0
Follow
Deep Infra Inc.
6
License:
llama2
Model card
Files
Files and versions
Community
03200fe
Llama-2-70b-chat-hf-trt-fp8
/
tensorrt_llm
/
1
2 contributors
History:
3 commits
yessenzhar
add trtllm weights
0e96839
about 1 year ago
config.json
Safe
1.31 kB
add smaller files
about 1 year ago
llama_float16_tp4_rank0.engine
Safe
17.8 GB
LFS
add trtllm weights
about 1 year ago
llama_float16_tp4_rank1.engine
Safe
17.8 GB
LFS
add trtllm weights
about 1 year ago
llama_float16_tp4_rank2.engine
Safe
17.8 GB
LFS
add trtllm weights
about 1 year ago
llama_float16_tp4_rank3.engine
Safe
17.8 GB
LFS
add trtllm weights
about 1 year ago
model.cache
Safe
22.6 MB
LFS
add model cache
about 1 year ago