DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8 / tensorrt_llm /1 /llama_float16_tp4_rank3.engine

Commit History

add weights compiled by 0.6.1 trtllm

2d64b65

yessenzhar commited on Dec 15, 2023

add trtllm weights

0e96839

yessenzhar commited on Dec 7, 2023