DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8 / tensorrt_llm /1

Commit History

update models for newer trt 0.6.1 version

dd20dba

yessenzhar commited on Dec 18, 2023

add weights compiled by 0.6.1 trtllm

2d64b65

yessenzhar commited on Dec 15, 2023

add trtllm weights

0e96839

yessenzhar commited on Dec 7, 2023

add model cache

2354c48

yessenzhar commited on Dec 7, 2023

add smaller files

a83b588

yessenzhar commited on Dec 7, 2023