DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8 / tensorrt_llm /1 /config.json

Commit History

update models for newer trt 0.6.1 version

dd20dba

yessenzhar commited on Dec 18, 2023

add weights compiled by 0.6.1 trtllm

2d64b65

yessenzhar commited on Dec 15, 2023

add smaller files

a83b588

yessenzhar commited on Dec 7, 2023