DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Model card Files Files and versions Community

Llama-2-70b-chat-hf-trt-fp8

Commit History

exclude input in ouput

891ad10

yessenzhar commited on Dec 13, 2023

try bugfix

151b0f6

yessenzhar commited on Dec 12, 2023

remove hardcoded weights and tokenizer dirs, replace with template

5de4d5c

yessenzhar commited on Dec 12, 2023

remove print

d5c7a29

yessenzhar commited on Dec 8, 2023

add trtllm weights

0e96839

yessenzhar commited on Dec 7, 2023

add model cache

2354c48

yessenzhar commited on Dec 7, 2023

add smaller files

a83b588

yessenzhar commited on Dec 7, 2023

initial commit

210dc9f

Pernekhan commited on Dec 6, 2023