DeepInfra
/

Llama-2-70b-chat-hf-trt-fp8

Pernekhan commited on Dec 13, 2023

Commit

6005d8a

1 Parent(s): 891ad10

Try fixing exclude_input_in_output value field

Refer to comment: https://github.com/triton-inference-server/tensorrtllm_backend/issues/145#issuecomment-1823888942
They use "True" instead of "true"

Files changed (1) hide show

tensorrt_llm/config.pbtxt CHANGED Viewed

@@ -197,7 +197,7 @@ parameters: {
 parameters: {
   key: "exclude_input_in_output"
   value: {
-    string_value: "true"
   }
 }
 parameters: {

 parameters: {
   key: "exclude_input_in_output"
   value: {
+    string_value: "True"
   }
 }
 parameters: {