TheBloke
/

CodeLlama-34B-Instruct-fp16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

TheBloke commited on Aug 25, 2023

Commit

a4d0ce9

•

1 Parent(s): 4eef1e2

Add pad_token_id to config.json

Files changed (1) hide show

config.json +2 -1

config.json CHANGED Viewed

@@ -27,5 +27,6 @@
         "AutoModelForCausalLM": "modeling_llama.LlamaForCausalLM",
         "AutoModelForSequenceClassification": "modeling_llama.LlamaForSequenceClassification"
     },
-    "rope_theta": 1000000
 }

         "AutoModelForCausalLM": "modeling_llama.LlamaForCausalLM",
         "AutoModelForSequenceClassification": "modeling_llama.LlamaForSequenceClassification"
     },
+    "rope_theta": 1000000,
+    "pad_token_id": 0
 }