BramVanroy
/

falcon-40b-ft-alpaca-dolly-dutch

Text Generation

text-generation-inference

Model card Files Files and versions Community

BramVanroy commited on Nov 8, 2023

Commit

b50ea88

•

1 Parent(s): fe535cd

Fix parameter names

Files changed (1) hide show

config.json +4 -3

config.json CHANGED Viewed

@@ -22,9 +22,10 @@
   "initializer_range": 0.02,
   "layer_norm_epsilon": 1e-05,
   "model_type": "falcon",
-  "n_head": 128,
-  "n_head_kv": 8,
-  "n_layer": 60,
   "parallel_attn": true,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.1",

   "initializer_range": 0.02,
   "layer_norm_epsilon": 1e-05,
   "model_type": "falcon",
+  "new_decoder_architecture": true,
+  "num_attention_heads": 128,
+  "num_hidden_layers": 60,
+  "num_kv_heads": 8,
   "parallel_attn": true,
   "torch_dtype": "bfloat16",
   "transformers_version": "4.30.1",