Upload params.json
Browse files- params.json +1 -0
params.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{ "dim": 6656, "multiple_of": 256, "n_heads": 52, "n_layers": 60, "norm_eps": 1e-6, "vocab_size": -1 }
|