Update README.md
Browse files
README.md
CHANGED
@@ -148,7 +148,7 @@ The control-vectors in this repo were created as an experiment by increasing the
|
|
148 |
|
149 |
</details>
|
150 |
|
151 |
-
This means each models' cross-covariance matrix will be the result of `120,000` hidden state samples and this in turn will mean each uses ~10x the hidden state dimension for the largest models
|
152 |
|
153 |
## Regularisation
|
154 |
|
|
|
148 |
|
149 |
</details>
|
150 |
|
151 |
+
This means each models' cross-covariance matrix will be the result of `120,000` hidden state samples and this in turn will mean each uses ~10x the hidden state dimension for the largest models with `hidden_dim = 12288`.
|
152 |
|
153 |
## Regularisation
|
154 |
|