Commit
•
3fce7f1
1
Parent(s):
96e93dd
Update README.md
Browse files
README.md
CHANGED
|
@@ -41,6 +41,9 @@ can be [found here](https://huggingface.co/AmelieSchreiber/esm2_t6_8m_qlora_bind
|
|
| 41 |
|
| 42 |
## Testing for Overfitting
|
| 43 |
|
|
|
|
|
|
|
|
|
|
| 44 |
### Epoch 1:
|
| 45 |
```python
|
| 46 |
Train metrics:
|
|
|
|
| 41 |
|
| 42 |
## Testing for Overfitting
|
| 43 |
|
| 44 |
+
Notably, it appears adding in the adapters for the additional weight matrices serves as a more robust regularization technique, and
|
| 45 |
+
that these models appear to generalize better.
|
| 46 |
+
|
| 47 |
### Epoch 1:
|
| 48 |
```python
|
| 49 |
Train metrics:
|