Update README.md
Browse files
README.md
CHANGED
|
@@ -15,4 +15,9 @@ license: llama3.2
|
|
| 15 |
|
| 16 |
## Model Information
|
| 17 |
|
| 18 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## Model Information
|
| 17 |
|
| 18 |
+
This uses the Llama 3.2 1B model as a starting point and uses the project1-v1 dataset.
|
| 19 |
+
|
| 20 |
+
|
| 21 |
+
#### Our latest model uses a combination of SFT and DPO to achieve superior results than our initial experiments!
|
| 22 |
+
|
| 23 |
+
#### Please let us know what you think by opening a discussion in the Community tab!
|