Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Metadata:
|
| 2 |
+
AR loss to consistency loss ratio: 10: 1
|
| 3 |
+
shareGPT dataset size: 48k
|
| 4 |
+
n-token sequence length:32
|
| 5 |
+
Jacobi trajectory data cleaning: True
|
| 6 |
+
Target model: LLaMA2-7B fine-tuned on ShareGPT48k
|
| 7 |
+
|
| 8 |
+
release date: 02/26/2024
|