See our Github repo for more details: https://github.com/hao-ai-lab/Consistency_LLM | |
Metadata: | |
AR loss to consistency loss ratio: 10: 1 | |
GSM8K dataset size: 7k | |
n-token sequence length: 16 | |
Jacobi trajectory data cleaning: True | |
Target model: ABEL-7B-001 fine-tuned on GSM8K | |
release date: 02/26/2024 |