File size: 310 Bytes
a5392be
 
c49e44e
d251f0e
c49e44e
d251f0e
c49e44e
d251f0e
33c70a4
d251f0e
c49e44e
d251f0e
c49e44e
 
d251f0e
c49e44e
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
See our Github repo for more details: https://github.com/hao-ai-lab/Consistency_LLM

Metadata:

AR loss to consistency loss ratio: 10: 1

shareGPT dataset size: 48k

n-token sequence length: 32

Jacobi trajectory data cleaning: True

Target model: LLaMA2-7B fine-tuned on ShareGPT48k


release date: 02/26/2024