- We apply DPO to
opencsg/csg-wukong-2b-smoltalk-chinese, usingultrafeedback-chinese-binarized-lowestas the DPO dataset. - Train 2 epochs, learning rate=5e-6, batchsize=128
- This model's evaluation score is higher than that one trained on
ultrafeedback-chinese-binarized
- Downloads last month
- 11
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.
Model tree for opencsg/csg-wukong-2b-ultrafeedback-chinese-binarized-lowest
Base model
opencsg/csg-wukong-2b-chinese-fineweb-edu
Finetuned
opencsg/csg-wukong-2b-smoltalk-chinese