adalaw commited on
Commit
abcad96
1 Parent(s): e8dd628

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - openai/gsm8k
4
+ ---
5
+
6
+ ## Introduction
7
+ The model is trained with Masked thought Fine-Tuning (MFT), a simple variant of standard Supervised Fine-Tuning (SFT). You can refer to our code and paper below.
8
+
9
+ ## Links
10
+ - **Code**: [GitHub Repository](https://github.com/ChangyuChen347/MaskedThought)
11
+ - **Paper**: [Arxiv Paper](https://arxiv.org/abs/2403.02178)
12
+
13
+ ## Results
14
+ We test it with the scripts provided in our code.
15
+ | Model | GSM8K |
16
+ |---------------------------------------------------------------------------------------|-------|
17
+ | [adalaw/Llama2-7B-GSM8K-SFT](https://huggingface.co/adalaw/Llama2-7B-GSM8K-SFT) | 42.8 |
18
+ | [adalaw/Llama2-7B-GSM8K-MFT](https://huggingface.co/adalaw/Llama2-7B-GSM8K-MFT) | 47.3 |