commit files to HF hub

README.md

@@ -31,33 +31,33 @@ model-index:
     metrics:
     - name: BLEU4 (Question Answering)
       type: bleu4_question_answering
-      value: 0.0
+      value: 9.96
     - name: ROUGE-L (Question Answering)
       type: rouge_l_question_answering
-      value: 0.0
+      value: 27.98
     - name: METEOR (Question Answering)
       type: meteor_question_answering
-      value: 0.0
+      value: 23.8
     - name: BERTScore (Question Answering)
       type: bertscore_question_answering
-      value: 77.03
+      value: 87.4
     - name: MoverScore (Question Answering)
       type: moverscore_question_answering
-      value: 56.66
+      value: 68.49
     - name: AnswerF1Score (Question Answering)
       type: answer_f1_score__question_answering
-      value: 0.0
+      value: 43.12
     - name: AnswerExactMatch (Question Answering)
       type: answer_exact_match_question_answering
-      value: 0.0
+      value: 24.06
 ---
 
 # Model Card of `vocabtrimmer/mt5-small-trimmed-fr-90000-frquad-qa`
-This model is fine-tuned version of [vocabtrimmer/mt5-small-trimmed-fr-90000](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-90000) for question answering task on the [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
+This model is fine-tuned version of [ckpts/mt5-small-trimmed-fr-90000](https://huggingface.co/ckpts/mt5-small-trimmed-fr-90000) for question answering task on the [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
 
 
 ### Overview
-- **Language model:** [vocabtrimmer/mt5-small-trimmed-fr-90000](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-90000)   
+- **Language model:** [ckpts/mt5-small-trimmed-fr-90000](https://huggingface.co/ckpts/mt5-small-trimmed-fr-90000)   
 - **Language:** fr  
 - **Training data:** [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) (default)
 - **Online Demo:** [https://autoqg.net/](https://autoqg.net/)
@@ -93,16 +93,16 @@ output = pipe("question: En quelle année a-t-on trouvé trace d'un haut fournea
 
 |                  |   Score | Type    | Dataset                                                          |
 |:-----------------|--------:|:--------|:-----------------------------------------------------------------|
-| AnswerExactMatch |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| AnswerF1Score    |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| BERTScore        |   77.03 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| Bleu_1           |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| Bleu_2           |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| Bleu_3           |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| Bleu_4           |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| METEOR           |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| MoverScore       |   56.66 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
-| ROUGE_L          |    0    | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| AnswerExactMatch |   24.06 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| AnswerF1Score    |   43.12 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| BERTScore        |   87.4  | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| Bleu_1           |   17.28 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| Bleu_2           |   14.01 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| Bleu_3           |   11.74 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| Bleu_4           |    9.96 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| METEOR           |   23.8  | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| MoverScore       |   68.49 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
+| ROUGE_L          |   27.98 | default | [lmqg/qg_frquad](https://huggingface.co/datasets/lmqg/qg_frquad) |
 
 
 
@@ -114,15 +114,15 @@ The following hyperparameters were used during fine-tuning:
  - input_types: ['paragraph_question']
  - output_types: ['answer']
  - prefix_types: None
- - model: vocabtrimmer/mt5-small-trimmed-fr-90000
+ - model: ckpts/mt5-small-trimmed-fr-90000
  - max_length: 512
  - max_length_output: 32
- - epoch: 5
+ - epoch: 13
  - batch: 32
- - lr: 0.0001
+ - lr: 0.001
  - fp16: False
  - random_seed: 1
- - gradient_accumulation_steps: 4
+ - gradient_accumulation_steps: 2
  - label_smoothing: 0.15
 
 The full configuration can be found at [fine-tuning config file](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-90000-frquad-qa/raw/main/trainer_config.json).

eval/metric.first.answer.paragraph_question.answer.lmqg_qg_frquad.default.json

@@ -1 +1 @@
-{"validation": {"Bleu_1": 1.148764872165851e-20, "Bleu_2": 2.051116381898933e-14, "Bleu_3": 2.4883417255587024e-12, "Bleu_4": 2.7407528945568e-11, "METEOR": 0.0, "ROUGE_L": 0.0, "BERTScore": 0.7678841189615699, "MoverScore": 0.5553836859189898, "AnswerF1Score": 0.0, "AnswerExactMatch": 0.0}, "test": {"Bleu_1": 2.232847769559236e-20, "Bleu_2": 3.985492540479623e-14, "Bleu_3": 4.8345526682602444e-12, "Bleu_4": 5.324679149106555e-11, "METEOR": 2.1914039137865177e-05, "ROUGE_L": 0.0, "BERTScore": 0.7703234967279016, "MoverScore": 0.5665574813142406, "AnswerF1Score": 0.0, "AnswerExactMatch": 0.0}}
+{"validation": {"Bleu_1": 0.1932725401837919, "Bleu_2": 0.16007914602896, "Bleu_3": 0.13578319438973033, "Bleu_4": 0.116296643168242, "METEOR": 0.2336239495477666, "ROUGE_L": 0.2869036816616231, "BERTScore": 0.8729169056511284, "MoverScore": 0.6741014345784797, "AnswerF1Score": 42.11315829622192, "AnswerExactMatch": 19.69887076537014}, "test": {"Bleu_1": 0.17281853864733646, "Bleu_2": 0.14009403051623157, "Bleu_3": 0.11740903841504663, "Bleu_4": 0.09957940417233394, "METEOR": 0.23798691012437684, "ROUGE_L": 0.27980331642769446, "BERTScore": 0.8740178610442424, "MoverScore": 0.6849181722997052, "AnswerF1Score": 43.11839268944033, "AnswerExactMatch": 24.058971141781683}}