Hugging Face's logo

Spaces:
hallucinations-leaderboard
/
leaderboard
Running on CPU Upgrade

App Files Community
27
pminervini commited on
Commit
4f6280e
•
1 Parent(s): 93f817a

update

Browse files
Files changed (1) hide show
  1. src/backend/tasks/nq_swap/nq_swap.yaml +1 -1
src/backend/tasks/nq_swap/nq_swap.yaml CHANGED
@@ -1,7 +1,7 @@
1
  task: nq_swap
2
  dataset_path: pminervini/NQ-Swap
3
  output_type: generate_until
4
- validation_split: substituted
5
  description: "Answer the following question based on the provided context:\n\n"
6
  doc_to_text: "Context: {{sub_context}}\nQuestion: {{question}}?\nAnswer:"
7
  doc_to_target: "{{sub_answer}}" # TODO: should be multi-target
 
1
  task: nq_swap
2
  dataset_path: pminervini/NQ-Swap
3
  output_type: generate_until
4
+ validation_split: dev
5
  description: "Answer the following question based on the provided context:\n\n"
6
  doc_to_text: "Context: {{sub_context}}\nQuestion: {{question}}?\nAnswer:"
7
  doc_to_target: "{{sub_answer}}" # TODO: should be multi-target