Spaces:
Running
on
Zero
Running
on
Zero
Martín Santillán Cooper
commited on
Commit
•
12a20e3
1
Parent(s):
e5f0735
Revert "Update answer relevance test case"
Browse filesThis reverts commit 2b52fecea14a45e71d6209c778e8283d7a1ec5af.
- catalog.json +2 -2
catalog.json
CHANGED
@@ -98,9 +98,9 @@
|
|
98 |
{
|
99 |
"name": "answer_relevance",
|
100 |
"criteria": "'Assistant' message fails to address or properly respond to the User's input. This includes providing off-topic information, misinterpreting the query, or omitting crucial details requested by the User. An irrelevant answer may contain factually correct information but still fail to meet the User's specific needs or answer their intended question.",
|
101 |
-
"user_message": "
|
102 |
"assistant_message": "Tracing the genealogy of African Americans can be a very difficult process.",
|
103 |
-
"context": "
|
104 |
}
|
105 |
]
|
106 |
}
|
|
|
98 |
{
|
99 |
"name": "answer_relevance",
|
100 |
"criteria": "'Assistant' message fails to address or properly respond to the User's input. This includes providing off-topic information, misinterpreting the query, or omitting crucial details requested by the User. An irrelevant answer may contain factually correct information but still fail to meet the User's specific needs or answer their intended question.",
|
101 |
+
"user_message": "Who were not identified by name on the census before the civil war?",
|
102 |
"assistant_message": "Tracing the genealogy of African Americans can be a very difficult process.",
|
103 |
+
"context": "Sometimes people of mixed African-American and Native American descent report having had elder family members withholding pertinent genealogical information. Tracing the genealogy of African Americans can be a very difficult process, as censuses did not identify slaves by name before the American Civil War, meaning that most African Americans did not appear by name in those records. In addition, many white fathers who used slave women sexually, even those in long-term relationships like Thomas Jefferson's with Sally Hemings, did not acknowledge their mixed-race slave children in records, so paternity was lost."
|
104 |
}
|
105 |
]
|
106 |
}
|