Tabular-LLM-Study-Preference

Runtime error

App Files Files Community

luulinh90s commited on Sep 13, 2024

Commit

16f4777

1 Parent(s): 174b5e1

update

Browse files

Files changed (2) hide show

templates/attribution.html +19 -6
templates/introduction.html +2 -2

templates/attribution.html CHANGED Viewed

@@ -56,6 +56,9 @@
         .highlight {
             background-color: #ffffcc;
         }
         button {
             background-color: #4CAF50;
             color: white;
@@ -107,7 +110,7 @@
                 <td>Cincinnati</td>
                 <td>Win</td>
                 <td>20</td>
-                <td class="highlight">0</td>
                 <td>1 - 1</td>
             </tr>
             <tr class="highlight">
@@ -116,7 +119,7 @@
                 <td>9 Georgia</td>
                 <td>Win</td>
                 <td>26</td>
-                <td class="highlight">0</td>
                 <td>3 - 1 , 20</td>
             </tr>
             <tr class="highlight">
@@ -125,7 +128,7 @@
                 <td>10 Vanderbilt</td>
                 <td>Win</td>
                 <td>14</td>
-                <td class="highlight">0</td>
                 <td>4 - 1 , 14</td>
             </tr>
             <tr class="highlight">
@@ -134,7 +137,7 @@
                 <td>Evansville</td>
                 <td>Win</td>
                 <td>36</td>
-                <td class="highlight">0</td>
                 <td>7 - 2</td>
             </tr>
         </table>
@@ -143,10 +146,20 @@
         </p>
         <ul style="text-align: left;">
             <li>The entire rows for games 2, 4, 5, and 9 are highlighted in yellow.</li>
-            <li>Within these rows, the "Opponents" column cells containing "0" are highlighted with a deeper yellow.</li>
         </ul>
         <p>
-            These highlights indicate that the system identified four games where the opposing team did not score, verifying the statement as true. By highlighting these cells, the system is showing us the exact data points it used in its decision-making process.
         </p>
         <p>
             During the experiment, you will compare different methods that provide these types of explanations. Your task will be to evaluate which explanations are most clear and helpful in understanding the system's reasoning.

         .highlight {
             background-color: #ffffcc;
         }
+        .green-highlight {
+            background-color: #90EE90;
+        }
         button {
             background-color: #4CAF50;
             color: white;
                 <td>Cincinnati</td>
                 <td>Win</td>
                 <td>20</td>
+                <td class="green-highlight">0</td>
                 <td>1 - 1</td>
             </tr>
             <tr class="highlight">
                 <td>9 Georgia</td>
                 <td>Win</td>
                 <td>26</td>
+                <td class="green-highlight">0</td>
                 <td>3 - 1 , 20</td>
             </tr>
             <tr class="highlight">
                 <td>10 Vanderbilt</td>
                 <td>Win</td>
                 <td>14</td>
+                <td class="green-highlight">0</td>
                 <td>4 - 1 , 14</td>
             </tr>
             <tr class="highlight">
                 <td>Evansville</td>
                 <td>Win</td>
                 <td>36</td>
+                <td class="green-highlight">0</td>
                 <td>7 - 2</td>
             </tr>
         </table>
         </p>
         <ul style="text-align: left;">
             <li>The entire rows for games 2, 4, 5, and 9 are highlighted in yellow.</li>
+            <li>Within these rows, the "Opponents" column cells containing "0" are highlighted in green.</li>
+        </ul>
+        <p>
+            These highlights indicate that the system identified four games where the opposing team did not score, verifying the statement as true. The yellow highlighting shows the relevant rows, while the green highlighting represents the cells containing fine-grained information needed to verify the statement.
+        </p>
+        <p>
+            By using different colors for highlighting, the system provides a more nuanced explanation:
+        </p>
+        <ul style="text-align: left;">
+            <li>Yellow highlights (rows): Show the overall context of the relevant games.</li>
+            <li>Green highlights (cells): Pinpoint the exact data points (opposing team's score of 0) that directly answer the question.</li>
         </ul>
         <p>
+            This multi-level highlighting helps users quickly grasp both the broad context and the specific details that support the system's answer.
         </p>
         <p>
             During the experiment, you will compare different methods that provide these types of explanations. Your task will be to evaluate which explanations are most clear and helpful in understanding the system's reasoning.

templates/introduction.html CHANGED Viewed

@@ -65,7 +65,7 @@
         </div>
         <div class="sample-container">
-            <h2>Sample TableQA Problem</h2>
             <iframe srcdoc="
             <html><head>
             <style>
@@ -201,7 +201,7 @@
         <div class="outro">
             <h2>Your Task</h2>
-            <p>Your task is to evaluate different methods that explain how the TableQA system arrives at its answers. Understanding these explanations helps improve trust and transparency in AI systems.</p>
         </div>
         <div class="button-container">

         </div>
         <div class="sample-container">
+            <h2>Verify if the following Statement is TRUE or FALSE</h2>
             <iframe srcdoc="
             <html><head>
             <style>
         <div class="outro">
             <h2>Your Task</h2>
+            <p>Your task in this experiment is to evaluate different methods that explain how the TableQA system arrives at its answers (here TRUE). Understanding these explanations helps improve trust and transparency in AI systems.</p>
         </div>
         <div class="button-container">