Update README.md
Browse files
README.md
CHANGED
@@ -4,7 +4,7 @@ license: llama2
|
|
4 |
|
5 |
# TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios
|
6 |
|
7 |
-
We present **
|
8 |
|
9 |
TLLM generates either a code solution or a direct text answer to handle tabular data manipulation tasks based on different scenarios. Code generation is used for handling spreadsheet-embedded tabular data, which often involves the insert, delete, update, query, merge, and plot operations of tables. Text generation is used for handling document-embedded tabular data, which often involves the query operation of short tables.
|
10 |
|
@@ -24,8 +24,8 @@ We evaluate the code solution generation ability of TLLM on three benchmarks: Wi
|
|
24 |
| StructGPT (GPT3.5) | 52.5 | 27.5 | 11.8 | 14.0 | 67.8 |**84.8**| / | 48.9 |
|
25 |
| Binder (GPT3.5) | 61.6 | 12.8 | 6.8 | 5.1 | 78.6 | 52.6 | / | 42.5 |
|
26 |
| DATER (GPT3.5) | 53.4 | 28.4 | 18.3 | 13.0 | 58.2 | 26.5 | / | 37.0 |
|
27 |
-
|
|
28 |
-
|
|
29 |
|
30 |
## Prompt Template
|
31 |
The prompts we used for generating code solutions and text answers are introduced below.
|
|
|
4 |
|
5 |
# TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios
|
6 |
|
7 |
+
We present **TableLLM**, a powerful large language model designed to handle tabular data manipulation tasks efficiently, whether they are embedded in spreadsheets or documents, meeting the demands of real office scenarios. The TLLM series encompasses two distinct scales: [TableLLM-7B](https://huggingface.co/KAKA22/TableLLM-7b) and [TableLLM-13B](https://huggingface.co/KAKA22/TableLLM-13b), which are fine-tuned based on CodeLlama-7B and 13B.
|
8 |
|
9 |
TLLM generates either a code solution or a direct text answer to handle tabular data manipulation tasks based on different scenarios. Code generation is used for handling spreadsheet-embedded tabular data, which often involves the insert, delete, update, query, merge, and plot operations of tables. Text generation is used for handling document-embedded tabular data, which often involves the query operation of short tables.
|
10 |
|
|
|
24 |
| StructGPT (GPT3.5) | 52.5 | 27.5 | 11.8 | 14.0 | 67.8 |**84.8**| / | 48.9 |
|
25 |
| Binder (GPT3.5) | 61.6 | 12.8 | 6.8 | 5.1 | 78.6 | 52.6 | / | 42.5 |
|
26 |
| DATER (GPT3.5) | 53.4 | 28.4 | 18.3 | 13.0 | 58.2 | 26.5 | / | 37.0 |
|
27 |
+
| TableLLM-7B (Ours) | 58.8 | 66.9 | 72.6 |<ins>63.1</ins>|<ins>86.6</ins>| 82.6 |<ins>78.8</ins>| 72.8 |
|
28 |
+
| TableLLM-13B (Ours) |<ins>62.4</ins>| 68.2 |<ins>74.5</ins>| 62.5 | **90.7**|<ins>83.4</ins>| **80.8** |<ins>74.7</ins>|
|
29 |
|
30 |
## Prompt Template
|
31 |
The prompts we used for generating code solutions and text answers are introduced below.
|