Update README.md
Browse files
README.md
CHANGED
|
@@ -110,6 +110,8 @@ We have collected a total of 3.6M conversations, approximately 4.51 billion toke
|
|
| 110 |
|
| 111 |
### Dataset Construction
|
| 112 |
|
|
|
|
|
|
|
| 113 |
#### Base Dataset: Knowledge Injection with Retrieval Augmentation
|
| 114 |
|
| 115 |
We developed a knowledge search system using open Chinese knowledge corpora, integrated with [QDrant](https://qdrant.tech/). To construct Supervised Fine-Tuning(SFT) pairs, we followed this process:
|
|
|
|
| 110 |
|
| 111 |
### Dataset Construction
|
| 112 |
|
| 113 |
+
The data construction for Kyara is divided into two parts: English and Chinese. For the English part, we have incorporated multiple high-quality open-source datasets, such as `teknium/OpenHermes-2.5` and `arcee-ai/The-Tome`, and performing semantic deduplication to drop out near-similar examples. As for the Chinese part, the construction follows the process outlined below:
|
| 114 |
+
|
| 115 |
#### Base Dataset: Knowledge Injection with Retrieval Augmentation
|
| 116 |
|
| 117 |
We developed a knowledge search system using open Chinese knowledge corpora, integrated with [QDrant](https://qdrant.tech/). To construct Supervised Fine-Tuning(SFT) pairs, we followed this process:
|