Update README.md

README.md

@@ -93,20 +93,31 @@ To make sure this classifier makes sense, it is applied to various datasets.
 
 Educational Value = 2 point * P(High) + 1 point * P(Mid) + 0 point * P(Low)
 
-|Dataset | Sampling | Average Educational Value |
-|--------------------------------------|---|-------------------|
-|[SciPhi/textbooks-are-all-you-need-lite](https://huggingface.co/datasets/SciPhi/textbooks-are-all-you-need-lite) |First 10,000 | 1.846 |
-|[nampdn-ai/tiny-orca-textbooks](https://huggingface.co/datasets/nampdn-ai/tiny-orca-textbooks) |First 10,000 | 1.668 |
-|[vikp/textbook_quality_programming](https://huggingface.co/datasets/vikp/textbook_quality_programming) |First 10,000| 1.664|
-|[nampdn-ai/tiny-textbooks](https://huggingface.co/datasets/nampdn-ai/tiny-textbooks) |First 10,000 | 1.581 |
-|[armanc/scientific_papers pubmed](https://huggingface.co/datasets/armanc/scientific_papers) |First 10,000 | 1.256|
-|[wikipedia en 20220301](https://huggingface.co/datasets/wikipedia) |First 10,000 | 1.237|
-|[armanc/scientific_papers arxiv](https://huggingface.co/datasets/armanc/scientific_papers) |First 10,000 | 1.069 |
-|[HuggingFaceFW/fineweb](https://huggingface.co/datasets/HuggingFaceFW/fineweb)| First 10,000 | 1.058|
-|[BEE-spoke-data/fineweb-100k_en-med](https://huggingface.co/datasets/BEE-spoke-data/fineweb-100k_en-med)| First 10,000 | 1.017|
-|[JeanKaddour/minipile](https://huggingface.co/datasets/JeanKaddour/minipile)| First 10,000 | 0.994|
-|[mattymchen/refinedweb-3m](https://huggingface.co/datasets/mattymchen/refinedweb-3m)| First 10,000 | 0.853|
 
+|Dataset | Sampling | Average Educational Value | Type |
+|--------------------------------------|---|-------------------|-------|
+|[SciPhi/textbooks-are-all-you-need-lite](https://huggingface.co/datasets/SciPhi/textbooks-are-all-you-need-lite) |First 10,000 | 1.846 |Synthetic|
+|[nampdn-ai/tiny-orca-textbooks](https://huggingface.co/datasets/nampdn-ai/tiny-orca-textbooks) |First 10,000 | 1.668 |Synthetic|
+|[HuggingFaceTB/cosmopedia stanford](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.673 |Synthetic|
+|[vikp/textbook_quality_programming](https://huggingface.co/datasets/vikp/textbook_quality_programming) |First 10,000| 1.664|Synthetic|
+|[HuggingFaceTB/cosmopedia web_samples_v1](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.615 |Synthetic|
+|[nampdn-ai/tiny-textbooks](https://huggingface.co/datasets/nampdn-ai/tiny-textbooks) |First 10,000 | 1.581 |Synthetic|Synthetic|
+|[HuggingFaceTB/cosmopedia web_samples_v2](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.559 |Synthetic|
+|[HuggingFaceTB/cosmopedia openstax](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.468 |Synthetic|
+|[HuggingFaceTB/cosmopedia wikihow](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.420 |Synthetic|
+|[HuggingFaceTB/cosmopedia khanacademy](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.378 |Synthetic|
+|[HuggingFaceTB/cosmopedia auto_math_text](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.350 |Synthetic|
+|[NousResearch/dolma-v1_7-305B*](https://huggingface.co/datasets/NousResearch/dolma-v1_7-305B) |First 10,000 | 1.290|Real|
+|[armanc/scientific_papers pubmed](https://huggingface.co/datasets/armanc/scientific_papers) |First 10,000 | 1.256|Real|
+|[wikipedia en 20220301](https://huggingface.co/datasets/wikipedia) |First 10,000 | 1.237|Real|
+|[HuggingFaceTB/cosmopedia stories](https://huggingface.co/datasets/HuggingFaceTB/cosmopedia) |First 10,000 | 1.156 |Synthetic|
+|[armanc/scientific_papers arxiv](https://huggingface.co/datasets/armanc/scientific_papers) |First 10,000 | 1.069 |Real|
+|[HuggingFaceFW/fineweb](https://huggingface.co/datasets/HuggingFaceFW/fineweb)| First 10,000 | 1.058|Real|
+|[BEE-spoke-data/fineweb-100k_en-med](https://huggingface.co/datasets/BEE-spoke-data/fineweb-100k_en-med)| First 10,000 | 1.017|Real|
+|[JeanKaddour/minipile](https://huggingface.co/datasets/JeanKaddour/minipile)| First 10,000 | 0.994|Real|
+|[mattymchen/refinedweb-3m](https://huggingface.co/datasets/mattymchen/refinedweb-3m)| First 10,000 | 0.853|Real|
+
+* I encounted an [issue](https://huggingface.co/datasets/allenai/dolma/discussions/26) so that I cannot process the original [allenai/dolma](https://huggingface.co/datasets/allenai/dolma).
 
 ![image/png](https://cdn-uploads.huggingface.co/production/uploads/60e50ce5350d181892d5a636/fCWpxWB1yLmJwWhPXsjIw.png)
 
@@ -114,3 +125,6 @@ The classifier aligns with the expectation. Textbook category scores the highest
 Wikipedia scores comparatively lower because it is not textbook after all and it also contains information (result of a match) that has small educational value.  
 Web scores the lowest.  
 
+In general, the synthetic data has higher education value because they are created with a high educational value by design.
+For real data, [Dolma v1_7](https://huggingface.co/datasets/allenai/dolma), which applied extensive quality filter described in [here](https://blog.allenai.org/olmo-1-7-7b-a-24-point-improvement-on-mmlu-92b43f7d269d), has the highest educational value across all real data.
+