Wikipedia - Distill Knowledge - a Self-GRIT Collection

Self-GRIT 's Collections

Wikipedia - Distill Knowledge

WikiText Perplexity Evals

Intermediate Datasets Pretraining

EvaluationDatasets

Wikipedia - Distill Knowledge

updated Aug 1

Datasets for distilling Knowledge on Wikipedia Domain

Self-GRIT/Pile_Wikipedia_chunks

Viewer • Updated Jul 30 • 7k • 38
Self-GRIT/Pile_Wikipedia_chunks_estimator-PI_KFI_claude-claude-3-5-sonnet-20240620

Viewer • Updated Jul 30 • 100 • 42
Self-GRIT/Pile_Wikipedia_chunks_estimator-PI_KFI_claude-claude-3-5-sonnet-20240620-FK_claude

Viewer • Updated Aug 1 • 100 • 36
Self-GRIT/Pile_Wikipedia_chunks_2k-PI_KFI_claude-claude-3-5-sonnet-20240620

Viewer • Updated Aug 1 • 2.5k • 44
Self-GRIT/Pile_Wikipedia_chunks_2k-PI_KFI_claude-claude-3-5-sonnet-20240620-FK_claude

Viewer • Updated Aug 1 • 2.5k • 35
Self-GRIT/Pile_Wikipedia_chunks_estimator-PI_KFI_claude-claude-3-5-sonnet-20240620-SFT-distill

Viewer • Updated Jul 31 • 100 • 35
Self-GRIT/Pile_Wikipedia_chunks_2k-PI_KFI_claude-claude-3-5-sonnet-20240620-SFT-distill-retrieval-tokens

Viewer • Updated Jul 31 • 2.5k • 43
Self-GRIT/Pile_Wikipedia_chunks_2k-PI_KFI_claude-FK_claude-SFT-dist-syn-knowledge

Viewer • Updated Aug 7 • 2.5k • 35