canbingol/exp1_flash_attn_1epoch_lr1e4_500k_vngr_corpus
Text Generation
•
Updated
•
25
Pretrain experiments
This collection created for storing my pretrain expriments
-
-
canbingol/exp2_sdpa_1epoch_lr1e4_500k_vngr_corpus
Updated • 20 -
canbingol/exp3_eager_1epoch_lr1e4_500k_vngr_corpus
Updated • 24 -
canbingol/exp4_flash_attn_1epoch_lr1e4_200k_vngr_corpus
Updated • 19 -
canbingol/exp5_sdpa_1epoch_lr1e4_200k_vngr_corpus
Updated • 23 -
canbingol/exp6_flash_attn_1epoch_lr1e4_500k_vngr_corpus_10layers
Updated • 10 -
canbingol/exp7_sdpa_1epoch_lr1e4_500k_vngr_corpus_2-epoch-kaggle
Updated • 6 -
canbingol/exp8_sdpa_1epoch_lr1e4_500k_vngr_corpus_1-epoch_kaggle
Updated • 29