Eli Chen

elichen3051's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted an article 4 days ago

view article

Article

Efficient LLM Pretraining: Packed Sequences and Masked Attention

By •

Oct 7

• 7

updated a dataset 6 days ago

skymizer/axolotl-tiny-set

Viewer • Updated 6 days ago • 3.23k • 11

updated a dataset 7 days ago

skymizer/fineweb-edu-dedup-5B

Viewer • Updated 7 days ago • 4.83M • 35

updated a model 7 days ago

skymizer/llama3.2-1B-cpt-5B-pretokenized-flash-attn-re

Text Generation • Updated 7 days ago • 8

updated a dataset 8 days ago

skymizer/fineweb-edu-dedup-45B

Viewer • Updated 8 days ago • 43.4M • 116 • 1

liked a dataset 8 days ago

argilla/ultrafeedback-binarized-preferences-cleaned

Viewer • Updated Dec 11, 2023 • 60.9k • 8.54k • 125

updated a dataset 8 days ago

skymizer/pretraining-10K-examples

Viewer • Updated 8 days ago • 10k • 24

updated 3 datasets 9 days ago

skymizer/packed_pretraining_5B_llama3.2_seq_len_2048

Viewer • Updated 9 days ago • 2.25M • 70

skymizer/pretraining-50B-llama3.2-tokenized-padded-packed-2048

Viewer • Updated 9 days ago • 22.5M • 19

skymizer/pretraining-50B-llama3.2-tokenized-padded-packed-2048

Viewer • Updated 9 days ago • 22.5M • 19

liked a dataset 9 days ago

emozilla/yarn-train-tokenized-8k-llama

Viewer • Updated Nov 16, 2023 • 213k • 171 • 1

updated 2 datasets 9 days ago

skymizer/pretraining-5B-tokenized-padded-packed-2048

Viewer • Updated 9 days ago • 2.25M • 28

skymizer/pretraining-5B-tokenized-padded-packed-2048

Viewer • Updated 9 days ago • 2.25M • 28

updated 3 datasets 10 days ago

skymizer/pretraining-tiny-tokenized-padded

Viewer • Updated 10 days ago • 11.1k • 25

skymizer/pretraining-5B-tokenized-padded

Viewer • Updated 10 days ago • 5.73M • 38

skymizer/pretraining-50B-tokenized-padded

Viewer • Updated 10 days ago • 57.3M • 13