Songlin Yang

sonta7's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a paper 14 days ago

Gated Delta Networks: Improving Mamba2 with Delta Rule

Paper • 2412.06464 • Published 15 days ago • 9

liked a dataset about 1 month ago

codeparrot/codeparrot-clean-valid

Viewer • Updated Oct 10, 2022 • 61.4k • 1.85k • 11

liked 2 datasets 2 months ago

HuggingFaceFW/fineweb-edu

Viewer • Updated 4 days ago • 3B • 339k • 570

HuggingFaceFW/fineweb-edu-score-2

Viewer • Updated Jun 2 • 11.8B • 25.9k • 65

upvoted an article 2 months ago

view article

Article

History of State Space Models (SSM) in 2022

By •

Apr 11

• 15

updated a model 3 months ago

fla-hub/mamba-2.7B-100B

Text Generation • Updated Oct 1 • 14 • 2

upvoted a paper 3 months ago

A Controlled Study on Long Context Extension and Generalization in LLMs

Paper • 2409.12181 • Published Sep 18 • 43

authored 3 papers 3 months ago

A Controlled Study on Long Context Extension and Generalization in LLMs

Paper • 2409.12181 • Published Sep 18 • 43

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10 • 3

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11 • 19

upvoted a paper 3 months ago

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11 • 19

commented a paper 3 months ago

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11 • 19 •

2

updated a collection 3 months ago

GSA

Collection

3 items • Updated Nov 10 • 2

upvoted a paper 7 months ago

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10 • 3

upvoted a collection 8 months ago

based

Collection

These language model checkpoints are trained at the 360M and 1.3Bn parameter scales for up to 50Bn tokens on the Pile corpus, for research purposes. • 15 items • Updated Oct 18 • 9

authored a paper 8 months ago

HGRN2: Gated Linear RNNs with State Expansion

Paper • 2404.07904 • Published Apr 11 • 17

liked a dataset 8 months ago

HuggingFaceTB/cosmopedia

Viewer • Updated Aug 12 • 31.1M • 19.8k • 570