Songlin Yang

sonta7's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a paper 14 days ago

Gated Delta Networks: Improving Mamba2 with Delta Rule

Paper • 2412.06464 • Published 15 days ago • 9

upvoted an article 2 months ago

view article

Article

History of State Space Models (SSM) in 2022

By •

Apr 11

• 15

upvoted 2 papers 3 months ago

A Controlled Study on Long Context Extension and Generalization in LLMs

Paper • 2409.12181 • Published Sep 18 • 43

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11 • 19

upvoted a paper 7 months ago

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10 • 3

upvoted a collection 8 months ago

based

Collection

These language model checkpoints are trained at the 360M and 1.3Bn parameter scales for up to 50Bn tokens on the Pile corpus, for research purposes. • 15 items • Updated Oct 18 • 9