zheheng luo's picture

1 2 1

zheheng luo

KenLuo

·

https://zhehengluok.github.io/

zhehengluoK

AI & ML interests

text summarisation

Recent Activity

upvoted a paper 17 days ago

Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models

authored a paper 17 days ago

Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models

updated a dataset 6 months ago

KenLuo/EMPEC

View all activity

Organizations

KenLuo's activity

upvoted a paper 17 days ago

Sigma: Differential Rescaling of Query, Key and Value for Efficient Language Models

Paper • 2501.13629 • Published 18 days ago • 43

upvoted a paper 10 months ago

Rho-1: Not All Tokens Are What You Need

Paper • 2404.07965 • Published Apr 11, 2024 • 90