DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads
Paper
•
2410.10819
•
Published
•
6
Guangxuan Xiao
Guangxuan-Xiao
AI & ML interests
Efficient Machine Learning
Recent Activity
authored
a paper
about 1 month ago
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and
Streaming Heads
upvoted
a
paper
about 1 month ago
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and
Streaming Heads
commented
a paper
about 1 month ago
DuoAttention: Efficient Long-Context LLM Inference with Retrieval and
Streaming Heads
Organizations
