Q-Filters: Leveraging QK Geometry for Efficient KV Cache Compression
Paper
•
2503.02812
•
Published
•
9
Mini Reasoning
university
AI & ML interests
None defined yet.
Recent Activity
View all activity
mini-reasoning's activity
yuzhaouoe
authored
a
paper
8 days ago
rohitsaxena
authored
2
papers
15 days ago
aryopg
authored
a
paper
29 days ago
Jforeverss
authored
a
paper
4 months ago
alessiodevoto
authored
4
papers
5 months ago
Adaptive Computation Modules: Granular Conditional Computation For Efficient Inference
Paper
•
2312.10193
•
Published
•
1
A Simple and Effective $L_2$ Norm-Based Strategy for KV Cache Compression
Paper
•
2406.11430
•
Published
•
24
Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
Paper
•
2410.15999
•
Published
•
20
Analysing the Residual Stream of Language Models Under Knowledge Conflicts
Paper
•
2410.16090
•
Published
•
7
aryopg
authored
4
papers
5 months ago
CoMAT: Chain of Mathematically Annotated Thought Improves Mathematical Reasoning
Paper
•
2410.10336
•
Published
•
2
Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
Paper
•
2410.15999
•
Published
•
20
Analysing the Residual Stream of Language Models Under Knowledge Conflicts
Paper
•
2410.16090
•
Published
•
7
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations
Paper
•
2410.18860
•
Published
•
11
rohitsaxena
authored
a
paper
7 months ago
rohitsaxena
authored
a
paper
9 months ago
yuzhaouoe
authored
a
paper
9 months ago
aryopg
authored
a
paper
9 months ago
alessiodevoto
authored
a
paper
9 months ago
GWHed
authored
a
paper
9 months ago
Jforeverss
authored
a
paper
9 months ago