Sparse Query Attention (SQA): A Computationally Efficient Attention Mechanism with Query Heads Reduction
Paper
•
2510.01817
•
Published
•
15
Maciej Pastuszak
MacPas
AI & ML interests
None yet
Recent Activity
new activity
2 days ago
BAAI/bge-m3:Adding `safetensors` variant of this model
upvoted
a
paper
about 1 month ago
Sparse Query Attention (SQA): A Computationally Efficient Attention
Mechanism with Query Heads Reduction
Organizations
None yet
Adding `safetensors` variant of this model
1
#130 opened 3 months ago
by
SFconvertbot
upvoted
a
paper
about 1 month ago