Why Can't Transformers Learn Multiplication? Reverse-Engineering Reveals Long-Range Dependency Pitfalls
Paper
•
2510.00184
•
Published
•
16
Xiaoyan Bai
smallyan
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 2 months ago
Why Can't Transformers Learn Multiplication? Reverse-Engineering Reveals
Long-Range Dependency Pitfalls
upvoted
a
paper
3 months ago
Concept Incongruence: An Exploration of Time and Death in Role Playing
Organizations
None yet
upvoted
a
paper
about 2 months ago