23 19 1

Yi Cui

onekq

https://onekq.ai

AI & ML interests

Benchmark, Code Generation Model

Recent Activity

commented on their article about 6 hours ago

🌳 QAT: The Art of Growing a Bonsai Model

posted an update 1 day ago

Instead of architectural upgade, each major model drop nowadays perfects a regional innovation. What Kimi brought to spot light this time is quantization aware training (QAT). I wrote an article to explain it and why it matters to reasoning models. https://huggingface.co/blog/onekq/qat-bonsai If you are interested in this kind of posts, I will introduce the Muon optimizers, another technology behind Kimi success.

published an article 2 days ago

🌳 QAT: The Art of Growing a Bonsai Model

View all activity

Organizations

Posts 89

Post

918

Instead of architectural upgade, each major model drop nowadays perfects a regional innovation. What Kimi brought to spot light this time is quantization aware training (QAT). I wrote an article to explain it and why it matters to reasoning models.

https://huggingface.co/blog/onekq/qat-bonsai

If you are interested in this kind of posts, I will introduce the Muon optimizers, another technology behind Kimi success.

View all Posts

Articles 4

Article

🌳 QAT: The Art of Growing a Bonsai Model

View all Articles

Papers 4

models 0

None public yet

datasets 0

None public yet