ubergarm

/

Qwen3-Coder-480B-A35B-Instruct-GGUF

like 14

ik llama already supports tool calls! https://github.com/iSevenDays/ik_llama.cpp/tree/function_calling

ik llama already supports tool calls! https://github.com/iSevenDays/ik_llama.cpp/tree/function_calling

thanks for sharing this mate but its just a forked ik_llama . i think the tool feature still under testing didt merged in the main ik_llama.

ik llama already supports tool calls! https://github.com/iSevenDays/ik_llama.cpp/tree/function_calling

thanks for sharing this mate but its just a forked ik_llama . i think the tool feature still under testing didt merged in the main ik_llama.

That git repo has an open PR here that you can track the details: https://github.com/ikawrakow/ik_llama.cpp/pull/628

@xldistance @gopi87

Just got compiled in 10 minutes ago, give it a go looks like it might be good for both Kimi and Qwen3's

https://github.com/ikawrakow/ik_llama.cpp/pull/628

just tested the tool call in the claude code and vs code coninue extention everythink is fine except the while its doing browsing i am seeing some failure not sure why

@gopi87

just tested the tool call in the claude code and vs code coninue extention everythink is fine except the while its doing browsing i am seeing some failure not sure why

i've not tried it personally, check that github PR and maybe ask there?

@gopi87

Might be relevent to your testing: https://github.com/ikawrakow/ik_llama.cpp/pull/661