No ARM support (Nvidia DGX Spark) for your custom vLLM build
#10
by
ruben-bibsyst - opened
Your custom build of vLLM does not support ARM, which hinders our company from running Devstral 2 Small on our DGX Spark. Will we just have to wait until NVIDIA releases a new version of their own custom build of vLLM, or will you add an ARM build to your own custom vLLM build?
I am a bit confused, since you specifically mentioned in your announcement that Devstral 2 Small was ready to use on NVIDIAs DGX spark.
ruben-bibsyst changed discussion title from
No ARM support (for Nvidia DGX Spark) for your custom vLLM build
to No ARM support (Nvidia DGX Spark) for your custom vLLM build
I just tried using NVIDIAs latest official vLLM build, and it does not have support for the ministral3 architecture.