VLLM error
#8
by
BornSaint - opened
ValueError: KimiVLForConditionalGeneration has no vLLM implementation and the Transformers implementation is not compatible with vLLM. Try setting VLLM_USE_V1=0.
VLLM_USE_V1=0 also don't work.
zhouzaida changed discussion status to
closed