In a previous commit we extended the AI boot image to also include a cpu version of vLLM. In this change, we start to use the cpu version if the gpu count is zero.
816 B
Executable File
816 B
Executable File