Job producing the image: https://github.com/ubicloud/ai-images/actions/runs/13120464006 The image contains - Python 3.12 - vLLM: 0.7.1 - inference gateway: 0.1.5 The main updates are: - vLLM: 0.7.1 - in addition to the NVIDIA CUDA version, a CPU version of vLLM is now included in the image
7.2 KiB
7.2 KiB