Job producing the image: https://github.com/ubicloud/ai-images/actions/runs/13307618520 The image contains - Python 3.12 - vLLM: 0.7.2 - inference gateway: v0.1.6 The main difference from the previous ai base image is that it comes with https://github.com/flashinfer-ai/flashinfer preinstalled.
7.3 KiB
7.3 KiB