Files
Benjamin Satzger b5dbdcb45e Make vLLM work with FlashInfer
In order for FlashInfer to work we need to set the HOME variable to a
writable location. FlashInfer creates a cache directory under the users
home. With this change, it will be created at `/ie/workdir/.cache/flashinfer`.

More details on FlashInfer: https://github.com/flashinfer-ai/flashinfer
2025-02-14 08:17:48 +01:00
..