Benjamin Satzger c77cb7635d Migration to add gpu_count to inference_endpoint ...

Add a column `gpu_count` to the `inference_endpoint` table. That column
allows to specify how many gpus are to be assigned to each VM that runs
a replica of this endpoint.

2024-10-31 12:44:39 +01:00

180 B

Raw Permalink Blame History

View Raw