Add an external_config column to the inference_endpoint table to store the configuration of external components. Add an external_state column to the inference_endpoint_replica table to track the state of external components for each replica.
317 B
317 B