Add an external_config column to the inference_endpoint table to store the configuration of external components. Add an external_state column to the inference_endpoint_replica table to track the state of external components for each replica. |
||
---|---|---|
.. | ||
inference_endpoint.rb | ||
inference_endpoint_replica.rb |