Benjamin Satzger e54e0382db Set load balancer stack for inference endpoints ...

Inference endpoints currently don't support dual stack ip addresses.
Configure the load balancer as ipv4 to make sure clients don't try to
connect with ipv6.

2024-11-06 16:19:26 +01:00

..

inference_endpoint_nexus.rb

Set load balancer stack for inference endpoints

2024-11-06 16:19:26 +01:00

inference_endpoint_replica_nexus.rb

Add gpu_count to inference endpoints

2024-10-31 12:44:39 +01:00