Avoid service disruptions during rolling deployments #2985

Problem

During rolling deployments, a new replica starts receiving requests immediately after it becomes running, even if it is not yet ready to handle them, which leads to request errors.

Solution

Only start routing requests to a new replica after its probes pass.

Workaround

No response

Would you like to help us implement this feature by sending a PR?

Yes