[Bugfix][Router] Return 503 when failover ends on a backend client error - #1164

[Bugfix][Router] Return 503 when failover ends on a backend client error#1164

Mazyod wants to merge 1 commit into

vllm-project:mainvllm-project/production-stack:mainfrom

Mazyod:fix/unreachable-backend-503Mazyod/production-stack:fix/unreachable-backend-503Copy head branch name to clipboard