Problem
NIM has rate limits and is prone to throttling, so load balancing or chaining multiple accounts is necessary.
Proposed solution
The simplest approach might be to provide an option that automatically switches to a backup profile when the following error occurs: Warn Rate limit exceeded: {“status”:429,‘title’:“Too Many Requests”}.
Alternatives considered
Additional context
Problem
NIM has rate limits and is prone to throttling, so load balancing or chaining multiple accounts is necessary.
Proposed solution
The simplest approach might be to provide an option that automatically switches to a backup profile when the following error occurs:
Warn Rate limit exceeded: {“status”:429,‘title’:“Too Many Requests”}.Alternatives considered
Additional context