infrastructure

Failover

Automatically switching to a backup model or provider when the first one fails, for example because of an outage or a rate limit. The answer may come from a different model, so quality and cost can change. Like a backup generator: it keeps the lights on, but it is not the same power source.

See it in practice: Field Notes on fallback chains

Want to learn more about AI?

Peter Saddington has trained 17,000+ people on agile and AI. Let’s talk.

Work with Peter