infrastructure
Failover
Automatically switching to a backup model or provider when the first one fails, for example because of an outage or a rate limit. The answer may come from a different model, so quality and cost can change. Like a backup generator: it keeps the lights on, but it is not the same power source.
See it in practice: Field Notes on fallback chains
Want to learn more about AI?
Peter Saddington has trained 17,000+ people on agile and AI. Let’s talk.
Work with Peter