Prompt LibraryEngineering
Model Fallback & Degradation Policy Prompt
Define what happens when the primary model is unavailable.
The prompt
Define a fallback policy for when the primary model is unavailable or slow.
Specify:
- The primary model and the latency/cost SLA.
- The fallback model (cheaper/faster) and what tasks it may handle.
- What the fallback model must NOT do (complex reasoning, tool use) — those queue instead.
- The circuit-breaker threshold (N failures in M seconds → switch).
- The recovery condition to switch back to primary.
Primary model: {{primary}}
Fallback model: {{fallback}}Replace the {{fields}} with your own context and tighten the rules to match your domain.
More Engineering prompts
LLM Model Routing Policy Design Prompt
Decide which requests go to a cheap model vs a frontier model.
LLM Observability & Tracing Schema Prompt
Define what to log for every model call so incidents are debuggable.
LLM Reranking Prompt for RAG Retrieval
Use a model as a cross-encoder-style reranker for retrieved chunks.
