Prompt LibraryEngineering
LLM Model Routing Policy Design Prompt
Decide which requests go to a cheap model vs a frontier model.
The prompt
Task types and volumes: {{task_breakdown}}
Available models and their cost/latency: {{models}}
Propose a routing policy: which task types route to which model by default, the signal used to detect a task type before generation, and the escalation rule for when a cheap-model response fails a confidence or validation check.
State the expected cost saving and the quality risk you are accepting.Replace the {{fields}} with your own context and tighten the rules to match your domain.
More Engineering prompts
Model Fallback & Degradation Policy Prompt
Define what happens when the primary model is unavailable.
LLM Reranking Prompt for RAG Retrieval
Use a model as a cross-encoder-style reranker for retrieved chunks.
RAG Chunking Strategy Design Prompt
Design a structure-aware chunking plan for a specific document type.
