This site is in development.
Features and figures may change.
Contact us
Skip to content
Sample data. These figures are not a customer bill.
Learn more
Harbour /
All workspaces
Workspace
Search pages, models and records
Ctrl K
Pay as you go
Sample user
Pay as you go · Builder view
SU
Home
Routing
Router settings
All envs
Environment
Last 30 days
Range
Provider routing
Auto router
Router settings
Quality tests
Caching
Prompt trimming
Batch
Activity
Savings
Models
Chat
More
Router settings
Later
Later.
These settings show how routing will be tuned. The gateway does not read them yet.
Retries and timeouts
Retries per model
Request timeout (seconds)
Circuit breaker
Failures before it opens
Open for (seconds)
Load balancing
Spread evenly
Each deployment gets a share of requests.
Lowest latency
Send to the deployment answering fastest right now.
Least busy
Send to the deployment with the fewest requests in flight.
Least used
Send to the deployment furthest from its rate limit.
Skip deployments whose health check fails
Keep a conversation on the deployment whose prompt cache is warm
Conditional routing
If
is
→
✕
Add rule
Canary
Candidate model
Share of traffic (%)
Save router settings
