This site is in development.
Features and figures may change.
Contact us
Skip to content
Sample data. These figures are not a customer bill.
Learn more
Orbital Health /
All workspaces
Workspace
Search pages, models and records
Ctrl K
Enterprise
Sample user
Enterprise · Builder view
SU
Home
Routing
Caching
All envs
Environment
Last 30 days
Range
Provider routing
Auto router
Router settings
Quality tests
Caching
Prompt trimming
Batch
Activity
Savings
Models
Chat
More
Caching
Provider cache
Response cache
Hit rate
0.0%
0 of 24 sample requests
Cached input tokens
0
Tokens the provider priced as cached
Routes to reorder
2
Stable prefix is not in front yet
Prompt reorder
Note draft
Move the stable system prompt ahead of the user turn so the provider can cache it.
8,173 input tokens
Open cache policy
Auth summary
Move the stable system prompt ahead of the user turn so the provider can cache it.
7,955 input tokens
Open cache policy
