This site is in development.
Features and figures may change.
Contact us
Skip to content
Sample data. These figures are not a customer bill.
Learn more
Northwind AI /
All workspaces
Workspace
Search pages, models and records
Ctrl K
Pay as you go
Sample user
Pay as you go · Builder view
SU
Home
Routing
Caching
All envs
Environment
Last 30 days
Range
Provider routing
Auto router
Router settings
Quality tests
Caching
Prompt trimming
Batch
Activity
Savings
,
2
open recommendations
Models
Chat
More
Caching
Provider cache
Response cache
Hit rate
25.0%
12 of 48 sample requests
Cached input tokens
1,440
Tokens the provider priced as cached
Routes to reorder
3
Stable prefix is not in front yet
Prompt reorder
Support reply
Move the stable system prompt ahead of the user turn so the provider can cache it.
10,837 input tokens
Open cache policy
Document extract
Move the stable system prompt ahead of the user turn so the provider can cache it.
9,357 input tokens
Open cache policy
Eval backfill
Move the stable system prompt ahead of the user turn so the provider can cache it.
9,994 input tokens
Open cache policy
