Ohhhh, programmatic control over AI token budgets is actually really useful.
Example use case:
- start with a more conservative budget
- allow re-up with business justification via a slack bot
Vercel Developers (@vercel_dev)
AI Gateway API keys now support budgets. Set one programmatically or configure on the API keys page:
𝚟𝚎𝚛𝚌𝚎𝚕 𝚊𝚒-𝚐𝚊𝚝𝚎𝚠𝚊𝚢 𝚊𝚙𝚒-𝚔𝚎𝚢𝚜 𝚌𝚛𝚎𝚊𝚝𝚎 \
--𝚗𝚊𝚖𝚎 𝚖𝚢-𝚔𝚎𝚢 \
--𝚋𝚞𝚍𝚐𝚎𝚝 𝟷𝟶𝟶𝟶
vercel.com/changelog/budgets…
— https://nitter.net/vercel_dev/status/2064509018719273300#m