Now Available: Prompt Caching in Public Preview
With Prompt Caching, DigitalOcean automatically recognizes repeated token prefixes and currently offers an 80% discount on cached input tokens compared to standard input pricing across supported model…
Added 1
- Prompt Caching feature now available in public preview with automatic recognition of repeated token prefixes