LiteLLM v1.98.0

v1.98.0
Added 8
  • Configure provisioned-throughput flat cost on a model deployment for PTU
  • Daily rollup writes per-model PTU flat cost by active hour
  • Add opt-in session_id and trace_id correlation to JSON log records via contextvars
  • Surface PTU flat cost on the daily activity read path
  • Add per-deployment allowed_fails_policy and cooldown_time override support in router
  • Add PTU inputs to the model form and flat cost to the Usage page
  • Gate PTU flat-cost attribution behind an opt-in env var
  • Configurable estimated output tokens per key, team and model for rate limiting
Fixed 12
  • Drop toolSpec.strict for Claude Sonnet 5 on Converse in Bedrock
  • Attribute Vertex passthrough batch cost to key, team, and tags
  • Scope file list pagination cursors to the caller in proxy
  • Skip Prisma-dependent hooks when no database is attached in proxy
  • Report has_more false on caller-scoped file list pages in proxy
  • Restore management_v1 query-param validation under fastapi>=0.140.7 in proxy

From LiteLLM

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.98.0

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.98.0/cosign.pub \
  ghcr.io/berriai/litellm:v1.98.0

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key
What's Changed
New Contributors

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.97.0...v1.98.0

View original

Upgraded? How did it go?

Discussion