LiteLLM v1.98.0-rc.1

v1.98.0-rc.1Pre-release
Added 8
  • Calibrate the complexity router classifier rubric with worked examples, selectable per router
  • Pre-adoption shadow eval for the auto-router with blind pairwise judge and derived state
  • Migrate playground chat controls to shadcn in UI
  • Add day-0 pricing for grok-4.6
  • Add meta/muse-spark-1.2 model pricing and its contributor tier
  • Show provider prompt cache tokens in chat response metrics in UI
  • Add Fireworks FW model pricing on Azure AI Foundry
  • Enable xhigh reasoning support for gpt-5.4-mini models
Changed 7
  • Bump nanoid to 3.3.18
  • Migrate TokenFlow and JsonViewer to shadcn in UI
  • Migrate SimpleMessageBlock and SimpleToolCallBlock to shadcn in UI
  • Migrate HistoryTree and CollapsibleMessage to shadcn in UI
  • Replace Any with precise types across responses, proxy, and llms modules
  • Migrate TruncatedValue and OutputCard to shadcn in UI
  • Migrate SectionHeader and ToolsSection to shadcn in UI
Fixed 5
  • Drop toolSpec.strict for Claude Sonnet 5 on Converse in Bedrock
  • Stop scoring system prompt text for code/technical complexity in router
  • Map step and turn history to Responses API roles and content types in interactions
  • Restore playground model filtering by endpoint in UI
  • Stop forwarding custom_llm_provider twice in proxy batches list and cancel operations
Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
  ghcr.io/berriai/litellm:v1.98.0-rc.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.98.0-rc.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.98.0-rc.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key
What's Changed
New Contributors

Full Changelog: https://github.com/BerriAI/litellm/compare/v1.98.0-dev.2...v1.98.0-rc.1

View original

Upgraded? How did it go?

Discussion