# LiteLLM v1.101.0-dev.1 - Product: LiteLLM (https://whatsnew.fyi/product/litellm) - Vendor: BerriAI - Date: 2026-09-01 - Version: v1.101.0-dev.1 - Original notes: https://github.com/BerriAI/litellm/releases/tag/v1.101.0-dev.1 - Permalink: https://whatsnew.fyi/product/litellm/releases/v1.101.0-dev.1 - Labels: Pre-release What's New is an index, not a publisher: every entry below links to the vendor's own release notes, which are the authoritative source. Entries are labelled where they are hand-curated sample data, pre-releases, or drawn from a secondary source such as a developer blog. Reuse: the summaries, labels and curation here are © What's New. Quote freely with attribution and a link back; wholesale republication of the corpus is not permitted — terms: https://whatsnew.fyi/terms. The vendors' own release notes remain their publishers'. --- - **fixed** — Emit timing headers and overhead for /v1/messages and /v1/responses in proxy - **fixed** — Derive the no-cache-read-rate savings baseline from the model map in tests - **changed** — Clear Any type seams across 47 files and ratchet basedpyright ceilings - **changed** — Clear 1.2k basedpyright Any errors across 16 hotspot files - **added** — Honor streaming buffer and sampling config for unbuffered post_call scans in Bedrock - **added** — Set ENABLE_TOOL_SEARCH=true for lite Claude in CLI - **fixed** — Deliver budget alerts on webhook-only alerting and accept ALERTING_WEBHOOK_URL in proxy - **fixed** — Update stale source URLs and deprecation dates in model cost map - **added** — Close duplicate issues after a 3-day grace period in CI - **fixed** — Configure Prompt Security file timeout policy in guardrails - **fixed** — Stop duplicating Converse config blocks inside inferenceConfig in Bedrock - **fixed** — Exclude images from HiddenLayer v1 scans in guardrails - **added** — Persist router metadata in spend logs for internal router models in spend_tracking - **fixed** — Graft default vertex path when api_base has a version-only path in vertex_ai - **fixed** — Allow unblocking customers via /customer/update in proxy - **added** — Support workload identity federation (OIDC token exchange) in OpenAI - **fixed** — Emit cache token counts on OTel v2 LLM spans in otel - **added** — Add /v1/responses/input_tokens token counting endpoint in proxy - **fixed** — Bump wolfi-base for glibc 2.44 and pin apk python to 3.13 in Docker - **added** — Add zai-org/GLM-5.3-Flash model pricing for Friendli - **fixed** — Surface Nova Sonic user transcripts, speech events, and usage in realtime API for Bedrock - **fixed** — Carry Anthropic url image sources through to guardrails - **added** — Add zai-org/GLM-5.3 model pricing for Friendli - **fixed** — Apply model renames to the in-memory deployment list in router - **added** — Add native API passthrough routes with spend logging for Gigachat - **added** — Add classification_mode to skip classifier on continuation turns in complexity-router - **security** — Sign all LiteLLM Docker images with cosign ##### Verify Docker Image Signature All LiteLLM Docker images are signed with [cosign](https://docs.sigstore.dev/cosign/overview/). Every release is signed with the same key introduced in [commit `0112e53`](https://github.com/BerriAI/litellm/commit/0112e53046018d726492c814b3644b7d376029d0). **Verify using the pinned commit hash (recommended):** A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \ ghcr.io/berriai/litellm:v1.101.0-dev.1 ``` **Verify using the release tag (convenience):** Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules: ```bash cosign verify \ --key https://raw.githubusercontent.com/BerriAI/litellm/v1.101.0-dev.1/cosign.pub \ ghcr.io/berriai/litellm:v1.101.0-dev.1 ``` Expected output: ``` The following checks were performed on each of these signatures: - The cosign claims were validated - The signatures were verified against the specified public key ``` --- ##### What's Changed * fix(proxy): emit timing headers and overhead for /v1/messages and /v1/responses by @yucheng-berri in https://github.com/BerriAI/litellm/pull/38840 * fix(tests): derive the no-cache-read-rate savings baseline from the model map by @tin-berri in https://github.com/BerriAI/litellm/pull/38863 * chore(typing): clear Any seams across 47 files, ratchet basedpyright ceilings -3,302 by @mateo-berri in https://github.com/BerriAI/litellm/pull/37778 * chore(typing): clear 1.2k basedpyright Any errors across 16 hotspot files by @mateo-berri in https://github.com/BerriAI/litellm/pull/36722 * feat(bedrock): honor streaming buffer/sampling config for unbuffered post_call scans by @mateo-berri in https://github.com/BerriAI/litellm/pull/38722 * feat(cli): set ENABLE_TOOL_SEARCH=true for lite claude by @mateo-berri in https://github.com/BerriAI/litellm/pull/38942 * fix(proxy): deliver budget alerts on webhook-only alerting and accept ALERTING_WEBHOOK_URL by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/38441 * docs(claude.md): require tests to check behavior, not code structure by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/38772 * chore(newrelic): cover static default_team_settings per-team routing by @yucheng-berri in https://github.com/BerriAI/litellm/pull/38857 * fix: update stale source URLs and deprecation dates in model cost map by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/38801 * feat(ci): close duplicate issues after a 3-day grace period by @mubashir1osmani in https://github.com/BerriAI/litellm/pull/38381 * docs(proxy): clarify spend semantics on /v2/user/info and /user/daily/activity by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/38883 * fix(guardrails): configure Prompt Security file timeout policy by @davida-ps in https://github.com/BerriAI/litellm/pull/38083 * fix(bedrock): stop duplicating Converse config blocks inside inferenceConfig by @mateo-berri in https://github.com/BerriAI/litellm/pull/38993 * fix(guardrails): exclude images from HiddenLayer v1 scans by @Ashton-Sidhu in https://github.com/BerriAI/litellm/pull/29210 * feat(spend_tracking): persist router metadata in spend logs for internal router models by @mateo-berri in https://github.com/BerriAI/litellm/pull/39001 * fix(vertex_ai): graft default vertex path when api_base has a version-only path by @devin-ai-integration[bot] in https://github.com/BerriAI/litellm/pull/38986 * fix(proxy): allow unblocking customers via /customer/update by @cat0825 in https://github.com/BerriAI/litellm/pull/34696 * feat(openai): support workload identity federation (OIDC token exchange) by @mateo-berri in https://github.com/BerriAI/litellm/pull/38995 * fix(otel): emit cache token counts on OTel v2 LLM sp _[Truncated at 4000 characters — full notes: https://github.com/BerriAI/litellm/releases/tag/v1.101.0-dev.1]_