# MLflow v3.14.0 - Product: MLflow (https://whatsnew.fyi/product/mlflow) - Vendor: LF AI & Data - Date: 2026-06-17 - Version: v3.14.0 - Original notes: https://github.com/mlflow/mlflow/releases/tag/v3.14.0 - Permalink: https://whatsnew.fyi/product/mlflow/releases/v3.14.0 What's New is an index, not a publisher: every entry below links to the vendor's own release notes, which are the authoritative source. Entries are labelled where they are hand-curated sample data, pre-releases, or drawn from a secondary source such as a developer blog. Reuse: the summaries, labels and curation here are © What's New. Quote freely with attribution and a link back; wholesale republication of the corpus is not permitted — terms: https://whatsnew.fyi/terms. The vendors' own release notes remain their publishers'. --- - **added** — One-command agent onboarding with `mlflow agent setup` to install MLflow, set up tracing, and configure coding agents with MLflow skills - **added** — Durable, low-latency tracing for Claude Code with write-ahead-log to prevent slowing the agent, overwhelming the tracking server, or losing traces - **added** — Review Queues for traces to assign traces to reviewers and collect structured feedback and ground-truth annotations in the UI - **changed** — Revamped evaluation dataset UI to browse, inspect, edit, and bulk-manage evaluation dataset records directly in the UI with click-through to source trace - **added** — Pytest integration for regression testing with `@mlflow.test` marker to write GenAI regression tests and review test history in the UI - **added** — LLM Playground to iterate on prompts in the browser against AI Gateway endpoints and Prompt Registry versions with settings, tools, and structured output - **changed** — Change `mlflow.sklearn` `serialization_format` default from `cloudpickle` to `skops` - **changed** — Change `serialization_format` default to `pt2` for `mlflow.pytorch.log_model` and `mlflow.pytorch.save_model` - **changed** — Change `serialization_format` default to `skops` in `mlflow.lightgbm` `log_model`/`save_model` - **added** — Add EvaluationResult.passed and .reason properties for `@mlflow.test` assertions - **added** — Add shareable review queue URLs with a `startReview` deep link - **added** — Allow editing a completed review in place in focus mode - **added** — Add `x-mlflow-run-id` support to OTLP trace ingestion - **added** — Add `mlflow skills view/list` CLI command - **added** — Add `MLFLOW_WORKSPACE` support to OSS auth provider - **added** — Add cached token pricing to Databricks model catalog in Gateway - **added** — Add `MLFLOW_GENAI_JUDGE_DEFAULT_MODEL` environment variable for evaluation - **added** — Add rule-based built-in scorers: `RegexMatch`, `PIIDetection`, `ResponseLength` - **added** — Add Google ADK LLM judge scorers (`Hallucination`, `Safety`, `ResponseEvaluation`) - **fixed** — Fix `ChrfScore` RAGAS scorer instantiation due to class name mismatch MLflow 3.14.0 includes several major features and improvements ###### Major New Features - **🚀 [One-command agent onboarding with `mlflow agent setup`](https://mlflow.org/docs/latest/genai/tracing/quickstart/)**: Install MLflow, set up tracing, and hand your favorite coding agent (Claude Code, OpenAI Codex, or OpenCode) the MLflow skills to instrument your app, all from a single command. - **⚡ [Durable, low-latency tracing for Claude Code](https://mlflow.org/docs/latest/genai/tracing/integrations/listing/claude_code)**: Roll out Claude Code tracing across a team with confidence: a write-ahead-log keeps it from slowing the agent, overwhelming the tracking server, or losing traces on a network blip or crash. - **📝 [Review Queues for traces](https://mlflow.org/docs/latest/genai/assessments/review-queues)**: Assign traces to reviewers (or agents) and collect structured feedback and ground-truth annotations in the UI, written straight back onto the trace so they are immediately usable for evaluation. - **🗂️ [Revamped evaluation dataset UI](https://mlflow.org/docs/latest/genai/datasets/)**: Browse, inspect, edit, and bulk-manage evaluation dataset records directly in the UI, with click-through to the source trace. - **🧪 [Pytest integration for regression testing](https://mlflow.org/docs/latest/genai/eval-monitor/regression-testing)**: Write GenAI regression tests as plain pytest functions with the `@mlflow.test` marker, gate them in CI, and review test history and per-assertion judge results in the UI. - **🎛️ [LLM Playground](https://mlflow.org/docs/latest/genai/prompt-registry/playground)**: Iterate on prompts in the browser against your AI Gateway endpoints and Prompt Registry versions, with settings, tools, structured output, and template variables. ###### Breaking Changes - [Models] Change `mlflow.sklearn` `serialization_format` default from `cloudpickle` to `skops` (#23987, @copilot-swe-agent) - [Models] Change `serialization_format` default to `"pt2"` for `mlflow.pytorch.log_model` and `mlflow.pytorch.save_model` (#23988, @copilot-swe-agent) - [Models] Change `serialization_format` default to `"skops"` in `mlflow.lightgbm` `log_model`/`save_model` (#23986, @copilot-swe-agent) ###### Other Assorted Features & Improvements: - [Evaluation / UI] [3/3] Show regression-test results in the existing eval-run UI (#23985, @B-Step62) - [Prompts / UI] Add "Save prompt to registry" action to the Prompt Playground (#24021, @B-Step62) - [Prompts] Prompt Playground (#23273, @TomeHirata) - [Evaluation] [2/3] Add `EvaluationResult.passed`/`.reason` for `@mlflow.test` assertions (#23869, @B-Step62) - [UI] Review queues: list the affected queues in the delete-question confirmation (#24002, @kriscon-db) - [UI] Add shareable review queue URLs with a `startReview` deep link (#23941, @harupy) - [UI] Allow editing a completed review in place in focus mode (#23967, @kriscon-db) - [Tracing] Add `x-mlflow-run-id` support to OTLP trace ingestion (#23664, @sanatb187) - [Evaluation / Tracing] [1/3] Add @mlflow.test pytest marker and assertion framework (#23864, @B-Step62) - [UI] Improve review queue empty states with onboarding content (#23903, @B-Step62) - [UI] Add `mlflow skills view/list` CLI (#23907, @joshuawong-db) - [UI] Improve review queue list: flat layout, sortable columns, status filter (#23902, @B-Step62) - [Tracing] Add `MLFLOW_WORKSPACE` support to OSS auth provider (#23927, @Nehanth) - [Gateway] Add cached token pricing to Databricks model catalog (#23901, @TomeHirata) - [Evaluation] Add `MLFLOW_GENAI_JUDGE_DEFAULT_MODEL` environment variable (#23860, @B-Step62) - [Evaluation] Wire "Run judge(s)" submission in "Run Eval" in Evaluations Run page to POST /mlflow/genai/evaluate/invoke (#23781, @aaronteo-db) - [Evaluation] Add rule-based built-in scorers: `RegexMatch`, `PIIDetection`, `ResponseLength` (#22571, @debu-sinha) - [Tracing] Support Databricks backend in `mlflow agent setup` (#23783, @harup _[Truncated at 4000 characters — full notes: https://github.com/mlflow/mlflow/releases/tag/v3.14.0]_