# Accelerate v1.9.0 — v1.9.0: Trackio support, Model loading speedup, Minor distributed improvements - Product: Accelerate (https://whatsnew.fyi/product/accelerate) - Vendor: Hugging Face - Date: 2025-07-16 - Version: v1.9.0 - Original notes: https://github.com/huggingface/accelerate/releases/tag/v1.9.0 - Permalink: https://whatsnew.fyi/product/accelerate/releases/v1.9.0 What's New is an index, not a publisher: every entry below links to the vendor's own release notes, which are the authoritative source. Entries are labelled where they are hand-curated sample data, pre-releases, or drawn from a secondary source such as a developer blog. Reuse: the summaries, labels and curation here are © What's New. Quote freely with attribution and a link back; wholesale republication of the corpus is not permitted — terms: https://whatsnew.fyi/terms. The vendors' own release notes remain their publishers'. --- - **added** — Add support for trackio experiment tracking library with local-first design and Hugging Face Spaces integration - **changed** — Improve model loading speed by 4-5x when using set_module_tensor_to_device with new clear_device option and non_blocking transfers - **changed** — Change find_executable_batch_size() default back-off strategy from halving batch size to multiplying by 0.9 to reduce GPU capacity waste - **added** — Add support for e5e2 and default to hybrid mode when launcher is used - **fixed** — Fix FP8 to work without direct Accelerator() configuration - **fixed** — Fix proper error handling when using DDP with Dtensor model - **fixed** — Fix fsdp2 example typo - **fixed** — Add check in no_sync() to avoid errors when using deepspeed zero2/3 - **fixed** — Fix wandb config not being saved in offline mode - **fixed** — Prevent yielding from data loader when base_dataloader is empty - **changed** — Add warnings for invalid keys - **changed** — Update Gaudi runner image to latest SynapseAI and enable previously disabled tests - **removed** — Unpin datasets dependency in examples requirements #### Trackio tracker support We've added support for a trackio, lightweight, 💯 free experiment tracking Python library built on top of 🤗 Datasets and Spaces. ![Screen Recording 2025-06-11 at 5 39 32 PM](https://github.com/user-attachments/assets/5cf12286-54e7-4119-8a20-88c2cbd37ab6) Main features are: - *Local-first* design: dashboard runs locally by default. You can also host it on Spaces by specifying a `space_id`. - Persists logs locally (or in a private Hugging Face Dataset) - Visualize experiments with a Gradio dashboard locally (or on Hugging Face Spaces) - Everything here, including hosting on Hugging Faces, is **free**! To use it with accelerate, you need to set `log_with` and initialize the trackers ```python accelerator = Accelerator(log_with="trackio") config={"learning_rate": 0.001, "batch_size": 32} #### init_kwargs in order to host the dashboard on spaces init_kwargs = {"trackio": {"space_id": "hf_username/space_name"} accelerator.init_trackers("example_project", config=config, init_kwargs=init_kwargs}) ``` Thanks @pcuenca for the integration ! * trackio by @pcuenca in https://github.com/huggingface/accelerate/pull/3669 ##### Model loading speedup when relying `set_module_tensor_to_device ` Setting tensor while clearing cache is very slow, so we added `clear_device` option to disable it. Another small optimization is using `non_blocking` everywhere and syncing just before returning control to the user. This makes the loading slightly faster. * Speedup model loading by 4-5x in Diffusers ⚡ by @a-r-r-o-w in https://github.com/huggingface/accelerate/pull/3674 ##### FDSP, Deepspeed, FP8 minor improvements * Add support for e5e2 and default to hybrid when launcher is used by @IlyasMoutawwakil in https://github.com/huggingface/accelerate/pull/3640 * Fix FP8 tests, enable FP8 to be used without direct `Accelerator()` configuring by @pstjohn in https://github.com/huggingface/accelerate/pull/3677 * Bunch of FSDP improvements by @S1ro1 in https://github.com/huggingface/accelerate/pull/3671 * Fix: properly error when DDP + Dtensor model by @S1ro1 in https://github.com/huggingface/accelerate/pull/3629 * Fix fsdp2 example typo by @shimizust in https://github.com/huggingface/accelerate/pull/3657 * Added a check in no_sync() to avoid errors when using deepspeed zero2/3 by @xliu0105 in https://github.com/huggingface/accelerate/pull/3656 ##### 🚨🚨🚨 Breaking changes 🚨🚨🚨 `find_executable_batch_size()` will no longer halves the batch after every OOM. Instead, we will multiply the batch size by 0.9. This should help user not waste gpu capacity. * “Stop Halving My Batch!” · Default back-off 0.5 → 0.9 by @SunMarc in https://github.com/huggingface/accelerate/pull/3684 ##### What's Changed * [typo] shards instead of shard by @SunMarc in https://github.com/huggingface/accelerate/pull/3645 * Docs: Fix typos in gradient accumulation guide by @kilavvy in https://github.com/huggingface/accelerate/pull/3649 * xpu enablement on left cases by @yao-matrix in https://github.com/huggingface/accelerate/pull/3654 * unpin datasets in examples requirements by @SunMarc in https://github.com/huggingface/accelerate/pull/3681 * fix: wandb config not saved in offline mode by @ved1beta in https://github.com/huggingface/accelerate/pull/3648 * accelerate/data_loader.py: do not yield if the base_dataloader is empty by @0xnightwind in https://github.com/huggingface/accelerate/pull/3659 * warn for invalid keys by @ved1beta in https://github.com/huggingface/accelerate/pull/3613 * Update Gaudi runner image to latest SynapseAI and enable previously disabled tests by @IlyasMoutawwakil in https://github.com/huggingface/accelerate/pull/3653 ##### New Contributors * @kilavvy made their first contribution in https://github.com/huggingface/accelerate/pull/3649 * @shimizust made their first contribution in https://github.com/huggingface/accelerate/pull/3657 * @xliu0105 made their first contribu _[Truncated at 4000 characters — full notes: https://github.com/huggingface/accelerate/releases/tag/v1.9.0]_