unsloth v0.1.803-beta

v0.1.803-betaPre-release

Bug Fixes + Auto compaction + LAN Remote Access

Added 10
  • Added LAN API keyless and password-less access with keyboard shortcuts
  • Added XET and HTTP download toggle for clearer download progress
  • Added Auto Compaction (Experimental) for longer chats beyond context limits
  • Added Remote and LAN Access (Preview) for easy network access without Cloudflare links
  • Added support for custom llama.cpp builds with toggles for Cache RAM, Mmap, Mlock, Checkpoints, Speculative Decoding KV Cache, and Vision On/Off
  • Released Unsloth Dynamic v3.0 with Qwen3.8-27B GGUFs delivering over 10% higher top-1 accuracy
Changed 8
  • Improved chat streaming performance, reduced UI lag, and made long conversations smoother
  • Improved tool calling and MCP behavior
  • Responses API now supports structured output formatting
  • Improved recovery when llama-server crashes
  • Improved GGUF downloads to be faster
  • Improved Desktop packaging and permissions
  • Improved training scheduler and preprocessing
  • Improved compatibility across ROCm, xFormers, and flash-attention setups
Fixed 2
  • Fixed MLX and Mac runtimes that did not run correctly
  • Fixed AMD bugs and 170 bug, reliability, and performance issues

From unsloth

Thanks for the support for Qwen3.8-27B and Unsloth Desktop! This is a bug fix release with 170+ PRs.

  • MLX fixed - Some MLX and Mac runtimes did not run correctly
  • LAN API keyless / password-less + Keyboard shortcuts
  • XET / HTTP download toggle - clearer download progress
  • AMD bug fixes + 170 bug, reliability & performance fixes
Features
  • Auto Compaction (Experimental) for longer chats beyond context limits
  • Remote & LAN Access (Preview) for easy network access without Cloudflare links
  • Faster Chat - Improved streaming performance, reduced UI lag, and smoother long conversations.
  • Support for custom llama.cpp builds. Toggles for Cache RAM, Mmap, Mlock, Checkpoints, Spe Decoding KV Cache, Vision On / Off
  • Unsloth Dynamic v3.0 is released. New Qwen3.8-27B Dynamic v3.0 GGUFs deliver >10% higher top-1 accuracy compared to everyone else. Works with Unsloth.
Auto compaction (Experimental)

You can now do long chats and surpass a model's context limit, with evicted turns remaining searchable.

  • Long local chats can continue past the context limit by rolling older turns out of active context.
  • Auto compaction creates fresh context epochs instead of permanently trimming replies.
  • Evicted conversations remain searchable, with improved fact recall.
  • Context window information is shown before chat begins.

How it works

  • Entire oldest turns are removed only when needed, never mid-message. The saved transcript stays unchanged.
  • Evicted turns are indexed into a per-thread searchable archive using Unsloth's existing RAG pipeline (store, chunker, embedder, retrieval). Lexical search is prioritized because chat recall is usually exact matches like names, numbers, or IDs.
  • A recall is forced during eviction instead of relying on the model to search itself. Later retrieval uses search_conversation.
  • The archive persists across epochs, allowing future compactions to recover previously evicted context.
  • No summarization: it showed little benefit and added ~190s per compaction.
Remote & LAN access (Preview)

Access Unsloth from another device on your network, managed from settings.

  • New dedicated Settings section for remote access.
  • Enable or disable LAN access without restarting.
  • Supports connection addresses, QR codes, and optional auto-start.
  • LAN access is disabled by default and requires changing the generated admin password.
Chat + Functionality improvements
  • Long chats are faster with optimized streaming and thread handling.
  • Projects organize chats, files, and workspaces together.
  • Chats remember composer settings, system prompts, and model sampling options.
  • Added prompt queueing and customizable keyboard shortcuts.
  • Added edit_file tool for partial file modifications.
  • Improved tool calling and MCP behavior.
Hardware + inference improvements
  • Support for custom llama.cpp builds.
  • Toggles for advanced settings - Cache RAM, Mmap, Mlock, Checkpoints, Speculative Decoding KV Cache, Vision On / Off
  • Better validation for missing GPU support and oversized GGUF models.
  • Improved MTP performance and VRAM handling.
  • Better compatibility across ROCm, xFormers, and flash-attention setups.
  • Added Intel XPU support.
API + serving
  • Responses API supports structured output formatting.
  • Improved recovery when llama-server crashes.
  • Added OpenCode V2 support for unsloth start.
Hub + Desktop + training
  • Hub supports more image/video workflows.
  • Faster and improved GGUF downloads.
  • Desktop packaging and permissions improved.
  • Training scheduler and preprocessing improvements.
What's Changed
New Contributors

Full Changelog: https://github.com/unslothai/unsloth/compare/v0.1.801-beta...v0.1.803-beta

View original

Upgraded? How did it go?

Discussion