What’s New

textgen v4.5.2

v4.5.2
Added
  • Add sky-blue color for quoted text in light mode
Changed
  • Project renamed to TextGen with GitHub URL now at github.com/oobabooga/textgen
  • Improve logits display
  • Reduce VRAM peak in prompt logprobs forward pass
  • Update llama.cpp to commit 5d14e5d19bd6af7fc38eb92d96aa185e5948a03d
  • Update ik_llama.cpp to commit 47986f0844a16d1f498e3c8095812a24f969351f
Fixed
  • Fix Gemma-4 tool calling to handle double quotes and newline chars in arguments
  • Fix chat scroll getting stuck on thinking blocks
  • Prevent Tool Icon SVG shrinking when tool calls are long
  • Fix wrong chat being deleted when selection changes before confirm
  • Fix bos/eos tokens not being set for models without a chat template by resetting defaults before reading model metadata
  • Fix duplicate BOS token being prepended in ExLlamav3
  • Fix version metadata not syncing on Continue
  • Fix row_split not working with ik_llama.cpp by converting --split-mode row to --split-mode graph
  • Fix Start reply with crash
  • Fix tool responses with Gemma 4 template
  • Fix consecutive thinking blocks rendering with Gemma 4
  • Fix bos/eos tokens being overwritten after GGUF metadata sets them
Changes
  • The project has been renamed to TextGen! The GitHub URL is now github.com/oobabooga/textgen.
  • Logits display improvements (#7486). Thanks, @wiger3.
  • UI: Add sky-blue color for quoted text in light mode (#7473). Thanks, @Th-Underscore.
  • Reduce VRAM peak in prompt logprobs forward pass.
Bug fixes
  • Fix Gemma-4 tool calling: handle double quotes and newline chars in arguments (#7477). Thanks, @mamei16.
  • Fix chat scroll getting stuck on thinking blocks (#7485).
  • Prevent Tool Icon SVG Shrinking When Tool Calls Are Long (#7488). Thanks, @mamei16.
  • Fix: wrong chat deleted when selection changes before confirm (#7483). Thanks, @lawrence3699.
  • Fix bos/eos tokens not being set for models without a chat template. Defaults are now reset before reading model metadata.
  • Fix duplicate BOS token being prepended in ExLlamav3.
  • Fix version metadata not syncing on Continue (#7492).
  • Fix row_split not working with ik_llama.cpp — --split-mode row is now converted to --split-mode graph (#7489).
  • Fix "Start reply with" crash (#7497). 🆕 - v4.5.1.
  • Fix tool responses with Gemma 4 template (#7498). 🆕 - v4.5.1.
  • UI: Fix consecutive thinking blocks rendering with Gemma 4. 🆕 - v4.5.1.
  • Fix bos/eos tokens being overwritten after GGUF metadata sets them (#7496). 🆕 - v4.5.2
Dependency updates
Portable builds

Below you can find self-contained packages that work with GGUF models (llama.cpp) and require no installation! Just download the right version for your system, unzip/extract, and run.

[!NOTE] NVIDIA GPU: If nvidia-smi reports CUDA Version >= 13.1, use the cuda13.1 build. Otherwise, use cuda12.4.

ik_llama.cpp is a llama.cpp fork with new quant types. If unsure, use the llama.cpp column.

Windows
GPU/Platformllama.cppik_llama.cpp
NVIDIA (CUDA 12.4)Download (774 MB)Download (1.09 GB)
NVIDIA (CUDA 13.1)Download (696 MB)Download (1.19 GB)
AMD/Intel (Vulkan)Download (209 MB)—
AMD (ROCm 7.2)Download (517 MB)—
CPU onlyDownload (191 MB)Download (192 MB)
Linux
GPU/Platformllama.cppik_llama.cpp
NVIDIA (CUDA 12.4)Download (758 MB)Download (1.09 GB)
NVIDIA (CUDA 13.1)Download (710 MB)Download (1.21 GB)
AMD/Intel (Vulkan)Download (225 MB)—
AMD (ROCm 7.2)Download (330 MB)—
CPU onlyDownload (207 MB)Download (218 MB)
macOS
Architecturellama.cpp
Apple Silicon (arm64)Download (182 MB)
Intel (x86_64)Download (188 MB)
Updating a portable install:
  1. Download and extract the latest version.
  2. Replace the user_data folder with the one in your existing install. All your settings and models will be moved.

Starting with 4.0, you can also move user_data one folder up, next to the install folder. It will be detected automatically, making updates easier:

text-generation-webui-4.0/
text-generation-webui-4.1/
user_data/                    <-- shared by both installs
View original