# textgen changelog

> textgen release notes.

- Vendor: textgen
- Category: AI
- Official site: https://github.com/oobabooga/textgen
- Tracked by: What's New (https://whatsnew.fyi/product/textgen)
- Harvested from: GitHub (oobabooga/textgen)
- Entries below: 10 (newest first)

What's New is an index, not a publisher: every entry below links to the vendor's own release notes, which are the authoritative source. Entries are labelled where they are hand-curated sample data, pre-releases, or drawn from a secondary source such as a developer blog.

## Releases

### v4.9

- Date: 2026-05-20
- Version: v4.9
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.9
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.9

##### Changes

- **MTP speculative decoding support**: Add `draft-mtp` as a new `--spec-type` option. Auto-enabled when loading MTP GGUFs (e.g. Qwen 3.6 MoE MTP builds).
- **Web search improvements**:
  - Add snippet support to the `web_search` tool: results now include a short text excerpt that often answers the query directly, eliminating the need for a follow-up `fetch_webpage` call (#7548).
  - Drop link URLs from `fetch_webpage` output (links now appear as plain text instead of `[text](url)` markdown), significantly reducing tokens used per page.
  - Prettier rendering of `web_search` results in the chat, with a spinner during the call.
  - Add an info message to the "Activate web search" checkbox.
- Show live generation speed (tokens/s) and context size while generating (#7563).
- DGX Spark support: Add Linux aarch64 portable builds.
- Electron
  - Add "Check for updates" button in the Session tab.
  - Add a folder picker for the models directory.
  - Add right-click context menu for copying text.
  - Add a spellcheck toggle in the Session tab (#7550).
  - Store app data in `user_data/cache/electron` instead of the OS default location.
  - Disable DNS-over-HTTPS probes.
- One-click installer: Track the latest release tag instead of bleeding-edge `main`.
- Auto-detect and auto-select sibling mmproj files when loading a model (#7564).
- Detect `mmproj-*.gguf` files in the main models folder: They appear in the mmproj dropdown and are hidden from the regular model dropdown.
- Project icon: Add an icon, courtesy of [LMLocalizer on Reddit](https://www.reddit.com/r/Oobabooga/comments/1tffhcu/comment/omcwa31/).
- Treat negative `--ctx-size` values as auto (0).
- UI
  - Add drag-and-drop file upload support to the chat input (Gradio fork).
  - Reorganize the right sidebar with Mode/Character/Chat style on top.
  - Hide reasoning and tools controls in chat mode (only shown in instruct / chat-instruct).
  - Fade in new messages, fix scroll-up jump on send.
  - Rename "Send dummy message/reply" to "Insert user/assistant message".
  - Polish character dropdown in chat tab.
  - Tighten spacing between dropdowns and refresh buttons.
  - Improve the looks of the Session tab.

##### Security

- Restrict CORS to localhost by default to prevent drive-by API access. `--listen` and `--public-api` opt into network exposure.
- Sanitize character name in `load_character` to prevent path traversal.
- fix: prevent path traversal in load_template_by_name (#7562). Thanks, @Allen930311.
- UI: Improve web search security by rejecting non-HTTP links.

##### Bug fixes

- Fix llama-server not being killed when the parent process exits on Windows, e.g. when closing the console window or killing python.exe (#7574).
- Fix streaming output leaking across chats when switching mid-stream (#7555).
- Fix continue-mode regressions across template families.
- Fix incorrect prompts generated with continue mode. Thanks, @MeemeeLab.
- Fix thinking channel being lost across tool-call turns (#7578).
- Fix API model load silently dropping hyphenated arg keys (#7577).
- Fix chat deletion failing when `user_data/logs` is a symlink (#7579).
- Fix token count not being set in non-streaming mode.
- Keep web search blocks closed when the user closes them mid-stream.
- fix(win): set PYTHONUTF8 for non-ASCII locale Windows compatibility (#7560). Thanks, @jerry78424.
- Set TORCH_VERSION to 2.9.0 to match xformers 0.0.33's torch pin (#7581). Thanks, @AJ-Gazin.

##### Dependency updates

- Update llama.cpp to https://github.com/ggml-org/llama.cpp/commit/e947228222147356bc7e64154d3439e142481632
- Update ik_llama.cpp to https://github.com/ikawrakow/ik_llama.cpp/commit/40254a51daf485b2b644bcb82a84278d95745ee5
- Update ExLlamaV3 to 0.0.34

##### Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

> [!NOTE]
> **NVIDIA GPU:** If `nvidia-smi` reports CUDA Version >= 13.1, use the *

_[Truncated at 4000 characters — full notes: https://github.com/oobabooga/textgen/releases/tag/v4.9]_

### v4.8

- Date: 2026-05-07
- Version: v4.8
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.8
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.8

<img src="https://raw.githubusercontent.com/oobabooga/screenshots/refs/heads/main/CHAT-4.8.png" />

##### Changes

- **Redesigned chat composer**: Taller input area with the paperclip and message-action buttons pinned to the bottom, similar to Gemini and DeepSeek.
- **Smooth scroll animation when sending a new message**: Inspired by Gemini's chat UI.
- **Electron improvements**:
  - Persist window bounds and maximize state across launches.
  - Add a `--no-electron` flag to skip the desktop window and use the web UI in the browser instead.
  - Disable spellcheck in the chat input.
- API: Add support for list-format content in tool and assistant messages.
- Add more space below the last chat/chat-instruct message so its action buttons have breathing room.

##### Bug fixes

- Electron:
  - Fix `--listen` mode in the launcher.
  - Fix missing log colors on Windows.
  - Fix big character picture failing to load (#7540).
- Fix speculative decoding broken by upstream llama.cpp arg renames (#7541).
- Fix truncation length reverting after model load on UI reload (#7540).
- Don't clear the chat input when sending a message with no model loaded (#7542).

##### Dependency updates

- Update llama.cpp to https://github.com/ggml-org/llama.cpp/commit/68380ae11b564af67196afc70f10c99dbb532fa9
- Update ik_llama.cpp to https://github.com/ikawrakow/ik_llama.cpp/commit/9a26522af234f8db079ae3735f35ab6c20fe2c66

##### Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

> [!NOTE]
> **NVIDIA GPU:** If `nvidia-smi` reports CUDA Version >= 13.1, use the **cuda13.1** build. Otherwise, use **cuda12.4**.
>
> **ik_llama.cpp** is a [llama.cpp fork](https://github.com/ikawrakow/ik_llama.cpp/) with new quant types. If unsure, use the llama.cpp column.

###### Windows

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-windows-cuda12.4.zip) (891 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-ik-4.8-windows-cuda12.4.zip) (1.23 GB) |
| NVIDIA (CUDA 13.1) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-windows-cuda13.1.zip) (817 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-ik-4.8-windows-cuda13.1.zip) (1.33 GB) |
| AMD/Intel (Vulkan) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-windows-vulkan.zip) (336 MB) | — |
| AMD (ROCm 7.2) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-windows-rocm7.2.zip) (604 MB) | — |
| CPU only | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-windows-cpu.zip) (319 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-ik-4.8-windows-cpu.zip) (334 MB) |

###### Linux

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-linux-cuda12.4.tar.gz) (848 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-ik-4.8-linux-cuda12.4.tar.gz) (1.20 GB) |
| NVIDIA (CUDA 13.1) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-linux-cuda13.1.tar.gz) (803 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-ik-4.8-linux-cuda13.1.tar.gz) (1.33 GB) |
| AMD/Intel (Vulkan) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-linux-vulkan.tar.gz) (324 MB) | — |
| AMD (ROCm 7.2) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.8/textgen-portable-4.8-linux-rocm7.2.tar.gz) (396 MB) | — |
| CPU only | [Download](https://github.com/o

_[Truncated at 4000 characters — full notes: https://github.com/oobabooga/textgen/releases/tag/v4.8]_

### v4.7.3

- Date: 2026-05-03
- Version: v4.7.3
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.7.3
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.7.3

<img src="https://raw.githubusercontent.com/oobabooga/screenshots/refs/heads/main/CHAT-4.7.png" />

##### Changes

- **Native desktop app**: Portable builds now bundle [Electron](https://www.electronjs.org/) and open as a native window. Run `textgen` / `textgen.bat` instead of the previous start scripts. Pass `--listen` or `--nowebui` to skip the window and run the server directly.
- **Major UI overhaul**:
  - Replace Noto Sans with Inter as the default font.
  - Replace emoji refresh/save/delete buttons with [Lucide](https://lucide.dev/) SVG icons.
  - Turn the chat mode selector (chat / chat-instruct / instruct) into a 3-button segmented control.
  - Redesign the chat input as a single rounded card with a circular accent-colored send button.
  - Use a flat underline for the active tab indicator.
  - Replace the sidebar toggle buttons with 3px hairline handles on desktop.
- **Tensor parallelism for llama.cpp**: New `--split-mode` flag (replacing `--row-split`) with a `tensor` option that can make multi-GPU inference 60%+ faster. On the ik_llama.cpp backend, `tensor` and `row` fall back to `graph`.
- Replace DuckDuckGo HTML scraping in the web search tool with the [ddgs](https://pypi.org/project/ddgs/) library, which is more robust against DuckDuckGo's bot blocking.
- Add support for standalone `.jinja`/`.jinja2` instruction template files in the UI, in addition to the existing `.yaml` format (#7517).

##### Bug fixes

- Fix Stop button being ignored during tool call approval, and not interrupting between tool turns in multi-turn tool loops.
- Fix race condition in the ExLlamaV3 backend that could affect concurrent API requests.
- Fix extension settings not saving for extensions inside `user_data/extensions` (#7525).

##### Dependency updates

- Update llama.cpp to https://github.com/ggml-org/llama.cpp/commit/09294365a9d7a2b786584d59525b034622c3ed81
- Update ik_llama.cpp to https://github.com/ikawrakow/ik_llama.cpp/commit/9f1deefa7128889fd8a947964f04262bfa724b84
- Update transformers to 5.6

##### Portable builds

TextGen is now a desktop app for local LLMs. Download, unzip, double-click.

> [!NOTE]
> **NVIDIA GPU:** If `nvidia-smi` reports CUDA Version >= 13.1, use the **cuda13.1** build. Otherwise, use **cuda12.4**.
>
> **ik_llama.cpp** is a [llama.cpp fork](https://github.com/ikawrakow/ik_llama.cpp/) with new quant types. If unsure, use the llama.cpp column.

###### Windows

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-4.7.3-windows-cuda12.4.zip) (891 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-ik-4.7.3-windows-cuda12.4.zip) (1.23 GB) |
| NVIDIA (CUDA 13.1) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-4.7.3-windows-cuda13.1.zip) (816 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-ik-4.7.3-windows-cuda13.1.zip) (1.33 GB) |
| AMD/Intel (Vulkan) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-4.7.3-windows-vulkan.zip) (336 MB) | — |
| AMD (ROCm 7.2) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-4.7.3-windows-rocm7.2.zip) (604 MB) | — |
| CPU only | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-4.7.3-windows-cpu.zip) (318 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-ik-4.7.3-windows-cpu.zip) (334 MB) |

###### Linux

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-4.7.3-linux-cuda12.4.tar.gz) (848 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.7.3/textgen-portable-ik-4.7.3-linux-

_[Truncated at 4000 characters — full notes: https://github.com/oobabooga/textgen/releases/tag/v4.7.3]_

### v4.7.2

- Date: 2026-05-03
- Version: v4.7.2
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.7.2
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.7.2

Updated to v4.7.3

https://github.com/oobabooga/textgen/releases/tag/v4.7.3

### v4.7.1

- Date: 2026-05-03
- Version: v4.7.1
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.7.1
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.7.1

Updated to v4.7.3

https://github.com/oobabooga/textgen/releases/tag/v4.7.3

### v4.7

- Date: 2026-05-03
- Version: v4.7
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.7
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.7

Updated to v4.7.3

https://github.com/oobabooga/textgen/releases/tag/v4.7.3

### v4.6.2

- Date: 2026-04-23
- Version: v4.6.2
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.6.2
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.6.2

##### Changes

- **Tool call confirmation**: Add inline approve/reject/always-approve buttons that appear before each tool call is executed. Enable via the new "Confirm tool calls" checkbox in the Chat tab.
- **Stdio MCP server support**: In addition to HTTP MCP servers, you can now configure local subprocess-based MCP servers via `user_data/mcp.json`, using the same format as Claude Desktop and Cursor. [[Tutorial]](https://github.com/oobabooga/textgen/wiki/Tool-Calling-Tutorial#mcp-servers)
- **`preserve_thinking` chat template parameter**: New UI checkbox and `--preserve-thinking` CLI flag to control whether thinking blocks from prior turns are kept in the context.
- **UI: Sidebars overhaul**: Sidebars now toggle independently and persist their state on page refresh. Default visibility adapts to viewport width.
- llama.cpp: Pass `--draft-min 48` by default for draftless speculative decoding.
- Only show the "Reasoning effort" and "Enable thinking" controls for models whose chat template actually uses them.
- Cache MCP tool discovery to avoid re-querying servers on each generation.
- Add model download branch handling in download_model_wrapper (#7506). Thanks, @Th-Underscore.
- UI: Improve border colors in light theme, fix code block copy button colors and centering, fix code block scrollbar flash during page load, improve past chats menu spacing.

##### Security

- Fix SSRF vulnerabilities in URL fetching: add backslash and userinfo rejection, validate every redirect hop.

##### Bug fixes

- Fix Gemma 4 thinking tags not hidden after tool calls (#7509).
- Fix GPT-OSS channel tokens leaking in UI after tool calls.
- Fix Slider preprocess not handling None from cleared number input. 🆕 - v4.6.1.
- llama.cpp: Fix multimodal by using server's random media marker. 🆕 - v4.6.1.

##### Dependency updates

- Update llama.cpp to https://github.com/ggml-org/llama.cpp/commit/6217b49583432f55014c2a0551f453d42b300530
- Update ik_llama.cpp to https://github.com/ikawrakow/ik_llama.cpp/commit/286ce324baed17c95faec77792eaa6bdb1c7a5f5
- Update ExLlamaV3 to 0.0.30

##### Portable builds

Below you can find self-contained packages that work with GGUF models (llama.cpp) and **require no installation**! Just download the right version for your system, unzip/extract, and run.

> [!NOTE]
> **NVIDIA GPU:** If `nvidia-smi` reports CUDA Version >= 13.1, use the **cuda13.1** build. Otherwise, use **cuda12.4**.
>
> **ik_llama.cpp** is a [llama.cpp fork](https://github.com/ikawrakow/ik_llama.cpp/) with new quant types. If unsure, use the llama.cpp column.

###### Windows

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-4.6.2-windows-cuda12.4.zip) (766 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-ik-4.6.2-windows-cuda12.4.zip) (1.1 GB) |
| NVIDIA (CUDA 13.1) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-4.6.2-windows-cuda13.1.zip) (686 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-ik-4.6.2-windows-cuda13.1.zip) (1.19 GB) |
| AMD/Intel (Vulkan) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-4.6.2-windows-vulkan.zip) (196 MB) | — |
| AMD (ROCm 7.2) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-4.6.2-windows-rocm7.2.zip) (499 MB) | — |
| CPU only | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-4.6.2-windows-cpu.zip) (178 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.6.2/textgen-portable-ik-4.6.2-windows-cpu.zip) (194 MB) |

###### Linux

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download

_[Truncated at 4000 characters — full notes: https://github.com/oobabooga/textgen/releases/tag/v4.6.2]_

### v4.6.1

- Date: 2026-04-23
- Version: v4.6.1
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.6.1
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.6.1

Updated to v4.6.2

https://github.com/oobabooga/textgen/releases/tag/v4.6.2

### v4.6

- Date: 2026-04-23
- Version: v4.6
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.6
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.6

Updated to v4.6.2

https://github.com/oobabooga/textgen/releases/tag/v4.6.2

### v4.5.2

- Date: 2026-04-15
- Version: v4.5.2
- Original notes: https://github.com/oobabooga/textgen/releases/tag/v4.5.2
- Permalink: https://whatsnew.fyi/product/textgen/releases/v4.5.2

##### Changes

- **The project has been renamed to TextGen!** The GitHub URL is now [github.com/oobabooga/textgen](https://github.com/oobabooga/textgen).
- Logits display improvements (#7486). Thanks, @wiger3.
- UI: Add sky-blue color for quoted text in light mode (#7473). Thanks, @Th-Underscore.
- Reduce VRAM peak in prompt logprobs forward pass.

##### Bug fixes

- Fix Gemma-4 tool calling: handle double quotes and newline chars in arguments (#7477). Thanks, @mamei16.
- Fix chat scroll getting stuck on thinking blocks (#7485).
- Prevent Tool Icon SVG Shrinking When Tool Calls Are Long (#7488). Thanks, @mamei16.
- Fix: wrong chat deleted when selection changes before confirm (#7483). Thanks, @lawrence3699.
- Fix bos/eos tokens not being set for models without a chat template. Defaults are now reset before reading model metadata.
- Fix duplicate BOS token being prepended in ExLlamav3.
- Fix version metadata not syncing on Continue (#7492).
- Fix `row_split` not working with ik_llama.cpp — `--split-mode row` is now converted to `--split-mode graph` (#7489).
- Fix "Start reply with" crash (#7497). 🆕 - v4.5.1.
- Fix tool responses with Gemma 4 template (#7498). 🆕 - v4.5.1.
- UI: Fix consecutive thinking blocks rendering with Gemma 4. 🆕 - v4.5.1.
- Fix bos/eos tokens being overwritten after GGUF metadata sets them (#7496).  🆕 - v4.5.2

##### Dependency updates

- Update llama.cpp to https://github.com/ggml-org/llama.cpp/commit/5d14e5d19bd6af7fc38eb92d96aa185e5948a03d
- Update ik_llama.cpp to https://github.com/ikawrakow/ik_llama.cpp/commit/47986f0844a16d1f498e3c8095812a24f969351f

-----

##### Portable builds

Below you can find self-contained packages that work with GGUF models (llama.cpp) and **require no installation**! Just download the right version for your system, unzip/extract, and run.

> [!NOTE]
> **NVIDIA GPU:** If `nvidia-smi` reports CUDA Version >= 13.1, use the **cuda13.1** build. Otherwise, use **cuda12.4**.
>
> **ik_llama.cpp** is a [llama.cpp fork](https://github.com/ikawrakow/ik_llama.cpp/) with new quant types. If unsure, use the llama.cpp column.

###### Windows

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-4.5.2-windows-cuda12.4.zip) (774 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-ik-4.5.2-windows-cuda12.4.zip) (1.09 GB) |
| NVIDIA (CUDA 13.1) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-4.5.2-windows-cuda13.1.zip) (696 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-ik-4.5.2-windows-cuda13.1.zip) (1.19 GB) |
| AMD/Intel (Vulkan) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-4.5.2-windows-vulkan.zip) (209 MB) | — |
| AMD (ROCm 7.2) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-4.5.2-windows-rocm7.2.zip) (517 MB) | — |
| CPU only | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-4.5.2-windows-cpu.zip) (191 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-ik-4.5.2-windows-cpu.zip) (192 MB) |

###### Linux

| GPU/Platform | llama.cpp | ik_llama.cpp |
|---|---|---|
| NVIDIA (CUDA 12.4) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-4.5.2-linux-cuda12.4.tar.gz) (758 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-ik-4.5.2-linux-cuda12.4.tar.gz) (1.09 GB) |
| NVIDIA (CUDA 13.1) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-4.5.2-linux-cuda13.1.tar.gz) (710 MB) | [Download](https://github.com/oobabooga/textgen/releases/download/v4.5.2/textgen-portable-ik-4.5.2-linux-cuda13.1.ta

_[Truncated at 4000 characters — full notes: https://github.com/oobabooga/textgen/releases/tag/v4.5.2]_