Works with Open WebUI

Open WebUI, running on your Mac

Open WebUI talks to ToolPiper as an OpenAI-compatible connection, so the chat UI is remote and the inference is not.

Download ToolPiper Read the API docs

Free, Apple Silicon, signed. The local model runner has no caps and needs no account.

Setup

  1. Install ToolPiper and launch it once. The local API listens on port 9998.
  2. In Open WebUI, add an OpenAI connection with the base URL below and a ToolPiper Developer Token as the API key.
  3. The model list populates from what is resident on the Mac.
http://localhost:9998/v1

Prompts, responses and files stay on the machine. There is no key to rotate and no per-token cost. Open WebUI talks to ToolPiper over its local OpenAI-compatible API on port 9998.