AX Engine 7.5.x ships dense 27B past the DRAM ceiling.See the numbers
AX Engine.
Get started

AX ENGINE / DOCUMENTATION

CLI workflows

Install the command-line tools, inspect your setup, and serve an existing model directory. The CLI and GUI can be installed independently.

Install and diagnose

If you use Homebrew, install the release formula below. It includes the native CLI, server, benchmark tools and pinned MLX runtime. It does not install the GUI. Use doctor to inspect the installation and which -a to find competing copies on PATH. A standalone archive is also available in the installation guide.

Terminal
brew install defai-digital/tap/ax-engine
ax-engine doctor
which -a ax-engine

Serve a prepared local model

Replace the example directory with a complete, supported MLX model folder on your Mac. Keep the quotes if its path contains spaces. Serving a prepared local directory needs no Python or Xcode. Leave this Terminal running while clients connect; Control-C stops the foreground server.

Terminal
ax-engine serve "$HOME/Models/my-model" --port 31418

Enable online model downloads

For Homebrew and standalone releases that use the Python download helpers, install Python 3.13 and create the environment below. AX_ENGINE_PYTHON selects the helper without replacing the native CLI. These exports apply to the current Terminal; set them again in a new Terminal or save the export in your shell configuration. The GUI distribution does not need this setup.

Terminal
brew install python@3.13 &&
python3.13 -m venv "$HOME/.local/share/ax-engine/download-env" &&
"$HOME/.local/share/ax-engine/download-env/bin/python" -m pip install huggingface-hub &&
export AX_ENGINE_PYTHON="$HOME/.local/share/ax-engine/download-env/bin/python"

Download an AutomatosX pack by alias

List the installed release’s managed aliases first. This compact-model example downloads the AutomatosX Qwen 3.5 9B catalog entry, then serves its cached snapshot. Check the current alias metadata and available memory before starting. --offline prevents a serve command from downloading a missing snapshot.

Terminal
ax-engine download --list &&
ax-engine download ax-qwen3.5-9b &&
ax-engine serve ax-qwen3.5-9b --offline --port 31418

Example: a third-party model through the CLI

Update the CLI independently

Use Homebrew to update a Homebrew installation. Rerunning the GUI installer does not update this CLI. If doctor reports an unexpected version, check which -a ax-engine and ensure the intended installation comes first on PATH.

Terminal
brew update && brew upgrade defai-digital/tap/ax-engine

Detailed reference