---
title: "Mac mini M5 Pro: What AI Models Can It Run? | ModelPiper"
description: "Local AI on the M5 Pro Mac mini: 307 GB/s memory bandwidth and 24 to 64 GB of unified memory. See which LLMs fit, at which quantization, and how fast they run."
canonical: "https://modelpiper.com/mac-mini/m5-pro"
---

# Mac mini M5 Pro: What AI Models Can It Run? | ModelPiper

> Local AI on the M5 Pro Mac mini: 307 GB/s memory bandwidth and 24 to 64 GB of unified memory. See which LLMs fit, at which quantization, and how fast they run.

[← All Mac mini models](/mac-mini)

# Mac mini M5 Pro

The M5 Pro Mac mini runs local models at 307 GB/s of memory bandwidth with 24 to 64 GB of unified memory. On Apple Silicon that memory is shared with the GPU, so the whole pool is available for weights: at 64 GB you can hold roughly a 85B dense model at Q4. The Pro roughly doubles the base chip's memory bus. That moves mid-size models from usable to comfortable without moving you into desktop money.

By [Ben Racicot](/about#founder), Founder & Lead Engineer— Updated 2026-08-21

## Specifications

ChipApple M5 Pro

CPU cores15 or 18

GPU cores16 or 20

Unified memory24, 48, or 64 GB

Memory bandwidth307 GB/s

Neural Engine38 TOPS

Released2026

AvailabilitySold new by Apple

Memory bandwidth is faster than 50% of the Apple Silicon chips shipped in a Mac, against a 1228 GB/s peak.

Its memory ceiling is above 45% of them, against a 512 GB peak.

## Pick your configuration

Every option Apple sells with this chip. The model list below recomputes against the one you pick.

GPU cores

16-core 20-core

Unified memory

24 GB48 GB64 GB

## What each memory option runs

Unified memory is the ceiling and it is soldered, so this is the decision you cannot revisit.

[24 GB](#ram-24gb)[48 GB](#ram-48gb)[64 GB](#ram-64gb)

### 24 GB unified memory

21 GB usable for weights · 307 GB/s

6,032 of 6,563 models fit, and 5,271 of them run with headroom rather than as a squeeze.

Largest model at Q4

[W2 31B A3B dLLM Base preview](/fit/whaletechai-w2-31b-a3b-dllm-base-preview) · 31.12B

Best all-round pick

[Kimi K3 DSpark](/fit/radixark-kimi-k3-dspark) · Q8\_0 · ~71 tok/s

### 48 GB unified memory

42 GB usable for weights · 307 GB/s

6,273 of 6,563 models fit, and 6,033 of them run with headroom rather than as a squeeze.

Largest model at Q4

[Yi 34Bx2 MoE 60B DPO](/fit/cloudyu-yi-34bx2-moe-60b-dpo) · 60.81B

Best all-round pick

[Kimi K3 DSpark](/fit/radixark-kimi-k3-dspark) · Q8\_0 · ~71 tok/s

### 64 GB unified memory

56 GB usable for weights · 307 GB/s

6,357 of 6,563 models fit, and 6,086 of them run with headroom rather than as a squeeze.

Largest model at Q4

[Hy3 REAP 48e](/fit/sapidlabs-hy3-reap-48e) · 84.02B

Best all-round pick

[Kimi K3 DSpark](/fit/radixark-kimi-k3-dspark) · Q8\_0 · ~71 tok/s

## What a 24 GB M5 Pro Mac mini can run

Every model in the database against this exact configuration, at 307 GB/s. Ratings and speeds are the same numbers the model pages show.

All Categories

Show All

All Sizes

 Best Fit

Showing 6563 of 6563 models

[Kimi K3 DSpark](/fit/radixark-kimi-k3-dspark?chip=m5-pro&ram=24)

General · radixark · 2026-07-27

Q8\_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.25B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniCPM5 1B](/fit/openbmb-minicpm5-1b?chip=m5-pro&ram=24)

General · openbmb · 2026-05-21

Q8\_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[OTel LLM 8B A1B IT](/fit/farbodtavakkoli-otel-llm-8b-a1b-it?chip=m5-pro&ram=24)

General · farbodtavakkoli · 2026-06-17

Q8\_0Excellent

10.8 GB45% of RAMBenchmark needed9.23B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 8B A1B](/fit/liquidai-lfm2-5-8b-a1b?chip=m5-pro&ram=24)

General · Liquid AI · 2026-05-28

Q8\_0Excellent

9.9 GB41% of RAMBenchmark needed8.47B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 2.6B](/fit/liquidai-lfm2-5-2-6b?chip=m5-pro&ram=24)

General · Liquid AI · 2026-07-28

Q8\_0Excellent

3.5 GB15% of RAM~60 tok/sEstimated2.7B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 230M](/fit/liquidai-lfm2-5-230m?chip=m5-pro&ram=24)

General · Liquid AI · 2026-06-24

Q8\_0Excellent

0.8 GB3% of RAM~699 tok/sEstimated0.23B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[JOSIE 2 2B OSS](/fit/goekdeniz-guelmez-josie-2-2b-oss?chip=m5-pro&ram=24)

General · goekdeniz-guelmez · 2026-07-31

Q8\_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[minicpm5 1b hermes toolhv1](/fit/ktruestory-minicpm5-1b-hermes-toolhv1?chip=m5-pro&ram=24)

General · ktruestory · 2026-05-28

Q8\_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[FrankenCPM 4x1B A2B](/fit/petrouil-frankencpm-4x1b-a2b?chip=m5-pro&ram=24)

General · petrouil · 2026-07-23

Q8\_0Excellent

3.4 GB14% of RAMBenchmark needed2.61B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[VibeThinker 3B](/fit/weiboai-vibethinker-3b?chip=m5-pro&ram=24)

General · weiboai · 2026-06-12

Q8\_0Excellent

3.9 GB16% of RAM~52 tok/sEstimated3.09B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 350M](/fit/liquidai-lfm2-5-350m?chip=m5-pro&ram=24)

General · Liquid AI · 2026-03-31

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.8\_4B\_Distilled\_GGUF](/fit/ma7ee7-qwen3-8_4b_distilled_gguf?chip=m5-pro&ram=24)

General · ma7ee7 · 2026-07-30

Q8\_0Excellent

4.0 GB17% of RAM~51 tok/sEstimated3.13B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.5 0.8B](/fit/qwen-qwen3-5-0-8b?chip=m5-pro&ram=24)

Multimodal · Alibaba · 2026-02-28

Q8\_0Excellent

1.5 GB6% of RAM~185 tok/sEstimated0.87B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.5 2B](/fit/qwen-qwen3-5-2b?chip=m5-pro&ram=24)

Multimodal · Alibaba · 2026-02-28

Q8\_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.5 0.8B Base](/fit/qwen-qwen3-5-0-8b-base?chip=m5-pro&ram=24)

Multimodal · Alibaba · 2026-02-28

Q8\_0Excellent

1.5 GB6% of RAM~185 tok/sEstimated0.87B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.5 2B Base](/fit/qwen-qwen3-5-2b-base?chip=m5-pro&ram=24)

Multimodal · Alibaba · 2026-02-28

Q8\_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 4.1 3b](/fit/ibm-granite-granite-4-1-3b?chip=m5-pro&ram=24)

General · ibm-granite · 2026-04-06

Q8\_0Excellent

4.3 GB18% of RAM~47 tok/sEstimated3.4B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Agents A1 4B](/fit/internscience-agents-a1-4b?chip=m5-pro&ram=24)

General · internscience · 2026-07-13

Q8\_0Excellent

5.6 GB23% of RAM~35 tok/sEstimated4.54B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite vision 4.1 4b](/fit/ibm-granite-granite-vision-4-1-4b?chip=m5-pro&ram=24)

Multimodal · ibm-granite · 2026-04-16

Q8\_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Nanbeige4.2 3B](/fit/nanbeige-nanbeige4-2-3b?chip=m5-pro&ram=24)

General · nanbeige · 2026-07-21

Q8\_0Excellent

5.2 GB21% of RAM~39 tok/sEstimated4.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[pii guard turkish 270m](/fit/cagrigungor-pii-guard-turkish-270m?chip=m5-pro&ram=24)

General · cagrigungor · 2026-08-06

Q8\_0Excellent

0.8 GB3% of RAM~596 tok/sEstimated0.27B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.5 4B](/fit/qwen-qwen3-5-4b?chip=m5-pro&ram=24)

Multimodal · Alibaba · 2026-02-27

Q8\_0Excellent

5.7 GB24% of RAM~35 tok/sEstimated4.66B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[gemma 4 E2B it](/fit/google-gemma-4-e2b-it?chip=m5-pro&ram=24)

Multimodal · Google · 2026-03-02

Q8\_0Excellent

6.2 GB26% of RAM~31 tok/sEstimated5.12B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.5 4B Base](/fit/qwen-qwen3-5-4b-base?chip=m5-pro&ram=24)

Multimodal · Alibaba · 2026-02-27

Q8\_0Excellent

5.7 GB24% of RAM~35 tok/sEstimated4.66B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 VL 1.6B](/fit/liquidai-lfm2-5-vl-1-6b?chip=m5-pro&ram=24)

Multimodal · Liquid AI · 2026-01-05

Q8\_0Excellent

2.3 GB10% of RAM~101 tok/sEstimated1.6B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 1.2B Thinking](/fit/liquidai-lfm2-5-1-2b-thinking?chip=m5-pro&ram=24)

General · Liquid AI · 2026-01-20

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[OneReason 0.8B pretrain competition](/fit/openonerec-onereason-0-8b-pretrain-competition?chip=m5-pro&ram=24)

Reasoning · openonerec · 2026-06-09

Q8\_0Excellent

1.4 GB6% of RAM~201 tok/sEstimated0.8B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 1.2B Base](/fit/liquidai-lfm2-5-1-2b-base?chip=m5-pro&ram=24)

General · Liquid AI · 2026-01-05

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 1.2B JP](/fit/liquidai-lfm2-5-1-2b-jp?chip=m5-pro&ram=24)

General · Liquid AI · 2026-01-04

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 2.6B Exp](/fit/liquidai-lfm2-2-6b-exp?chip=m5-pro&ram=24)

General · Liquid AI · 2025-12-25

Q8\_0Excellent

3.4 GB14% of RAM~63 tok/sEstimated2.57B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 2.6B Transcript](/fit/liquidai-lfm2-2-6b-transcript?chip=m5-pro&ram=24)

General · Liquid AI · 2026-01-05

Q8\_0Excellent

3.4 GB14% of RAM~63 tok/sEstimated2.57B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 1.2B Instruct](/fit/liquidai-lfm2-5-1-2b-instruct?chip=m5-pro&ram=24)

Chat · Liquid AI · 2026-01-06

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 ColBERT 350M](/fit/liquidai-lfm2-colbert-350m?chip=m5-pro&ram=24)

General · Liquid AI · 2025-10-28

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 8B A1B](/fit/liquidai-lfm2-8b-a1b?chip=m5-pro&ram=24)

General · Liquid AI · 2025-10-07

Q8\_0Excellent

9.8 GB41% of RAMBenchmark needed8.34B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[AI21 Jamba2 3B](/fit/ai21labs-ai21-jamba2-3b?chip=m5-pro&ram=24)

General · ai21labs · 2026-01-06

Q8\_0Excellent

3.9 GB16% of RAMBenchmark needed3.03B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Nemotron Labs Diffusion 3B](/fit/nvidia-nemotron-labs-diffusion-3b?chip=m5-pro&ram=24)

General · nvidia · 2026-03-02

Q8\_0Excellent

4.8 GB20% of RAM~42 tok/sEstimated3.83B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Lumma 0.6B Extract](/fit/frontiersmind-lumma-0-6b-extract?chip=m5-pro&ram=24)

General · frontiersmind · 2026-08-03

Q8\_0Excellent

1.2 GB5% of RAM~247 tok/sEstimated0.65B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Gemma 3 4B VL it Gemini Pro Heretic Uncensored Thinking](/fit/davidau-gemma-3-4b-vl-it-gemini-pro-heretic-uncensored-thinking?chip=m5-pro&ram=24)

Multimodal · davidau · 2026-02-02

Q8\_0Excellent

5.3 GB22% of RAM~37 tok/sEstimated4.3B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Ilama 3.2 1B](/fit/hmellor-ilama-3-2-1b?chip=m5-pro&ram=24)

General · hmellor · 2025-07-22

Q8\_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 4.0 h tiny](/fit/ibm-granite-granite-4-0-h-tiny?chip=m5-pro&ram=24)

General · ibm-granite · 2025-09-16

Q8\_0Excellent

8.2 GB34% of RAMBenchmark needed6.94B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 VL 450M](/fit/liquidai-lfm2-vl-450m?chip=m5-pro&ram=24)

Multimodal · Liquid AI · 2025-08-12

Q8\_0Excellent

1.0 GB4% of RAM~357 tok/sEstimated0.45B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[OneRec 1.7B](/fit/openonerec-onerec-1-7b?chip=m5-pro&ram=24)

General · openonerec · 2025-12-30

Q8\_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Ouro 1.4B](/fit/bytedance-ouro-1-4b?chip=m5-pro&ram=24)

General · bytedance · 2025-10-28

Q8\_0Excellent

2.1 GB9% of RAM~112 tok/sEstimated1.43B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 VL 1.6B](/fit/liquidai-lfm2-vl-1-6b?chip=m5-pro&ram=24)

Multimodal · Liquid AI · 2025-08-12

Q8\_0Excellent

2.3 GB9% of RAM~102 tok/sEstimated1.58B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 VL 3B](/fit/liquidai-lfm2-vl-3b?chip=m5-pro&ram=24)

Multimodal · Liquid AI · 2025-10-22

Q8\_0Excellent

3.8 GB16% of RAM~54 tok/sEstimated3B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 2.6B](/fit/liquidai-lfm2-2-6b?chip=m5-pro&ram=24)

General · Liquid AI · 2025-09-22

Q8\_0Excellent

3.4 GB14% of RAM~63 tok/sEstimated2.57B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 350M PII Extract JP](/fit/liquidai-lfm2-350m-pii-extract-jp?chip=m5-pro&ram=24)

General · Liquid AI · 2025-09-30

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 1.2B Extract](/fit/liquidai-lfm2-1-2b-extract?chip=m5-pro&ram=24)

General · Liquid AI · 2025-08-22

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 350M ENJP MT](/fit/liquidai-lfm2-350m-enjp-mt?chip=m5-pro&ram=24)

General · Liquid AI · 2025-09-03

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 1.2B RAG](/fit/liquidai-lfm2-1-2b-rag?chip=m5-pro&ram=24)

General · Liquid AI · 2025-09-03

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 350M Math](/fit/liquidai-lfm2-350m-math?chip=m5-pro&ram=24)

General · Liquid AI · 2025-08-25

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 350M Extract](/fit/liquidai-lfm2-350m-extract?chip=m5-pro&ram=24)

General · Liquid AI · 2025-09-03

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 1.2B Tool](/fit/liquidai-lfm2-1-2b-tool?chip=m5-pro&ram=24)

General · Liquid AI · 2025-09-03

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[VAETKI 7B A1B](/fit/nc-ai-consortium-vaetki-7b-a1b?chip=m5-pro&ram=24)

General · NCAI · 2025-12-29

Q8\_0Excellent

8.6 GB36% of RAMBenchmark needed7.25B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[typhoon2.5 qwen3 4b](/fit/typhoon-ai-typhoon2-5-qwen3-4b?chip=m5-pro&ram=24)

General · typhoon-ai · 2025-09-23

Q8\_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4.02B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 4.0 tiny preview](/fit/ibm-granite-granite-4-0-tiny-preview?chip=m5-pro&ram=24)

General · ibm-granite · 2025-04-30

Q8\_0Excellent

7.9 GB33% of RAMBenchmark needed6.67B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 1.2B](/fit/liquidai-lfm2-1-2b?chip=m5-pro&ram=24)

General · Liquid AI · 2025-07-10

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 4.0 micro](/fit/ibm-granite-granite-4-0-micro?chip=m5-pro&ram=24)

General · ibm-granite · 2025-09-16

Q8\_0Excellent

4.3 GB18% of RAM~47 tok/sEstimated3.4B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[PARD Llama 3.2 1B](/fit/amd-pard-llama-3-2-1b?chip=m5-pro&ram=24)

General · amd · 2025-05-17

Q8\_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[newsvibe categories multilingual llama 1b](/fit/stefanruseti-newsvibe-categories-multilingual-llama-1b?chip=m5-pro&ram=24)

General · stefanruseti · 2025-06-04

Q8\_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 4.0 h micro](/fit/ibm-granite-granite-4-0-h-micro?chip=m5-pro&ram=24)

General · ibm-granite · 2025-09-16

Q8\_0Excellent

4.1 GB17% of RAM~50 tok/sEstimated3.19B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 4B DFlash b16](/fit/z-lab-qwen3-4b-dflash-b16?chip=m5-pro&ram=24)

General · z-lab · 2026-01-04

Q8\_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 4.0 350m base](/fit/ibm-granite-granite-4-0-350m-base?chip=m5-pro&ram=24)

General · ibm-granite · 2025-10-07

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[EXAONE 4.0 1.2B](/fit/lgai-exaone-exaone-4-0-1-2b?chip=m5-pro&ram=24)

General · lgai-exaone · 2025-07-11

Q8\_0Excellent

1.9 GB8% of RAM~126 tok/sEstimated1.28B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 350M](/fit/liquidai-lfm2-350m?chip=m5-pro&ram=24)

General · Liquid AI · 2025-07-10

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 700M](/fit/liquidai-lfm2-700m?chip=m5-pro&ram=24)

General · Liquid AI · 2025-07-10

Q8\_0Excellent

1.3 GB6% of RAM~217 tok/sEstimated0.74B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[VAETKI VL 7B A1B](/fit/nc-ai-consortium-vaetki-vl-7b-a1b?chip=m5-pro&ram=24)

Multimodal · NCAI · 2025-12-29

Q8\_0Excellent

9.0 GB37% of RAMBenchmark needed7.58B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[DeepSeek R1 Distill Qwen 1.5B](/fit/deepseek-ai-deepseek-r1-distill-qwen-1-5b?chip=m5-pro&ram=24)

Reasoning · DeepSeek · 2025-01-20

Q8\_0Excellent

2.5 GB10% of RAM~90 tok/sEstimated1.78B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 4B Thinking 2507](/fit/qwen-qwen3-4b-thinking-2507?chip=m5-pro&ram=24)

General · Alibaba · 2025-08-05

Q8\_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4.02B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3Guard Gen 0.6B](/fit/qwen-qwen3guard-gen-0-6b?chip=m5-pro&ram=24)

General · Alibaba · 2025-09-23

Q8\_0Excellent

1.3 GB6% of RAM~214 tok/sEstimated0.75B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Phi 4 mini reasoning](/fit/microsoft-phi-4-mini-reasoning?chip=m5-pro&ram=24)

Reasoning · Microsoft · 2025-04-29

Q8\_0Excellent

4.8 GB20% of RAM~42 tok/sEstimated3.84B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[plamo 2 1b](/fit/pfnet-plamo-2-1b?chip=m5-pro&ram=24)

General · pfnet · 2025-02-05

Q8\_0Excellent

1.9 GB8% of RAM~125 tok/sEstimated1.29B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[academic ds 9B](/fit/bytedance-seed-academic-ds-9b?chip=m5-pro&ram=24)

General · bytedance-seed · 2025-04-09

Q8\_0Excellent

11.0 GB46% of RAMBenchmark needed9.37B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[HRM Text 1B](/fit/sapientinc-hrm-text-1b?chip=m5-pro&ram=24)

General · sapientinc · 2026-05-17

Q8\_0Excellent

1.8 GB8% of RAM~136 tok/sEstimated1.18B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Jan nano 128k](/fit/menlo-jan-nano-128k?chip=m5-pro&ram=24)

General · menlo · 2025-06-25

Q8\_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4.02B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[NEXUS Medical](/fit/fableforge-ai-nexus-medical?chip=m5-pro&ram=24)

General · fableforge-ai · 2026-07-05

Q8\_0Excellent

2.2 GB9% of RAM~104 tok/sEstimated1.54B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MicroLlama v2](/fit/viorikaai-org-microllama-v2?chip=m5-pro&ram=24)

General · viorikaai-org · 2026-07-05

Q8\_0Excellent

0.6 GB2% of RAM~3,216 tok/sEstimated0.05B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled v2](/fit/jackrong-qwen3-5-9b-claude-4-6-opus-reasoning-distilled-v2?chip=m5-pro&ram=24)

Reasoning · jackrong · 2026-03-16

Q8\_0Excellent

11.3 GB47% of RAM~17 tok/sEstimated9.65B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[BananaMind 2 Nano](/fit/bananamind-bananamind-2-nano?chip=m5-pro&ram=24)

General · bananamind · 2026-07-17

Q8\_0Excellent

0.5 GB2% of RAM~16,081 tok/sEstimated0.01B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[EXAONE Deep 2.4B](/fit/lgai-exaone-exaone-deep-2-4b?chip=m5-pro&ram=24)

General · lgai-exaone · 2025-03-12

Q8\_0Excellent

3.2 GB13% of RAM~67 tok/sEstimated2.41B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Nexus Erebus 50M](/fit/maliosdark-nexus-erebus-50m?chip=m5-pro&ram=24)

General · maliosdark · 2026-07-09

Q8\_0Excellent

0.6 GB2% of RAM~3,216 tok/sEstimated0.05B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Jolia](/fit/raidium-jolia?chip=m5-pro&ram=24)

General · raidium · 2026-06-15

Q8\_0Excellent

0.5 GB2% of RAM~8,040 tok/sEstimated0.02B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[embeddinggemma GTAIDE 300m 2605](/fit/taide-embeddinggemma-gtaide-300m-2605?chip=m5-pro&ram=24)

Embedding · taide · 2026-06-12

Q8\_0Excellent

0.8 GB3% of RAM~536 tok/sEstimated0.3B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 0.6B](/fit/qwen-qwen3-0-6b?chip=m5-pro&ram=24)

General · Alibaba · 2025-04-27

Q8\_0Excellent

1.3 GB6% of RAM~214 tok/sEstimated0.75B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 1.7B](/fit/qwen-qwen3-1-7b?chip=m5-pro&ram=24)

General · Alibaba · 2025-04-27

Q8\_0Excellent

2.8 GB12% of RAM~79 tok/sEstimated2.03B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen2.5 VL 3B Instruct](/fit/qwen-qwen2-5-vl-3b-instruct?chip=m5-pro&ram=24)

Multimodal · Alibaba · 2025-01-26

Q8\_0Excellent

4.7 GB20% of RAM~43 tok/sEstimated3.75B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[gemma 4 E4B it](/fit/google-gemma-4-e4b-it?chip=m5-pro&ram=24)

Multimodal · Google · 2026-03-02

Q8\_0Excellent

9.4 GB39% of RAM~20 tok/sEstimated8B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[GLM OCR](/fit/zai-org-glm-ocr?chip=m5-pro&ram=24)

Multimodal · zai-org

Q8\_0Excellent

2.0 GB8% of RAM~121 tok/sEstimated1.33B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 VL 2B Instruct](/fit/qwen-qwen3-vl-2b-instruct?chip=m5-pro&ram=24)

Multimodal · Alibaba

Q8\_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[surya ocr 2](/fit/datalab-to-surya-ocr-2?chip=m5-pro&ram=24)

Multimodal · datalab-to

Q8\_0Excellent

1.3 GB5% of RAM~233 tok/sEstimated0.69B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 1.7B Base](/fit/qwen-qwen3-1-7b-base?chip=m5-pro&ram=24)

General · Alibaba · 2025-04-28

Q8\_0Excellent

2.4 GB10% of RAM~93 tok/sEstimated1.72B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[SmolLM3 3B](/fit/huggingfacetb-smollm3-3b?chip=m5-pro&ram=24)

General · huggingfacetb · 2025-07-08

Q8\_0Excellent

3.9 GB16% of RAM~52 tok/sEstimated3.08B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniCPM V 4.6](/fit/openbmb-minicpm-v-4-6?chip=m5-pro&ram=24)

Multimodal · openbmb

Q8\_0Excellent

2.0 GB8% of RAM~124 tok/sEstimated1.3B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 0.6B Base](/fit/qwen-qwen3-0-6b-base?chip=m5-pro&ram=24)

General · Alibaba · 2025-04-28

Q8\_0Excellent

1.2 GB5% of RAM~268 tok/sEstimated0.6B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[dots.mocr](/fit/rednote-hilab-dots-mocr?chip=m5-pro&ram=24)

Multimodal · rednote-hilab

Q8\_0Excellent

3.9 GB16% of RAM~53 tok/sEstimated3.04B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[HunyuanOCR](/fit/tencent-hunyuanocr?chip=m5-pro&ram=24)

Multimodal · tencent

Q8\_0Excellent

1.7 GB7% of RAMBenchmark needed1.12B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[dots.ocr](/fit/dots-studio-dots-ocr?chip=m5-pro&ram=24)

Multimodal · dots-studio

Q8\_0Excellent

3.9 GB16% of RAM~53 tok/sEstimated3.04B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[distil lfm25 shellper](/fit/distil-labs-distil-lfm25-shellper?chip=m5-pro&ram=24)

General · distil-labs

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[OTel LLM 1.2B IT](/fit/farbodtavakkoli-otel-llm-1-2b-it?chip=m5-pro&ram=24)

General · farbodtavakkoli

Q8\_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Rax 4.5](/fit/raxcore-dev-rax-4-5?chip=m5-pro&ram=24)

Multimodal · raxcore-dev

Q8\_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[SmolLM3 3B Base](/fit/huggingfacetb-smollm3-3b-base?chip=m5-pro&ram=24)

General · huggingfacetb · 2025-06-19

Q8\_0Excellent

3.9 GB16% of RAM~52 tok/sEstimated3.08B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[ReaderLM v2](/fit/jinaai-readerlm-v2?chip=m5-pro&ram=24)

General · jinaai

Q8\_0Excellent

2.2 GB9% of RAM~104 tok/sEstimated1.54B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[OvisOCR2](/fit/ath-maas-ovisocr2?chip=m5-pro&ram=24)

Multimodal · ath-maas

Q8\_0Excellent

1.4 GB6% of RAM~189 tok/sEstimated0.85B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 VL 2B Thinking](/fit/qwen-qwen3-vl-2b-thinking?chip=m5-pro&ram=24)

Multimodal · Alibaba

Q8\_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 VL 450M](/fit/liquidai-lfm2-5-vl-450m?chip=m5-pro&ram=24)

Multimodal · Liquid AI

Q8\_0Excellent

1.0 GB4% of RAM~357 tok/sEstimated0.45B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[typhoon ocr1.5 2b](/fit/typhoon-ai-typhoon-ocr1-5-2b?chip=m5-pro&ram=24)

Reasoning · typhoon-ai

Q8\_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[PaddleOCR VL 1.6](/fit/paddlepaddle-paddleocr-vl-1-6?chip=m5-pro&ram=24)

Multimodal · paddlepaddle

Q8\_0Excellent

1.6 GB7% of RAM~168 tok/sEstimated0.96B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 350M Base](/fit/liquidai-lfm2-5-350m-base?chip=m5-pro&ram=24)

General · Liquid AI

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[alloma 1B Instruct](/fit/uzlm-alloma-1b-instruct?chip=m5-pro&ram=24)

Chat · uzlm · 2025-09-03

Q8\_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[PaddleOCR VL](/fit/paddlepaddle-paddleocr-vl?chip=m5-pro&ram=24)

Multimodal · paddlepaddle

Q8\_0Excellent

1.6 GB7% of RAM~168 tok/sEstimated0.96B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Llama 3.2 3B Instruct pythonic](/fit/baseten-llama-3-2-3b-instruct-pythonic?chip=m5-pro&ram=24)

Chat · baseten · 2025-09-12

Q8\_0Excellent

4.1 GB17% of RAM~50 tok/sEstimated3.21B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Orpo Llama 3.2 1B 15k](/fit/adamlucek-orpo-llama-3-2-1b-15k?chip=m5-pro&ram=24)

General · adamlucek

Q8\_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[llama 3.2 1b code instruct](/fit/shahriarferdoush-llama-3-2-1b-code-instruct?chip=m5-pro&ram=24)

Coding · shahriarferdoush

Q8\_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Llama 3.2 1B Aegis SFT DPO](/fit/ahczhg-llama-3-2-1b-aegis-sft-dpo?chip=m5-pro&ram=24)

General · ahczhg

Q8\_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 0.6B ONNX](/fit/onnx-community-qwen3-0-6b-onnx?chip=m5-pro&ram=24)

General · onnx-community · 2025-04-28

Q8\_0Excellent

1.0 GB4% of RAM~357 tok/sEstimated0.45B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Tashkeel 700M](/fit/etherll-tashkeel-700m?chip=m5-pro&ram=24)

General · etherll

Q8\_0Excellent

1.3 GB6% of RAM~217 tok/sEstimated0.74B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[ERNIE 4.5 0.3B PT](/fit/baidu-ernie-4-5-0-3b-pt?chip=m5-pro&ram=24)

General · baidu

Q8\_0Excellent

0.9 GB4% of RAM~447 tok/sEstimated0.36B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 1.2B JP 202606](/fit/liquidai-lfm2-5-1-2b-jp-202606?chip=m5-pro&ram=24)

General · Liquid AI

Q8\_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniCPM5 1B Base](/fit/openbmb-minicpm5-1b-base?chip=m5-pro&ram=24)

General · openbmb

Q8\_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[VideoLLaMA3 2B Image HF](/fit/lkhl-videollama3-2b-image-hf?chip=m5-pro&ram=24)

Multimodal · lkhl

Q8\_0Excellent

2.7 GB11% of RAM~82 tok/sEstimated1.96B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Infinity Parser2 Flash](/fit/infly-infinity-parser2-flash?chip=m5-pro&ram=24)

Multimodal · infly

Q8\_0Excellent

3.0 GB12% of RAM~73 tok/sEstimated2.21B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Llama 3.2 1B flax](/fit/benjamin-llama-3-2-1b-flax?chip=m5-pro&ram=24)

General · benjamin

Q8\_0Excellent

1.7 GB7% of RAM~150 tok/sEstimated1.07B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2 1.2B ONNX](/fit/lemonelabs-lfm2-1-2b-onnx?chip=m5-pro&ram=24)

General · lemonelabs

Q8\_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniCPM4 0.5B](/fit/openbmb-minicpm4-0-5b?chip=m5-pro&ram=24)

General · openbmb · 2025-06-05

Q8\_0Excellent

1.0 GB4% of RAM~374 tok/sEstimated0.43B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[OTel LLM 20B IT](/fit/farbodtavakkoli-otel-llm-20b-it?chip=m5-pro&ram=24)

General · farbodtavakkoli

Q8\_0Excellent

2.5 GB10% of RAMBenchmark needed1.77B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 1.2B Nova Function Calling](/fit/novachronoai-lfm2-5-1-2b-nova-function-calling-gguf?chip=m5-pro&ram=24)

General · novachronoai

Q8\_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[PaddleOCR VL 1.5](/fit/paddlepaddle-paddleocr-vl-1-5?chip=m5-pro&ram=24)

Multimodal · paddlepaddle

Q8\_0Excellent

1.6 GB7% of RAM~168 tok/sEstimated0.96B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 4B Kimi2.5 Reasoning Distilled](/fit/khazarai-qwen3-4b-kimi2-5-reasoning-distilled-gguf?chip=m5-pro&ram=24)

Reasoning · khazarai

Q8\_0Excellent

4.0 GB17% of RAM~51 tok/sEstimated3.13B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[FastVLM 0.5B](/fit/kamilamila-fastvlm-0-5b?chip=m5-pro&ram=24)

General · kamilamila

Q8\_0Excellent

1.2 GB5% of RAM~259 tok/sEstimated0.62B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[ThinkPRM 1.5B](/fit/launch-thinkprm-1-5b?chip=m5-pro&ram=24)

General · launch

Q8\_0Excellent

2.5 GB10% of RAM~90 tok/sEstimated1.78B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Trinity Nano Preview](/fit/arcee-ai-trinity-nano-preview?chip=m5-pro&ram=24)

General · arcee-ai

Q8\_0Excellent

7.3 GB31% of RAMBenchmark needed6.12B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[transcription cleanup llama3.2 1b](/fit/getonit-transcription-cleanup-llama3-2-1b?chip=m5-pro&ram=24)

General · getonit

Q8\_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 1.2B JP 202606 ONNX](/fit/liquidai-lfm2-5-1-2b-jp-202606-onnx?chip=m5-pro&ram=24)

General · Liquid AI

Q8\_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniCPM5 1B Claude Opus Fable5 V2 Thinking heretic](/fit/saidutta69-minicpm5-1b-claude-opus-fable5-v2-thinking-heretic?chip=m5-pro&ram=24)

General · saidutta69

Q8\_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[DeepScaleR 1.5B Preview](/fit/agentica-org-deepscaler-1-5b-preview?chip=m5-pro&ram=24)

General · agentica-org

Q8\_0Excellent

2.5 GB10% of RAM~90 tok/sEstimated1.78B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[SEX\_ROLEPLAY 3.2 1B](/fit/novaciano-sex_roleplay-3-2-1b?chip=m5-pro&ram=24)

General · novaciano

Q8\_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Qwen3 VL 2B RRG SFT](/fit/dmusingu-qwen3-vl-2b-rrg-sft?chip=m5-pro&ram=24)

General · dmusingu

Q8\_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[JiRackTernary\_1b](/fit/kgrabko-jirackternary_1b?chip=m5-pro&ram=24)

General · kgrabko

Q8\_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[LFM2.5 350M home assistant sft](/fit/ordenwills-lfm2-5-350m-home-assistant-sft?chip=m5-pro&ram=24)

General · ordenwills

Q8\_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Recurrent Llama 3.2 train recurrence 32](/fit/smcleish-recurrent-llama-3-2-train-recurrence-32?chip=m5-pro&ram=24)

General · smcleish

Q8\_0Excellent

2.1 GB9% of RAM~116 tok/sEstimated1.39B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[llama3.2\_1b\_2025\_uncensored\_v2](/fit/carsenk-llama3-2_1b_2025_uncensored_v2?chip=m5-pro&ram=24)

General · carsenk

Q8\_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[OpenReasoning Nemotron 1.5B](/fit/nvidia-openreasoning-nemotron-1-5b?chip=m5-pro&ram=24)

Reasoning · nvidia

Q8\_0Excellent

2.2 GB9% of RAM~104 tok/sEstimated1.54B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Miss MARTHA hot POCKET edition 2B OMNI](/fit/zero-point-ai-miss-martha-hot-pocket-edition-2b-omni?chip=m5-pro&ram=24)

Multimodal · zero-point-ai

Q8\_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniCPM V 4.6 Thinking](/fit/openbmb-minicpm-v-4-6-thinking?chip=m5-pro&ram=24)

General · openbmb

Q8\_0Excellent

2.0 GB8% of RAM~124 tok/sEstimated1.3B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 4.0 h 1b](/fit/ibm-granite-granite-4-0-h-1b?chip=m5-pro&ram=24)

General · ibm-granite

Q8\_0Excellent

2.1 GB9% of RAM~110 tok/sEstimated1.46B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniMax M2.7 Small JANGTQ](/fit/osaurusai-minimax-m2-7-small-jangtq?chip=m5-pro&ram=24)

General · osaurusai

Q8\_0Excellent

11.3 GB47% of RAMBenchmark needed9.65B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[gpt oss 120b lora merged redux](/fit/pyoakum-gpt-oss-120b-lora-merged-redux?chip=m5-pro&ram=24)

General · pyoakum

Q8\_0Excellent

6.5 GB27% of RAMBenchmark needed5.35B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[granite 3.1 3b a800m base](/fit/ibm-granite-granite-3-1-3b-a800m-base?chip=m5-pro&ram=24)

General · ibm-granite

Q8\_0Excellent

4.2 GB17% of RAMBenchmark needed3.3B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[MiniCPM V 4.6 Abliterated AND Disinhibited](/fit/treadon-minicpm-v-4-6-abliterated-and-disinhibited?chip=m5-pro&ram=24)

General · treadon

Q8\_0Excellent

2.0 GB8% of RAM~124 tok/sEstimated1.3B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

[Youtu LLM 2B](/fit/tencent-youtu-llm-2b?chip=m5-pro&ram=24)

General · tencent

Q8\_0Excellent

2.7 GB11% of RAM~82 tok/sEstimated1.96B params

What Mac for this model? [Run with ToolPiper](/toolpiper)

Show more (6413 remaining)

## 16-core vs 20-core GPU

Both bins run the same 307 GB/s memory bus, so token generation is the same on either one. The extra cores show up in image and video work, not in tokens per second.

| Configuration | Memory bandwidth | Memory options | Models that fit |
| --- | --- | --- | --- |
| 15-core CPU, 16-core GPU | 307 GB/s | 24, 48, 64 GB | Identical |
| 18-core CPU, 20-core GPU | 307 GB/s | 24, 48, 64 GB | Identical |

## Measured on the M5 Pro

Nobody has submitted a benchmark on the M5 Pro yet, so every speed on this page is the formula estimate rather than a measured run. The estimate is bandwidth-driven and calibrated against chips that do have data, which makes it a good guide and not a promise.

ToolPiper contributes a result anonymously when you run the benchmark, and the [leaderboard](/fit/benchmarks) shows every chip that already has one.

## Where to go from here

What each step actually changes for local models, rather than which one is newer.

[Used market alternative

Mac mini M4 Pro

11% less memory bandwidth

](/mac-mini/m4-pro)[Same chip, other Mac

MacBook Pro 14" M5 Pro

The same chip in a different Mac

](/macbook-pro-14/m5-pro)[Same chip, other Mac

MacBook Pro 16" M5 Pro

The same chip in a different Mac

](/macbook-pro-16/m5-pro)

## Why unified memory is the number that matters

On a PC the model has to fit in GPU VRAM, which is a separate pool from system RAM and usually the smaller of the two. Apple Silicon has one pool. The M5 Pro's 307 GB/s bus is shared by CPU, GPU, and Neural Engine, so a 64 GB machine can hand almost all of that to a model with no copy across a bus.

The mini is the cheapest way onto this chip, and it runs headless on a shelf perfectly well. Nothing about local inference needs the display attached. Buy the memory, not the cores: every extra GB raises what you can load, while the core count only moves throughput on models that already fit.

## Common questions

### Can the M5 Pro Mac mini run a 70B model?

Yes, at 64 GB. A 70B model at Q4\_K\_M needs about 46 GB including an 8K context, and 64 GB of unified memory leaves about 56 GB for weights once macOS takes its share. At 24 GB it does not fit at any quantization worth running.

### How much unified memory should I get with the M5 Pro Mac mini?

Memory is the only spec that changes what you can run at all. 24 GB holds about a 31B model at Q4; 64 GB holds about 85B. It is soldered, so this is a one-time decision, and it is the upgrade worth paying for before core count.

### How fast are local LLMs on the M5 Pro?

Token generation is bandwidth-bound, so M5 Pro throughput scales with its 307 GB/s memory bus. Divide bandwidth by the size of the weights actually read per token to get the ceiling, then expect roughly half of that in practice. A 7B model at Q4 reads about 4 GB per token pass, so the M5 Pro lands in the tens of tokens per second and a 70B model lands in the single digits.

### Is the 20-core GPU worth it over the 16-core on the M5 Pro?

Not for LLMs. Both bins run the same 307 GB/s memory bus and take the same memory options, and token generation is bound by bandwidth rather than GPU cores. The extra cores show up in image generation and video work, not in tokens per second.

### Should I buy the M5 Pro Mac mini now or wait for the next one?

Buy on the memory you need today. Apple raises memory ceilings slowly and bandwidth in steps, and the M5 Pro already holds about a 85B model at Q4. If your target model fits in 64 GB, waiting buys throughput rather than capability.

## Run these models on your Mac mini

ToolPiper downloads, manages, and runs local models on Apple Silicon. Free, and nothing leaves the machine.

[Get ToolPiper](/toolpiper)[Compare against another Mac](/fit?chip=m5-pro&ram=24)

[![ModelPiper](modelpiper-logo-sm.png)ModelPiper](/)

Runs on ToolPiper  
Local AI  
Private by default  
Talk to your Mac

#### Products

-   [ToolPiper](/toolpiper)
-   [VisionPiper](/visionpiper)
-   [AudioPiper](/audiopiper)
-   [MediaPiper](/docs/mediapiper)
-   [PiperTest](/pipertest)

#### Mac Hardware

-   [MacBook Air](/macbook-air)
-   [MacBook Pro 14"](/macbook-pro-14)
-   [MacBook Pro 16"](/macbook-pro-16)
-   [Mac mini](/mac-mini)
-   [Mac Studio](/mac-studio)
-   [iMac](/imac)

#### Resources

-   [Model Fit](/fit)
-   [Benchmarks](/fit/benchmarks)
-   [Blog](/blog)
-   [Workflows](/workflow)
-   [Docs](/docs)
-   [MCP Tools](/mcp-tools)

#### Company

-   [About](/about)
-   [Press](/press)
-   [Changelog](/changelog)
-   [Pricing](/pricing)
-   [Download](/download)
-   [Privacy](/privacy)
-   [Terms](/terms)

© 2026 ModelPiper. All rights reserved.