← All MacBook Pro 14" models

MacBook Pro 14" M3 Pro

The M3 Pro MacBook Pro 14" runs local models at 150 GB/s of memory bandwidth with 18 to 36 GB of unified memory. On Apple Silicon that memory is shared with the GPU, so the whole pool is available for weights: at 36 GB you can hold roughly a 47B dense model at Q4. The Pro roughly doubles the base chip's memory bus. That moves mid-size models from usable to comfortable without moving you into desktop money.

Apple no longer sells this configuration new. It stays fully evaluated here because the used market is where most of its local AI value now sits.

Specifications

ChipApple M3 Pro
CPU cores11 or 12
GPU cores14 or 18
Unified memory18 or 36 GB
Memory bandwidth150 GB/s
Neural Engine18 TOPS
Released2023
AvailabilityUsed market

Memory bandwidth is faster than 22% of the Apple Silicon chips shipped in a Mac, against a 819 GB/s peak.

Its memory ceiling is above 39% of them, against a 512 GB peak.

Pick your configuration

Every option Apple sells with this chip. The model list below recomputes against the one you pick.

GPU cores

Unified memory

What each memory option runs

Unified memory is the ceiling and it is soldered, so this is the decision you cannot revisit.

18 GB unified memory

15 GB usable for weights · 150 GB/s

3,264 of 3,641 models fit, and 2,998 of them run with headroom rather than as a squeeze.

Largest model at Q4
EuroLLM 22B Instruct 2512 · 22.64B
Best all-round pick
Qwen3.5 0.8B · Q8_0 · ~90 tok/s

36 GB unified memory

31 GB usable for weights · 150 GB/s

3,417 of 3,641 models fit, and 3,252 of them run with headroom rather than as a squeeze.

Largest model at Q4
Chinese Mixtral 8x7B · 46.91B
Best all-round pick
Qwen3.5 0.8B · Q8_0 · ~90 tok/s

What a 18 GB M3 Pro MacBook Pro 14" can run

Every model in the database against this exact configuration, at 150 GB/s. Ratings and speeds are the same numbers the model pages show.

Showing 3641 of 3641 models

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent
1.5 GB8% of RAM~90 tok/sEstimated0.87B params
Run with ToolPiper

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent
1.5 GB8% of RAM~90 tok/sEstimated0.87B params
Run with ToolPiper

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent
3.0 GB17% of RAM~35 tok/sEstimated2.27B params
Run with ToolPiper

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent
3.0 GB17% of RAM~35 tok/sEstimated2.27B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

Reasoning · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
1.3 GB7% of RAM~106 tok/sEstimated0.74B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

Reasoning · Liquid AI · 2025-11-28

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · ibm-granite · 2025-09-16

Q8_0Excellent
8.2 GB46% of RAMBenchmark needed6.94B params
Run with ToolPiper

Chat · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
9.8 GB54% of RAMBenchmark needed8.3B params
Run with ToolPiper

Chat · Liquid AI · 2025-11-28

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · NCAI · 2025-12-29

Q8_0Excellent
8.6 GB48% of RAMBenchmark needed7.25B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
3.4 GB19% of RAM~31 tok/sEstimated2.57B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
3.4 GB19% of RAM~31 tok/sEstimated2.57B params
Run with ToolPiper

Multimodal · NCAI · 2025-12-29

Q8_0Excellent
9.0 GB50% of RAMBenchmark needed7.58B params
Run with ToolPiper

Multimodal · Liquid AI · 2025-11-28

Q8_0Excellent
1.0 GB6% of RAM~175 tok/sEstimated0.45B params
Run with ToolPiper

Multimodal · Liquid AI · 2025-11-28

Q8_0Excellent
2.3 GB13% of RAM~49 tok/sEstimated1.6B params
Run with ToolPiper

Multimodal · Liquid AI · 2025-11-28

Q8_0Excellent
2.3 GB13% of RAM~50 tok/sEstimated1.58B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
2.2 GB12% of RAM~52 tok/sEstimated1.5B params
Run with ToolPiper

General · Liquid AI · 2025-11-28

Q8_0Excellent
2.2 GB12% of RAM~52 tok/sEstimated1.5B params
Run with ToolPiper

Reasoning · HuggingFace · 2025-07-08

Q8_0Excellent
3.8 GB21% of RAM~26 tok/sEstimated3B params
Run with ToolPiper

General · LG AI · 2025-07-15

Q8_0Excellent
1.8 GB10% of RAM~65 tok/sEstimated1.2B params
Run with ToolPiper

Chat · Liquid AI · 2025-11-28

Q8_0Excellent
3.4 GB19% of RAM~31 tok/sEstimated2.57B params
Run with ToolPiper

General · raidium · 2026-06-15

Q8_0Excellent
0.5 GB3% of RAM~3,929 tok/sEstimated0.02B params
Run with ToolPiper

Embedding · taide · 2026-06-12

Q8_0Excellent
0.8 GB5% of RAM~262 tok/sEstimated0.3B params
Run with ToolPiper

General · Alibaba · 2025-04-27

Q8_0Excellent
1.3 GB7% of RAM~105 tok/sEstimated0.75B params
Run with ToolPiper

Multimodal · zai-org

Q8_0Excellent
2.0 GB11% of RAM~59 tok/sEstimated1.33B params
Run with ToolPiper

General · Alibaba

Q8_0Excellent
1.0 GB6% of RAM~160 tok/sEstimated0.49B params
Run with ToolPiper

Multimodal · openbmb

Q8_0Excellent
2.0 GB11% of RAM~60 tok/sEstimated1.3B params
Run with ToolPiper

Multimodal · datalab-to

Q8_0Excellent
1.3 GB7% of RAM~114 tok/sEstimated0.69B params
Run with ToolPiper

General · openbmb

Q8_0Excellent
1.7 GB9% of RAM~73 tok/sEstimated1.08B params
Run with ToolPiper

General · hmellor

Q8_0Excellent
1.9 GB10% of RAM~63 tok/sEstimated1.24B params
Run with ToolPiper

General · distil-labs

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · farbodtavakkoli

Q8_0Excellent
1.8 GB10% of RAM~65 tok/sEstimated1.21B params
Run with ToolPiper

General · ibm-granite

Q8_0Excellent
7.9 GB44% of RAMBenchmark needed6.67B params
Run with ToolPiper
Q8_0Excellent
0.5 GB3% of RAM~7,857 tok/sEstimated0.01B params
Run with ToolPiper

General · Upstage

Q8_0Excellent
9.5 GB53% of RAMBenchmark needed8.05B params
Run with ToolPiper

General · openai

Q8_0Excellent
3.1 GB17% of RAMBenchmark needed2.37B params
Run with ToolPiper

General · paddlepaddle

Q8_0Excellent
1.6 GB9% of RAM~82 tok/sEstimated0.96B params
Run with ToolPiper

General · Liquid AI

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · pfnet

Q8_0Excellent
1.9 GB11% of RAM~61 tok/sEstimated1.29B params
Run with ToolPiper

General · openbmb

Q8_0Excellent
1.7 GB9% of RAM~73 tok/sEstimated1.08B params
Run with ToolPiper

General · baidu

Q8_0Excellent
0.9 GB5% of RAM~218 tok/sEstimated0.36B params
Run with ToolPiper

General · arcee-ai

Q8_0Excellent
7.3 GB41% of RAMBenchmark needed6.12B params
Run with ToolPiper

General · adamlucek

Q8_0Excellent
1.9 GB10% of RAM~63 tok/sEstimated1.24B params
Run with ToolPiper

Coding · shahriarferdoush

Q8_0Excellent
1.9 GB10% of RAM~63 tok/sEstimated1.24B params
Run with ToolPiper

General · ahczhg

Q8_0Excellent
1.9 GB10% of RAM~63 tok/sEstimated1.24B params
Run with ToolPiper

General · abaryan

Q8_0Excellent
1.9 GB10% of RAM~63 tok/sEstimated1.24B params
Run with ToolPiper

General · etherll

Q8_0Excellent
1.3 GB7% of RAM~106 tok/sEstimated0.74B params
Run with ToolPiper

General · farbodtavakkoli

Q8_0Excellent
2.5 GB14% of RAMBenchmark needed1.77B params
Run with ToolPiper

General · kamilamila

Q8_0Excellent
1.2 GB7% of RAM~127 tok/sEstimated0.62B params
Run with ToolPiper

General · paddlepaddle

Q8_0Excellent
1.6 GB9% of RAM~82 tok/sEstimated0.96B params
Run with ToolPiper

General · ordenwills

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper
Q8_0Excellent
2.1 GB11% of RAM~57 tok/sEstimated1.39B params
Run with ToolPiper

General · carsenk

Q8_0Excellent
1.9 GB10% of RAM~63 tok/sEstimated1.24B params
Run with ToolPiper

Reasoning · nvidia

Q8_0Excellent
2.2 GB12% of RAM~51 tok/sEstimated1.54B params
Run with ToolPiper

General · ibm-granite

Q8_0Excellent
2.0 GB11% of RAMBenchmark needed1.33B params
Run with ToolPiper

General · openbmb

Q8_0Excellent
2.0 GB11% of RAM~60 tok/sEstimated1.3B params
Run with ToolPiper

General · pyoakum

Q8_0Excellent
6.5 GB36% of RAMBenchmark needed5.35B params
Run with ToolPiper

General · ibm-granite

Q8_0Excellent
4.2 GB23% of RAMBenchmark needed3.3B params
Run with ToolPiper
Q8_0Excellent
2.0 GB11% of RAM~60 tok/sEstimated1.3B params
Run with ToolPiper

General · skis-ai-research

Q8_0Excellent
1.8 GB10% of RAM~67 tok/sEstimated1.17B params
Run with ToolPiper

General · thkim0305

Q8_0Excellent
1.6 GB9% of RAM~79 tok/sEstimated1B params
Run with ToolPiper
Q8_0Excellent
1.5 GB8% of RAM~90 tok/sEstimated0.87B params
Run with ToolPiper

Coding · rahul7star

Q8_0Excellent
1.5 GB8% of RAM~90 tok/sEstimated0.87B params
Run with ToolPiper

Coding · z-lab

Q8_0Excellent
1.7 GB9% of RAM~73 tok/sEstimated1.08B params
Run with ToolPiper
Q8_0Excellent
6.9 GB38% of RAMBenchmark needed5.75B params
Run with ToolPiper

General · artificialguybr

Q8_0Excellent
1.9 GB10% of RAM~63 tok/sEstimated1.24B params
Run with ToolPiper

General · Microsoft

Q8_0Excellent
0.7 GB4% of RAMBenchmark needed0.17B params
Run with ToolPiper

General · Microsoft

Q8_0Excellent
0.7 GB4% of RAMBenchmark needed0.17B params
Run with ToolPiper

General · tencent

Q8_0Excellent
1.1 GB6% of RAM~146 tok/sEstimated0.54B params
Run with ToolPiper

General · primeintellect

Q8_0Excellent
1.1 GB6% of RAMBenchmark needed0.54B params
Run with ToolPiper

Multimodal · Alibaba · 2026-02-27

Q8_0Excellent
5.7 GB32% of RAM~17 tok/sEstimated4.66B params
Run with ToolPiper

Multimodal · Alibaba

Q8_0Excellent
2.9 GB16% of RAM~37 tok/sEstimated2.13B params
Run with ToolPiper

General · Alibaba

Q8_0Excellent
2.2 GB12% of RAM~51 tok/sEstimated1.54B params
Run with ToolPiper

Reasoning · DeepSeek

Q8_0Excellent
2.5 GB14% of RAM~44 tok/sEstimated1.78B params
Run with ToolPiper

Multimodal · Alibaba · 2026-02-27

Q8_0Excellent
5.7 GB32% of RAM~17 tok/sEstimated4.66B params
Run with ToolPiper

Multimodal · lkhl

Q8_0Excellent
2.7 GB15% of RAM~40 tok/sEstimated1.96B params
Run with ToolPiper

General · jinaai

Q8_0Excellent
2.2 GB12% of RAM~51 tok/sEstimated1.54B params
Run with ToolPiper

Reasoning · typhoon-ai

Q8_0Excellent
2.9 GB16% of RAM~37 tok/sEstimated2.13B params
Run with ToolPiper

General · amd

Q8_0Excellent
2.2 GB12% of RAM~52 tok/sEstimated1.5B params
Run with ToolPiper

Multimodal · Liquid AI · 2025-11-28

Q8_0Excellent
3.8 GB21% of RAM~26 tok/sEstimated3B params
Run with ToolPiper
Q8_0Excellent
2.2 GB12% of RAM~52 tok/sEstimated1.5B params
Run with ToolPiper

General · agentica-org

Q8_0Excellent
2.5 GB14% of RAM~44 tok/sEstimated1.78B params
Run with ToolPiper

General · novaciano

Q8_0Excellent
2.2 GB12% of RAM~52 tok/sEstimated1.5B params
Run with ToolPiper

General · kgrabko

Q8_0Excellent
2.2 GB12% of RAM~52 tok/sEstimated1.5B params
Run with ToolPiper

General · bezzam

Q8_0Excellent
1.4 GB8% of RAM~101 tok/sEstimated0.78B params
Run with ToolPiper

General · ibm-granite

Q8_0Excellent
2.1 GB12% of RAM~54 tok/sEstimated1.46B params
Run with ToolPiper

General · menlo

Q8_0Excellent
2.4 GB13% of RAM~46 tok/sEstimated1.72B params
Run with ToolPiper

General · TII

Q8_0Excellent
2.2 GB12% of RAM~51 tok/sEstimated1.55B params
Run with ToolPiper

General · roystar

Q8_0Excellent
2.2 GB12% of RAM~51 tok/sEstimated1.54B params
Run with ToolPiper

General · weiboai

Q8_0Excellent
2.5 GB14% of RAM~44 tok/sEstimated1.78B params
Run with ToolPiper

General · TII

Q8_0Excellent
2.2 GB12% of RAM~51 tok/sEstimated1.55B params
Run with ToolPiper

General · lgai-exaone · 2025-03-12

Q8_0Excellent
3.2 GB18% of RAM~33 tok/sEstimated2.41B params
Run with ToolPiper

General · Alibaba · 2025-04-27

Q8_0Excellent
2.8 GB15% of RAM~39 tok/sEstimated2.03B params
Run with ToolPiper

General · Alibaba

Q8_0Excellent
1.0 GB6% of RAM~160 tok/sEstimated0.49B params
Run with ToolPiper

General · Alibaba

Q8_0Excellent
1.2 GB6% of RAM~131 tok/sEstimated0.6B params
Run with ToolPiper

General · Microsoft

Q8_0Excellent
1.2 GB6% of RAM~131 tok/sEstimated0.6B params
Run with ToolPiper

Multimodal · opengvlab

Q8_0Excellent
1.5 GB9% of RAM~84 tok/sEstimated0.94B params
Run with ToolPiper

General · Alibaba

Q8_0Excellent
1.3 GB7% of RAM~105 tok/sEstimated0.75B params
Run with ToolPiper

General · Liquid AI

Q8_0Excellent
9.9 GB55% of RAMBenchmark needed8.47B params
Run with ToolPiper

General · voyageai

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · Microsoft

Q8_0Excellent
0.8 GB4% of RAM~291 tok/sEstimated0.27B params
Run with ToolPiper

General · farbodtavakkoli

Q8_0Excellent
1.0 GB6% of RAM~175 tok/sEstimated0.45B params
Run with ToolPiper

General · farbodtavakkoli

Q8_0Excellent
0.8 GB4% of RAM~291 tok/sEstimated0.27B params
Run with ToolPiper

General · internlm

Q8_0Excellent
2.1 GB11% of RAM~56 tok/sEstimated1.4B params
Run with ToolPiper

General · Alibaba

Q8_0Excellent
2.9 GB16% of RAM~37 tok/sEstimated2.13B params
Run with ToolPiper

General · farbodtavakkoli

Q8_0Excellent
1.6 GB9% of RAM~79 tok/sEstimated1B params
Run with ToolPiper

General · jakobhuss

Q8_0Excellent
0.8 GB4% of RAM~291 tok/sEstimated0.27B params
Run with ToolPiper

General · farbodtavakkoli

Q8_0Excellent
2.2 GB12% of RAM~53 tok/sEstimated1.49B params
Run with ToolPiper

Coding · DeepSeek

Q8_0Excellent
2.0 GB11% of RAM~58 tok/sEstimated1.35B params
Run with ToolPiper

General · llava-hf

Q8_0Excellent
1.1 GB6% of RAM~157 tok/sEstimated0.5B params
Run with ToolPiper

General · tomg-group-umd

Q8_0Excellent
2.2 GB12% of RAM~53 tok/sEstimated1.49B params
Run with ToolPiper

General · openbmb

Q8_0Excellent
1.0 GB5% of RAM~183 tok/sEstimated0.43B params
Run with ToolPiper
Q8_0Excellent
1.2 GB7% of RAM~117 tok/sEstimated0.67B params
Run with ToolPiper

Coding · DeepSeek

Q8_0Excellent
1.6 GB9% of RAM~78 tok/sEstimated1.01B params
Run with ToolPiper

General · ibm-granite

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · numind

Q8_0Excellent
1.0 GB6% of RAM~171 tok/sEstimated0.46B params
Run with ToolPiper

General · toxicityprompts

Q8_0Excellent
1.0 GB6% of RAM~160 tok/sEstimated0.49B params
Run with ToolPiper

General · turing-motors

Q8_0Excellent
1.5 GB8% of RAM~86 tok/sEstimated0.91B params
Run with ToolPiper
Q8_0Excellent
4.0 GB22% of RAM~25 tok/sEstimated3.13B params
Run with ToolPiper

General · ibm-granite

Q8_0Excellent
0.9 GB5% of RAM~224 tok/sEstimated0.35B params
Run with ToolPiper

General · bytedance

Q8_0Excellent
2.1 GB12% of RAM~55 tok/sEstimated1.43B params
Run with ToolPiper

General · qnguyen3

Q8_0Excellent
1.7 GB9% of RAM~75 tok/sEstimated1.05B params
Run with ToolPiper
Q8_0Excellent
1.2 GB6% of RAM~131 tok/sEstimated0.6B params
Run with ToolPiper

General · opengvlab

Q8_0Excellent
1.7 GB9% of RAM~74 tok/sEstimated1.06B params
Run with ToolPiper

General · lmms-lab

Q8_0Excellent
1.1 GB6% of RAM~157 tok/sEstimated0.5B params
Run with ToolPiper

General · dmusingu

Q8_0Excellent
2.9 GB16% of RAM~37 tok/sEstimated2.13B params
Run with ToolPiper

General · tabularisai

Q8_0Excellent
0.9 GB5% of RAM~207 tok/sEstimated0.38B params
Run with ToolPiper

General · numind

Q8_0Excellent
1.0 GB6% of RAM~160 tok/sEstimated0.49B params
Run with ToolPiper

General · isotonic

Q8_0Excellent
1.3 GB7% of RAMBenchmark needed0.7B params
Run with ToolPiper

General · thisisiron

Q8_0Excellent
1.8 GB10% of RAM~70 tok/sEstimated1.13B params
Run with ToolPiper

General · nvidia

Q8_0Excellent
1.6 GB9% of RAMBenchmark needed0.97B params
Run with ToolPiper

General · manycore-research

Q8_0Excellent
1.2 GB6% of RAM~131 tok/sEstimated0.6B params
Run with ToolPiper

General · zero-point-ai

Q8_0Excellent
3.0 GB17% of RAM~35 tok/sEstimated2.27B params
Run with ToolPiper

General · dllm-hub

Q8_0Excellent
1.3 GB7% of RAM~105 tok/sEstimated0.75B params
Run with ToolPiper

General · huihui-ai

Q8_0Excellent
1.5 GB8% of RAMBenchmark needed0.86B params
Run with ToolPiper

General · tencent

Q8_0Excellent
2.7 GB15% of RAM~40 tok/sEstimated1.96B params
Run with ToolPiper

General · amd

Q8_0Excellent
1.3 GB7% of RAM~105 tok/sEstimated0.75B params
Run with ToolPiper
1.1 GB6% of RAM~157 tok/sEstimated0.5B params
Run with ToolPiper

14-core vs 18-core GPU

Both bins run the same 150 GB/s memory bus, so token generation is the same on either one. The extra cores show up in image and video work, not in tokens per second.

ConfigurationMemory bandwidthMemory optionsModels that fit
11-core CPU, 14-core GPU150 GB/s18, 36 GBIdentical
12-core CPU, 18-core GPU150 GB/s18, 36 GBIdentical

Measured on the M3 Pro

Nobody has submitted a benchmark on the M3 Pro yet, so every speed on this page is the formula estimate rather than a measured run. The estimate is bandwidth-driven and calibrated against chips that do have data, which makes it a good guide and not a promise.

ToolPiper contributes a result anonymously when you run the benchmark, and the leaderboard shows every chip that already has one.

Why unified memory is the number that matters

On a PC the model has to fit in GPU VRAM, which is a separate pool from system RAM and usually the smaller of the two. Apple Silicon has one pool. The M3 Pro's 150 GB/s bus is shared by CPU, GPU, and Neural Engine, so a 36 GB machine can hand almost all of that to a model with no copy across a bus.

Apple stopped selling this one, which is exactly why it is interesting. The 14-inch chassis cools well enough to hold its clocks through a long generation run, and it is the smallest machine Apple puts a Max chip in. A used M3 Pro at 36 GB still gives you 150 GB/s and a hard 47B ceiling, and neither number degrades with age the way a battery does.

Common questions

Can the M3 Pro MacBook Pro 14" run a 70B model?

No. A 70B model at Q4_K_M needs about 46 GB, and the largest M3 Pro MacBook Pro 14" tops out at 36 GB, which leaves about 31 GB for weights. The practical ceiling on this machine is around 47B parameters at Q4.

How much unified memory should I get with the M3 Pro MacBook Pro 14"?

Memory is the only spec that changes what you can run at all. 18 GB holds about a 22B model at Q4; 36 GB holds about 47B. It is soldered, so this is a one-time decision, and it is the upgrade worth paying for before core count.

How fast are local LLMs on the M3 Pro?

Token generation is bandwidth-bound, so M3 Pro throughput scales with its 150 GB/s memory bus. Divide bandwidth by the size of the weights actually read per token to get the ceiling, then expect roughly half of that in practice. A 7B model at Q4 reads about 4 GB per token pass, so the M3 Pro lands in the tens of tokens per second and a 70B model lands in the single digits.

Is the 18-core GPU worth it over the 14-core on the M3 Pro?

Not for LLMs. Both bins run the same 150 GB/s memory bus and take the same memory options, and token generation is bound by bandwidth rather than GPU cores. The extra cores show up in image generation and video work, not in tokens per second.

Is a used M3 Pro MacBook Pro 14" still worth buying for local AI?

For inference, the specs that matter do not age: 150 GB/s and up to 36 GB of unified memory are the same numbers today as they were in 2023. A used M3 Pro at the top memory option usually beats a new base-tier machine at the same price on both. Check the battery and the display, not the silicon.

Run these models on your MacBook Pro 14"

ToolPiper downloads, manages, and runs local models on Apple Silicon. Free, and nothing leaves the machine.