What LLMs Can Run on Your Mac?

Chip

Unified Memory

Bandwidth 307 GB/s

Available for Models ~21 GB

Everything this chip runs, machine by machine: MacBook Pro 14" M5 Pro, MacBook Pro 16" M5 Pro

Model Compatibility

Showing 6563 of 6563 models

General · radixark · 2026-07-27

Q8_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.25B params

Run with ToolPiper

General · openbmb · 2026-05-21

Q8_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

Run with ToolPiper

OTel LLM 8B A1B IT

General · farbodtavakkoli · 2026-06-17

Q8_0Excellent

10.8 GB45% of RAMBenchmark needed9.23B params

Run with ToolPiper

General · Liquid AI · 2026-05-28

Q8_0Excellent

9.9 GB41% of RAMBenchmark needed8.47B params

Run with ToolPiper

General · Liquid AI · 2026-07-28

Q8_0Excellent

3.5 GB15% of RAM~60 tok/sEstimated2.7B params

Run with ToolPiper

General · Liquid AI · 2026-06-24

Q8_0Excellent

0.8 GB3% of RAM~699 tok/sEstimated0.23B params

Run with ToolPiper

General · goekdeniz-guelmez · 2026-07-31

Q8_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

Run with ToolPiper

minicpm5 1b hermes toolhv1

General · ktruestory · 2026-05-28

Q8_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

Run with ToolPiper

FrankenCPM 4x1B A2B

General · petrouil · 2026-07-23

Q8_0Excellent

3.4 GB14% of RAMBenchmark needed2.61B params

Run with ToolPiper

General · weiboai · 2026-06-12

Q8_0Excellent

3.9 GB16% of RAM~52 tok/sEstimated3.09B params

Run with ToolPiper

General · Liquid AI · 2026-03-31

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

Qwen3.8_4B_Distilled_GGUF

General · ma7ee7 · 2026-07-30

Q8_0Excellent

4.0 GB17% of RAM~51 tok/sEstimated3.13B params

Run with ToolPiper

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent

1.5 GB6% of RAM~185 tok/sEstimated0.87B params

Run with ToolPiper

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

Run with ToolPiper

Qwen3.5 0.8B Base

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent

1.5 GB6% of RAM~185 tok/sEstimated0.87B params

Run with ToolPiper

Qwen3.5 2B Base

Multimodal · Alibaba · 2026-02-28

Q8_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

Run with ToolPiper

General · ibm-granite · 2026-04-06

Q8_0Excellent

4.3 GB18% of RAM~47 tok/sEstimated3.4B params

Run with ToolPiper

General · internscience · 2026-07-13

Q8_0Excellent

5.6 GB23% of RAM~35 tok/sEstimated4.54B params

Run with ToolPiper

granite vision 4.1 4b

Multimodal · ibm-granite · 2026-04-16

Q8_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4B params

Run with ToolPiper

General · nanbeige · 2026-07-21

Q8_0Excellent

5.2 GB21% of RAM~39 tok/sEstimated4.17B params

Run with ToolPiper

pii guard turkish 270m

General · cagrigungor · 2026-08-06

Q8_0Excellent

0.8 GB3% of RAM~596 tok/sEstimated0.27B params

Run with ToolPiper

Multimodal · Alibaba · 2026-02-27

Q8_0Excellent

5.7 GB24% of RAM~35 tok/sEstimated4.66B params

Run with ToolPiper

Multimodal · Google · 2026-03-02

Q8_0Excellent

6.2 GB26% of RAM~31 tok/sEstimated5.12B params

Run with ToolPiper

Qwen3.5 4B Base

Multimodal · Alibaba · 2026-02-27

Q8_0Excellent

5.7 GB24% of RAM~35 tok/sEstimated4.66B params

Run with ToolPiper

Multimodal · Liquid AI · 2026-01-05

Q8_0Excellent

2.3 GB10% of RAM~101 tok/sEstimated1.6B params

Run with ToolPiper

LFM2.5 1.2B Thinking

General · Liquid AI · 2026-01-20

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

General · ai21labs · 2026-01-06

Q8_0Excellent

3.9 GB16% of RAMBenchmark needed3.03B params

Run with ToolPiper

OneReason 0.8B pretrain competition

Reasoning · openonerec · 2026-06-09

Q8_0Excellent

1.4 GB6% of RAM~201 tok/sEstimated0.8B params

Run with ToolPiper

LFM2.5 1.2B Base

General · Liquid AI · 2026-01-05

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

Nemotron Labs Diffusion 3B

General · nvidia · 2026-03-02

Q8_0Excellent

4.8 GB20% of RAM~42 tok/sEstimated3.83B params

Run with ToolPiper

General · Liquid AI · 2026-01-04

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

General · Liquid AI · 2025-12-25

Q8_0Excellent

3.4 GB14% of RAM~63 tok/sEstimated2.57B params

Run with ToolPiper

LFM2 2.6B Transcript

General · Liquid AI · 2026-01-05

Q8_0Excellent

3.4 GB14% of RAM~63 tok/sEstimated2.57B params

Run with ToolPiper

LFM2.5 1.2B Instruct

Chat · Liquid AI · 2026-01-06

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

LFM2 ColBERT 350M

General · Liquid AI · 2025-10-28

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

General · Liquid AI · 2025-10-07

Q8_0Excellent

9.8 GB41% of RAMBenchmark needed8.34B params

Run with ToolPiper

Multimodal · Liquid AI · 2025-10-22

Q8_0Excellent

3.8 GB16% of RAM~54 tok/sEstimated3B params

Run with ToolPiper

LFM2 350M PII Extract JP

General · Liquid AI · 2025-09-30

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

Lumma 0.6B Extract

General · frontiersmind · 2026-08-03

Q8_0Excellent

1.2 GB5% of RAM~247 tok/sEstimated0.65B params

Run with ToolPiper

Gemma 3 4B VL it Gemini Pro Heretic Uncensored Thinking

Multimodal · davidau · 2026-02-02

Q8_0Excellent

5.3 GB22% of RAM~37 tok/sEstimated4.3B params

Run with ToolPiper

General · hmellor · 2025-07-22

Q8_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

Run with ToolPiper

granite 4.0 h tiny

General · ibm-granite · 2025-09-16

Q8_0Excellent

8.2 GB34% of RAMBenchmark needed6.94B params

Run with ToolPiper

Multimodal · Liquid AI · 2025-08-12

Q8_0Excellent

1.0 GB4% of RAM~357 tok/sEstimated0.45B params

Run with ToolPiper

General · openonerec · 2025-12-30

Q8_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

Run with ToolPiper

granite 4.0 h micro

General · ibm-granite · 2025-09-16

Q8_0Excellent

4.1 GB17% of RAM~50 tok/sEstimated3.19B params

Run with ToolPiper

General · bytedance · 2025-10-28

Q8_0Excellent

2.1 GB9% of RAM~112 tok/sEstimated1.43B params

Run with ToolPiper

Multimodal · Liquid AI · 2025-08-12

Q8_0Excellent

2.3 GB9% of RAM~102 tok/sEstimated1.58B params

Run with ToolPiper

General · Liquid AI · 2025-09-22

Q8_0Excellent

3.4 GB14% of RAM~63 tok/sEstimated2.57B params

Run with ToolPiper

LFM2 1.2B Extract

General · Liquid AI · 2025-08-22

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

LFM2 350M ENJP MT

General · Liquid AI · 2025-09-03

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

General · Liquid AI · 2025-09-03

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

General · Liquid AI · 2025-08-25

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

LFM2 350M Extract

General · Liquid AI · 2025-09-03

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

General · Liquid AI · 2025-09-03

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

General · NCAI · 2025-12-29

Q8_0Excellent

8.6 GB36% of RAMBenchmark needed7.25B params

Run with ToolPiper

typhoon2.5 qwen3 4b

General · typhoon-ai · 2025-09-23

Q8_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4.02B params

Run with ToolPiper

granite 4.0 tiny preview

General · ibm-granite · 2025-04-30

Q8_0Excellent

7.9 GB33% of RAMBenchmark needed6.67B params

Run with ToolPiper

General · Liquid AI · 2025-07-10

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

granite 4.0 micro

General · ibm-granite · 2025-09-16

Q8_0Excellent

4.3 GB18% of RAM~47 tok/sEstimated3.4B params

Run with ToolPiper

PARD Llama 3.2 1B

General · amd · 2025-05-17

Q8_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

Run with ToolPiper

newsvibe categories multilingual llama 1b

General · stefanruseti · 2025-06-04

Q8_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

Run with ToolPiper

Qwen3 4B DFlash b16

General · z-lab · 2026-01-04

Q8_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4B params

Run with ToolPiper

granite 4.0 350m base

General · ibm-granite · 2025-10-07

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

EXAONE 4.0 1.2B

General · lgai-exaone · 2025-07-11

Q8_0Excellent

1.9 GB8% of RAM~126 tok/sEstimated1.28B params

Run with ToolPiper

General · Liquid AI · 2025-07-10

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

General · Liquid AI · 2025-07-10

Q8_0Excellent

1.3 GB6% of RAM~217 tok/sEstimated0.74B params

Run with ToolPiper

VAETKI VL 7B A1B

Multimodal · NCAI · 2025-12-29

Q8_0Excellent

9.0 GB37% of RAMBenchmark needed7.58B params

Run with ToolPiper

DeepSeek R1 Distill Qwen 1.5B

Reasoning · DeepSeek · 2025-01-20

Q8_0Excellent

2.5 GB10% of RAM~90 tok/sEstimated1.78B params

Run with ToolPiper

Qwen3 4B Thinking 2507

General · Alibaba · 2025-08-05

Q8_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4.02B params

Run with ToolPiper

Qwen3Guard Gen 0.6B

General · Alibaba · 2025-09-23

Q8_0Excellent

1.3 GB6% of RAM~214 tok/sEstimated0.75B params

Run with ToolPiper

Phi 4 mini reasoning

Reasoning · Microsoft · 2025-04-29

Q8_0Excellent

4.8 GB20% of RAM~42 tok/sEstimated3.84B params

Run with ToolPiper

General · pfnet · 2025-02-05

Q8_0Excellent

1.9 GB8% of RAM~125 tok/sEstimated1.29B params

Run with ToolPiper

alloma 1B Instruct

Chat · uzlm · 2025-09-03

Q8_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

Run with ToolPiper

General · bytedance-seed · 2025-04-09

Q8_0Excellent

11.0 GB46% of RAMBenchmark needed9.37B params

Run with ToolPiper

General · sapientinc · 2026-05-17

Q8_0Excellent

1.8 GB8% of RAM~136 tok/sEstimated1.18B params

Run with ToolPiper

General · menlo · 2025-06-25

Q8_0Excellent

5.0 GB21% of RAM~40 tok/sEstimated4.02B params

Run with ToolPiper

General · fableforge-ai · 2026-07-05

Q8_0Excellent

2.2 GB9% of RAM~104 tok/sEstimated1.54B params

Run with ToolPiper

General · viorikaai-org · 2026-07-05

Q8_0Excellent

0.6 GB2% of RAM~3,216 tok/sEstimated0.05B params

Run with ToolPiper

Qwen3.5 9B Claude 4.6 Opus Reasoning Distilled v2

Reasoning · jackrong · 2026-03-16

Q8_0Excellent

11.3 GB47% of RAM~17 tok/sEstimated9.65B params

Run with ToolPiper

BananaMind 2 Nano

General · bananamind · 2026-07-17

Q8_0Excellent

0.5 GB2% of RAM~16,081 tok/sEstimated0.01B params

Run with ToolPiper

EXAONE Deep 2.4B

General · lgai-exaone · 2025-03-12

Q8_0Excellent

3.2 GB13% of RAM~67 tok/sEstimated2.41B params

Run with ToolPiper

Nexus Erebus 50M

General · maliosdark · 2026-07-09

Q8_0Excellent

0.6 GB2% of RAM~3,216 tok/sEstimated0.05B params

Run with ToolPiper

General · raidium · 2026-06-15

Q8_0Excellent

0.5 GB2% of RAM~8,040 tok/sEstimated0.02B params

Run with ToolPiper

embeddinggemma GTAIDE 300m 2605

Embedding · taide · 2026-06-12

Q8_0Excellent

0.8 GB3% of RAM~536 tok/sEstimated0.3B params

Run with ToolPiper

General · darthcrawl · 2026-05-07

Q8_0Excellent

0.5 GB2% of RAM~4,020 tok/sEstimated0.04B params

Run with ToolPiper

General · Alibaba · 2025-04-27

Q8_0Excellent

1.3 GB6% of RAM~214 tok/sEstimated0.75B params

Run with ToolPiper

General · Alibaba · 2025-04-27

Q8_0Excellent

2.8 GB12% of RAM~79 tok/sEstimated2.03B params

Run with ToolPiper

Qwen2.5 VL 3B Instruct

Multimodal · Alibaba · 2025-01-26

Q8_0Excellent

4.7 GB20% of RAM~43 tok/sEstimated3.75B params

Run with ToolPiper

Multimodal · Google · 2026-03-02

Q8_0Excellent

9.4 GB39% of RAM~20 tok/sEstimated8B params

Run with ToolPiper

Multimodal · zai-org

Q8_0Excellent

2.0 GB8% of RAM~121 tok/sEstimated1.33B params

Run with ToolPiper

Qwen3 VL 2B Instruct

Multimodal · Alibaba

Q8_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

Run with ToolPiper

Multimodal · datalab-to

Q8_0Excellent

1.3 GB5% of RAM~233 tok/sEstimated0.69B params

Run with ToolPiper

Qwen3 1.7B Base

General · Alibaba · 2025-04-28

Q8_0Excellent

2.4 GB10% of RAM~93 tok/sEstimated1.72B params

Run with ToolPiper

General · huggingfacetb · 2025-07-08

Q8_0Excellent

3.9 GB16% of RAM~52 tok/sEstimated3.08B params

Run with ToolPiper

Multimodal · openbmb

Q8_0Excellent

2.0 GB8% of RAM~124 tok/sEstimated1.3B params

Run with ToolPiper

Qwen3 0.6B Base

General · Alibaba · 2025-04-28

Q8_0Excellent

1.2 GB5% of RAM~268 tok/sEstimated0.6B params

Run with ToolPiper

Multimodal · rednote-hilab

Q8_0Excellent

3.9 GB16% of RAM~53 tok/sEstimated3.04B params

Run with ToolPiper

Multimodal · tencent

Q8_0Excellent

1.7 GB7% of RAMBenchmark needed1.12B params

Run with ToolPiper

Multimodal · dots-studio

Q8_0Excellent

3.9 GB16% of RAM~53 tok/sEstimated3.04B params

Run with ToolPiper

distil lfm25 shellper

General · distil-labs

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

OTel LLM 1.2B IT

General · farbodtavakkoli

Q8_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

Run with ToolPiper

Multimodal · raxcore-dev

Q8_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

Run with ToolPiper

SmolLM3 3B Base

General · huggingfacetb · 2025-06-19

Q8_0Excellent

3.9 GB16% of RAM~52 tok/sEstimated3.08B params

Run with ToolPiper

General · jinaai

Q8_0Excellent

2.2 GB9% of RAM~104 tok/sEstimated1.54B params

Run with ToolPiper

Multimodal · ath-maas

Q8_0Excellent

1.4 GB6% of RAM~189 tok/sEstimated0.85B params

Run with ToolPiper

Qwen3 VL 2B Thinking

Multimodal · Alibaba

Q8_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

Run with ToolPiper

Multimodal · Liquid AI

Q8_0Excellent

1.0 GB4% of RAM~357 tok/sEstimated0.45B params

Run with ToolPiper

Dolphin3 Cyber 8B

General · ravichandranj · 2026-02-13

Q8_0Excellent

7.7 GB32% of RAM~25 tok/sEstimated6.43B params

Run with ToolPiper

typhoon ocr1.5 2b

Reasoning · typhoon-ai

Q8_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

Run with ToolPiper

PaddleOCR VL 1.6

Multimodal · paddlepaddle

Q8_0Excellent

1.6 GB7% of RAM~168 tok/sEstimated0.96B params

Run with ToolPiper

General · lukebailey181pub · 2026-04-21

Q8_0Excellent

8.2 GB34% of RAM~23 tok/sEstimated6.91B params

Run with ToolPiper

LFM2.5 350M Base

General · Liquid AI

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

Multimodal · paddlepaddle

Q8_0Excellent

1.6 GB7% of RAM~168 tok/sEstimated0.96B params

Run with ToolPiper

Llama 3.2 3B Instruct pythonic

Chat · baseten · 2025-09-12

Q8_0Excellent

4.1 GB17% of RAM~50 tok/sEstimated3.21B params

Run with ToolPiper

Orpo Llama 3.2 1B 15k

General · adamlucek

Q8_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

Run with ToolPiper

llama 3.2 1b code instruct

Coding · shahriarferdoush

Q8_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

Run with ToolPiper

Llama 3.2 1B Aegis SFT DPO

General · ahczhg

Q8_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

Run with ToolPiper

Qwen3 0.6B ONNX

General · onnx-community · 2025-04-28

Q8_0Excellent

1.0 GB4% of RAM~357 tok/sEstimated0.45B params

Run with ToolPiper

General · etherll

Q8_0Excellent

1.3 GB6% of RAM~217 tok/sEstimated0.74B params

Run with ToolPiper

ERNIE 4.5 0.3B PT

General · baidu

Q8_0Excellent

0.9 GB4% of RAM~447 tok/sEstimated0.36B params

Run with ToolPiper

LFM2.5 1.2B JP 202606

General · Liquid AI

Q8_0Excellent

1.8 GB8% of RAM~137 tok/sEstimated1.17B params

Run with ToolPiper

MiniCPM5 1B Base

General · openbmb

Q8_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

Run with ToolPiper

VideoLLaMA3 2B Image HF

Multimodal · lkhl

Q8_0Excellent

2.7 GB11% of RAM~82 tok/sEstimated1.96B params

Run with ToolPiper

Infinity Parser2 Flash

Multimodal · infly

Q8_0Excellent

3.0 GB12% of RAM~73 tok/sEstimated2.21B params

Run with ToolPiper

Llama 3.2 1B flax

General · benjamin

Q8_0Excellent

1.7 GB7% of RAM~150 tok/sEstimated1.07B params

Run with ToolPiper

General · lemonelabs

Q8_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

Run with ToolPiper

General · openbmb · 2025-06-05

Q8_0Excellent

1.0 GB4% of RAM~374 tok/sEstimated0.43B params

Run with ToolPiper

OTel LLM 20B IT

General · farbodtavakkoli

Q8_0Excellent

2.5 GB10% of RAMBenchmark needed1.77B params

Run with ToolPiper

LFM2.5 1.2B Nova Function Calling

General · novachronoai

Q8_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

Run with ToolPiper

PaddleOCR VL 1.5

Multimodal · paddlepaddle

Q8_0Excellent

1.6 GB7% of RAM~168 tok/sEstimated0.96B params

Run with ToolPiper

Qwen3 4B Kimi2.5 Reasoning Distilled

Reasoning · khazarai

Q8_0Excellent

4.0 GB17% of RAM~51 tok/sEstimated3.13B params

Run with ToolPiper

General · kamilamila

Q8_0Excellent

1.2 GB5% of RAM~259 tok/sEstimated0.62B params

Run with ToolPiper

General · launch

Q8_0Excellent

2.5 GB10% of RAM~90 tok/sEstimated1.78B params

Run with ToolPiper

Trinity Nano Preview

General · arcee-ai

Q8_0Excellent

7.3 GB31% of RAMBenchmark needed6.12B params

Run with ToolPiper

transcription cleanup llama3.2 1b

General · getonit

Q8_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

Run with ToolPiper

LFM2.5 1.2B JP 202606 ONNX

General · Liquid AI

Q8_0Excellent

1.8 GB8% of RAM~133 tok/sEstimated1.21B params

Run with ToolPiper

MiniCPM5 1B Claude Opus Fable5 V2 Thinking heretic

General · saidutta69

Q8_0Excellent

1.7 GB7% of RAM~149 tok/sEstimated1.08B params

Run with ToolPiper

DeepScaleR 1.5B Preview

General · agentica-org

Q8_0Excellent

2.5 GB10% of RAM~90 tok/sEstimated1.78B params

Run with ToolPiper

SEX_ROLEPLAY 3.2 1B

General · novaciano

Q8_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

Run with ToolPiper

Qwen3 VL 2B RRG SFT

General · dmusingu

Q8_0Excellent

2.9 GB12% of RAM~75 tok/sEstimated2.13B params

Run with ToolPiper

JiRackTernary_1b

General · kgrabko

Q8_0Excellent

2.2 GB9% of RAM~107 tok/sEstimated1.5B params

Run with ToolPiper

LFM2.5 350M home assistant sft

General · ordenwills

Q8_0Excellent

0.9 GB4% of RAM~459 tok/sEstimated0.35B params

Run with ToolPiper

Recurrent Llama 3.2 train recurrence 32

General · smcleish

Q8_0Excellent

2.1 GB9% of RAM~116 tok/sEstimated1.39B params

Run with ToolPiper

llama3.2_1b_2025_uncensored_v2

General · carsenk

Q8_0Excellent

1.9 GB8% of RAM~130 tok/sEstimated1.24B params

Run with ToolPiper

OpenReasoning Nemotron 1.5B

Reasoning · nvidia

Q8_0Excellent

2.2 GB9% of RAM~104 tok/sEstimated1.54B params

Run with ToolPiper

Miss MARTHA hot POCKET edition 2B OMNI

Multimodal · zero-point-ai

Q8_0Excellent

3.0 GB13% of RAM~71 tok/sEstimated2.27B params

Run with ToolPiper

MiniCPM V 4.6 Thinking

General · openbmb

Q8_0Excellent

2.0 GB8% of RAM~124 tok/sEstimated1.3B params

Run with ToolPiper

granite 4.0 h 1b

General · ibm-granite

Q8_0Excellent

2.1 GB9% of RAM~110 tok/sEstimated1.46B params

Run with ToolPiper

MiniMax M2.7 Small JANGTQ

General · osaurusai

Q8_0Excellent

11.3 GB47% of RAMBenchmark needed9.65B params

Run with ToolPiper

gpt oss 120b lora merged redux

General · pyoakum

Q8_0Excellent

6.5 GB27% of RAMBenchmark needed5.35B params

Run with ToolPiper

Model not in the list? Paste a HuggingFace URL or ID for an instant fit check.

Frequently Asked Questions

How much RAM do I need to run LLMs on a Mac?

It depends on the model size and quantization. A 7B parameter model at Q4 quantization needs about 5 GB of RAM, while a 70B model needs 40+ GB. Apple Silicon Macs use unified memory, so your entire RAM pool is available for model weights — no separate VRAM required.

Can I run a 70B model on a MacBook Air?

Not comfortably. A 70B model at Q4 quantization needs about 40 GB of RAM. The MacBook Air maxes out at 24-32 GB depending on the generation. You'd need a Mac Studio or MacBook Pro with 48+ GB for a 70B model to run well.

What's the fastest LLM I can run on my Mac?

Speed depends on your chip's memory bandwidth and the model size. Smaller models (3-7B) run fastest — expect 40-70+ tokens per second on M2 Pro or better. Use the calculator above to see estimated speeds for your specific Mac.

What does quantization mean for model quality?

Quantization reduces model precision to use less memory. Q8 (8-bit) is nearly lossless. Q4 (4-bit) reduces memory by ~75% with minor quality loss — it's the sweet spot for most users. Q2 (2-bit) saves the most memory but noticeably degrades output quality.

How is Apple Silicon different from NVIDIA for LLMs?

Apple Silicon uses unified memory — CPU and GPU share the same RAM pool. A Mac with 32 GB can load a 28 GB model directly. On NVIDIA systems, you're limited by GPU VRAM (typically 8-24 GB on consumer cards), even if the PC has 64 GB of system RAM.

Does ToolPiper use GPU or CPU for inference?

ToolPiper uses Metal GPU acceleration via llama.cpp for LLM inference on Apple Silicon. The GPU and CPU share unified memory, so there's no data transfer overhead. The Neural Engine (ANE) is used for specific tasks like super-resolution and pose detection.

Can I run multiple models at the same time?

Yes, if you have enough RAM. ToolPiper manages model loading and can keep multiple models in memory simultaneously. When memory gets tight, it automatically evicts the least recently used model to make room for a new one.

What's the difference between GGUF and other formats?

GGUF is the standard format for running quantized models with llama.cpp (and ToolPiper). It supports all quantization levels and runs on CPU+GPU. MLX is Apple's format optimized for Apple Silicon. AWQ and GPTQ are NVIDIA-focused formats that don't run natively on Mac.

Browse the whole catalog

A cross-section of all 6563 models. Open any one to see which Macs run it, then follow its related models to work through the rest of the catalog.

Model database updated: 2026-08-21 · 6563 models