← Back to all models

Qwen3.5 122B A10B FP8

General model by Alibaba · 125.09B parameters

Won't Fit

Qwen3.5 122B A10B FP8 requires 55.0 GB which exceeds your available memory. You need a Mac with more RAM.

Quantization Options

QuantizationMemorySpeedFits?
Q8_0 140.0 GB~14 tok/s
Q6_K 108.8 GB~19 tok/s
Q5_K_M 93.8 GB~22 tok/s
Q4_K_M 81.3 GB~26 tok/s
Q3_K_M 68.7 GB~31 tok/s
Q2_K 55.0 GB~41 tok/s

Specifications

Parameters125.1B
Architectureqwen3_5_moe
Context Length262K
CategoryGeneral
Capabilitiestool_use
Mixture of Experts 256 experts, 8 active
Formatgguf
Minimum RAM69.9 GB
HuggingFace Downloads899,847

Which Mac Can Run Qwen3.5 122B A10B FP8?

Minimum Mac

MacBook Pro 14" — M6 Max 192GB

Q8_0 · ~48 tok/s · 73% RAM

MacQuanttok/sRAM %
MacBook Pro 14" · M6 Max 192GB Q8_0 ~48 73%
MacBook Pro 16" · M6 Max 192GB Q8_0 ~48 73%
MacBook Pro 16" · M6 Ultra 192GB Q8_0 ~97 73%
Mac Studio · M2 Ultra 192GB Q8_0 ~42 73%
Mac Studio · M4 Ultra 192GB Q8_0 ~43 73%
Mac Studio · M6 Max 192GB Q8_0 ~48 73%
Mac Studio · M6 Ultra 192GB Q8_0 ~97 73%
Mac Pro · M2 Ultra 192GB Q8_0 ~42 73%
Mac Pro · M4 Ultra 192GB Q8_0 ~43 73%
Mac Pro · M6 Ultra 192GB Q8_0 ~97 73%
MacBook Pro 16" · M6 Ultra 256GB Q8_0 ~97 55%
Mac Studio · M4 Ultra 256GB Q8_0 ~43 55%
Mac Studio · M6 Ultra 256GB Q8_0 ~97 55%
Mac Pro · M4 Ultra 256GB Q8_0 ~43 55%
Mac Pro · M6 Ultra 256GB Q8_0 ~97 55%
MacBook Pro 16" · M6 Ultra 384GB Q8_0 ~97 36%
Mac Studio · M6 Ultra 384GB Q8_0 ~97 36%
Mac Pro · M6 Ultra 384GB Q8_0 ~97 36%
MacBook Pro 14" · M5 Pro 64GB Q2_K ~46 86%
MacBook Pro 14" · M5 Max 64GB Q2_K ~92 86%
MacBook Pro 14" · M6 Pro 64GB Q2_K ~61 86%
MacBook Pro 14" · M6 Max 64GB Q2_K ~137 86%
MacBook Pro 16" · M1 Max 64GB Q2_K ~60 86%
MacBook Pro 16" · M2 Max 64GB Q2_K ~60 86%
MacBook Pro 16" · M3 Max 64GB Q2_K ~60 86%
MacBook Pro 16" · M4 Max 64GB Q2_K ~81 86%
MacBook Pro 16" · M5 Max 64GB Q2_K ~92 86%
MacBook Pro 16" · M6 Pro 64GB Q2_K ~61 86%
MacBook Pro 16" · M6 Max 64GB Q2_K ~137 86%
Mac Mini · M6 Pro 64GB Q2_K ~61 86%
Mac Studio · M1 Max 64GB Q2_K ~60 86%
Mac Studio · M1 Ultra 64GB Q2_K ~119 86%
Mac Studio · M2 Max 64GB Q2_K ~60 86%
Mac Studio · M2 Ultra 64GB Q2_K ~119 86%
Mac Studio · M4 Max 64GB Q2_K ~81 86%
Mac Studio · M6 Max 64GB Q2_K ~137 86%
MacBook Pro 16" · M2 Max 96GB Q4_K_M ~38 85%
MacBook Pro 16" · M3 Max 96GB Q4_K_M ~38 85%
Mac Studio · M2 Max 96GB Q4_K_M ~38 85%
Mac Studio · M2 Ultra 96GB Q4_K_M ~76 85%
Mac Pro · M2 Ultra 96GB Q4_K_M ~76 85%
MacBook Pro 14" · M5 Max 128GB Q6_K ~42 85%
MacBook Pro 14" · M6 Max 128GB Q6_K ~64 85%
MacBook Pro 16" · M3 Max 128GB Q6_K ~28 85%
MacBook Pro 16" · M4 Max 128GB Q6_K ~38 85%
MacBook Pro 16" · M5 Max 128GB Q6_K ~42 85%
MacBook Pro 16" · M6 Max 128GB Q6_K ~64 85%
Mac Studio · M1 Ultra 128GB Q6_K ~55 85%
Mac Studio · M2 Ultra 128GB Q6_K ~55 85%
Mac Studio · M4 Max 128GB Q6_K ~38 85%
Mac Studio · M4 Ultra 128GB Q6_K ~56 85%
Mac Studio · M6 Max 128GB Q6_K ~64 85%
Mac Pro · M2 Ultra 128GB Q6_K ~55 85%
Mac Pro · M4 Ultra 128GB Q6_K ~56 85%
MacBook Air · M1 8GB 687%
MacBook Air · M2 8GB 687%
MacBook Air · M3 8GB 687%
Mac Mini · M1 8GB 687%
Mac Mini · M2 8GB 687%
iMac · M1 8GB 687%
iMac · M3 8GB 687%
MacBook Air · M1 16GB 344%
MacBook Air · M2 16GB 344%
MacBook Air · M3 16GB 344%
MacBook Air · M4 16GB 344%
MacBook Air · M5 16GB 344%
MacBook Air · M6 16GB 344%
MacBook Pro 14" · M1 Pro 16GB 344%
MacBook Pro 14" · M2 Pro 16GB 344%
MacBook Pro 14" · M5 16GB 344%
MacBook Pro 14" · M6 16GB 344%
MacBook Pro 16" · M1 Pro 16GB 344%
MacBook Pro 16" · M2 Pro 16GB 344%
Mac Mini · M1 16GB 344%
Mac Mini · M2 16GB 344%
Mac Mini · M2 Pro 16GB 344%
Mac Mini · M4 16GB 344%
Mac Mini · M6 16GB 344%
iMac · M1 16GB 344%
iMac · M3 16GB 344%
iMac · M4 16GB 344%
iMac · M6 16GB 344%
MacBook Pro 14" · M3 Pro 18GB 305%
MacBook Pro 16" · M3 Pro 18GB 305%
MacBook Air · M2 24GB 229%
MacBook Air · M3 24GB 229%
MacBook Air · M4 24GB 229%
MacBook Air · M5 24GB 229%
MacBook Air · M6 24GB 229%
MacBook Pro 14" · M4 Pro 24GB 229%
MacBook Pro 14" · M5 24GB 229%
MacBook Pro 14" · M5 Pro 24GB 229%
MacBook Pro 14" · M6 24GB 229%
MacBook Pro 14" · M6 Pro 24GB 229%
MacBook Pro 16" · M4 Pro 24GB 229%
MacBook Pro 16" · M5 Pro 24GB 229%
MacBook Pro 16" · M6 Pro 24GB 229%
Mac Mini · M2 24GB 229%
Mac Mini · M4 24GB 229%
Mac Mini · M4 Pro 24GB 229%
Mac Mini · M6 24GB 229%
Mac Mini · M6 Pro 24GB 229%
iMac · M3 24GB 229%
iMac · M4 24GB 229%
iMac · M6 24GB 229%
MacBook Air · M4 32GB 172%
MacBook Air · M5 32GB 172%
MacBook Air · M6 32GB 172%
MacBook Pro 14" · M1 Pro 32GB 172%
MacBook Pro 14" · M2 Pro 32GB 172%
MacBook Pro 14" · M5 32GB 172%
MacBook Pro 14" · M6 32GB 172%
MacBook Pro 16" · M1 Pro 32GB 172%
MacBook Pro 16" · M1 Max 32GB 172%
MacBook Pro 16" · M2 Pro 32GB 172%
MacBook Pro 16" · M2 Max 32GB 172%
Mac Mini · M2 Pro 32GB 172%
Mac Mini · M4 32GB 172%
Mac Mini · M6 32GB 172%
Mac Studio · M1 Max 32GB 172%
Mac Studio · M2 Max 32GB 172%
iMac · M4 32GB 172%
iMac · M6 32GB 172%
MacBook Pro 14" · M3 Pro 36GB 153%
MacBook Pro 14" · M5 Max 36GB 153%
MacBook Pro 16" · M3 Pro 36GB 153%
MacBook Pro 16" · M3 Max 36GB 153%
MacBook Pro 16" · M4 Max 36GB 153%
MacBook Pro 16" · M5 Max 36GB 153%
Mac Studio · M4 Max 36GB 153%
MacBook Pro 14" · M4 Pro 48GB 115%
MacBook Pro 14" · M5 Pro 48GB 115%
MacBook Pro 14" · M5 Max 48GB 115%
MacBook Pro 14" · M6 Pro 48GB 115%
MacBook Pro 14" · M6 Max 48GB 115%
MacBook Pro 16" · M3 Max 48GB 115%
MacBook Pro 16" · M4 Pro 48GB 115%
MacBook Pro 16" · M4 Max 48GB 115%
MacBook Pro 16" · M5 Pro 48GB 115%
MacBook Pro 16" · M5 Max 48GB 115%
MacBook Pro 16" · M6 Pro 48GB 115%
MacBook Pro 16" · M6 Max 48GB 115%
Mac Mini · M4 Pro 48GB 115%
Mac Mini · M6 Pro 48GB 115%
Mac Studio · M6 Max 48GB 115%

Run Qwen3.5 122B A10B FP8 locally on your Mac

ToolPiper downloads, manages, and runs models with one click. Apple Silicon optimized.

Get ToolPiper — Free