← Back to all models

ERNIE 4.5 VL 28B A3B PT

General model by baidu · 29.4B parameters

Tight Fit

ERNIE 4.5 VL 28B A3B PT can run but will be tight at 81% of RAM. Consider a lower quantization or closing other apps.

~9 tok/s

Q4_K_M · 19.5 GB

Alternative: Q3_K_M (16.5 GB, ~11 tok/s)

Quantization Options

QuantizationMemorySpeedFits?
Q8_0 33.3 GB~5 tok/s
Q6_K 25.9 GB~6 tok/s
Q5_K_M 22.4 GB~8 tok/s
Q4_K_M Recommended 19.5 GB~9 tok/s
Q3_K_M 16.5 GB~11 tok/s
Q2_K 13.3 GB~14 tok/s

Specifications

Parameters29.4B
Architectureernie4_5_moe_vl
Context Length131K
CategoryGeneral
Capabilitiesvision
Formatgguf
Minimum RAM16.4 GB
HuggingFace Downloads62,537

Which Mac Can Run ERNIE 4.5 VL 28B A3B PT?

Minimum Mac

MacBook Air — M4 32GB

Q6_K · ~3 tok/s · 81% RAM

MacQuanttok/sRAM %
MacBook Air · M4 32GB Q6_K ~3 81%
MacBook Air · M5 32GB Q6_K ~4 81%
MacBook Air · M6 32GB Q6_K ~5 81%
MacBook Pro 14" · M1 Pro 32GB Q6_K ~5 81%
MacBook Pro 14" · M2 Pro 32GB Q6_K ~5 81%
MacBook Pro 14" · M5 32GB Q6_K ~4 81%
MacBook Pro 14" · M6 32GB Q6_K ~5 81%
MacBook Pro 16" · M1 Pro 32GB Q6_K ~5 81%
MacBook Pro 16" · M1 Max 32GB Q6_K ~9 81%
MacBook Pro 16" · M2 Pro 32GB Q6_K ~5 81%
MacBook Pro 16" · M2 Max 32GB Q6_K ~9 81%
Mac Mini · M2 Pro 32GB Q6_K ~5 81%
Mac Mini · M4 32GB Q6_K ~3 81%
Mac Mini · M6 32GB Q6_K ~5 81%
Mac Studio · M1 Max 32GB Q6_K ~9 81%
Mac Studio · M2 Max 32GB Q6_K ~9 81%
iMac · M4 32GB Q6_K ~3 81%
iMac · M6 32GB Q6_K ~5 81%
MacBook Pro 14" · M3 Pro 36GB Q6_K ~4 72%
MacBook Pro 14" · M5 Max 36GB Q6_K ~14 72%
MacBook Pro 16" · M3 Pro 36GB Q6_K ~4 72%
MacBook Pro 16" · M3 Max 36GB Q6_K ~9 72%
MacBook Pro 16" · M4 Max 36GB Q6_K ~13 72%
MacBook Pro 16" · M5 Max 36GB Q6_K ~14 72%
Mac Studio · M4 Max 36GB Q6_K ~13 72%
MacBook Pro 14" · M4 Pro 48GB Q8_0 ~5 69%
MacBook Pro 14" · M5 Pro 48GB Q8_0 ~5 69%
MacBook Pro 14" · M5 Max 48GB Q8_0 ~11 69%
MacBook Pro 14" · M6 Pro 48GB Q8_0 ~7 69%
MacBook Pro 14" · M6 Max 48GB Q8_0 ~16 69%
MacBook Pro 16" · M3 Max 48GB Q8_0 ~7 69%
MacBook Pro 16" · M4 Pro 48GB Q8_0 ~5 69%
MacBook Pro 16" · M4 Max 48GB Q8_0 ~10 69%
MacBook Pro 16" · M5 Pro 48GB Q8_0 ~5 69%
MacBook Pro 16" · M5 Max 48GB Q8_0 ~11 69%
MacBook Pro 16" · M6 Pro 48GB Q8_0 ~7 69%
MacBook Pro 16" · M6 Max 48GB Q8_0 ~16 69%
Mac Mini · M4 Pro 48GB Q8_0 ~5 69%
Mac Mini · M6 Pro 48GB Q8_0 ~7 69%
Mac Studio · M6 Max 48GB Q8_0 ~16 69%
MacBook Pro 14" · M5 Pro 64GB Q8_0 ~5 52%
MacBook Pro 14" · M5 Max 64GB Q8_0 ~11 52%
MacBook Pro 14" · M6 Pro 64GB Q8_0 ~7 52%
MacBook Pro 14" · M6 Max 64GB Q8_0 ~16 52%
MacBook Pro 16" · M1 Max 64GB Q8_0 ~7 52%
MacBook Pro 16" · M2 Max 64GB Q8_0 ~7 52%
MacBook Pro 16" · M3 Max 64GB Q8_0 ~7 52%
MacBook Pro 16" · M4 Max 64GB Q8_0 ~10 52%
MacBook Pro 16" · M5 Max 64GB Q8_0 ~11 52%
MacBook Pro 16" · M6 Pro 64GB Q8_0 ~7 52%
MacBook Pro 16" · M6 Max 64GB Q8_0 ~16 52%
Mac Mini · M6 Pro 64GB Q8_0 ~7 52%
Mac Studio · M1 Max 64GB Q8_0 ~7 52%
Mac Studio · M1 Ultra 64GB Q8_0 ~14 52%
Mac Studio · M2 Max 64GB Q8_0 ~7 52%
Mac Studio · M2 Ultra 64GB Q8_0 ~14 52%
Mac Studio · M4 Max 64GB Q8_0 ~10 52%
Mac Studio · M6 Max 64GB Q8_0 ~16 52%
MacBook Pro 16" · M2 Max 96GB Q8_0 ~7 35%
MacBook Pro 16" · M3 Max 96GB Q8_0 ~7 35%
Mac Studio · M2 Max 96GB Q8_0 ~7 35%
Mac Studio · M2 Ultra 96GB Q8_0 ~14 35%
Mac Pro · M2 Ultra 96GB Q8_0 ~14 35%
MacBook Pro 14" · M5 Max 128GB Q8_0 ~11 26%
MacBook Pro 14" · M6 Max 128GB Q8_0 ~16 26%
MacBook Pro 16" · M3 Max 128GB Q8_0 ~7 26%
MacBook Pro 16" · M4 Max 128GB Q8_0 ~10 26%
MacBook Pro 16" · M5 Max 128GB Q8_0 ~11 26%
MacBook Pro 16" · M6 Max 128GB Q8_0 ~16 26%
Mac Studio · M1 Ultra 128GB Q8_0 ~14 26%
Mac Studio · M2 Ultra 128GB Q8_0 ~14 26%
Mac Studio · M4 Max 128GB Q8_0 ~10 26%
Mac Studio · M4 Ultra 128GB Q8_0 ~15 26%
Mac Studio · M6 Max 128GB Q8_0 ~16 26%
Mac Pro · M2 Ultra 128GB Q8_0 ~14 26%
Mac Pro · M4 Ultra 128GB Q8_0 ~15 26%
MacBook Pro 14" · M6 Max 192GB Q8_0 ~16 17%
MacBook Pro 16" · M6 Max 192GB Q8_0 ~16 17%
MacBook Pro 16" · M6 Ultra 192GB Q8_0 ~33 17%
Mac Studio · M2 Ultra 192GB Q8_0 ~14 17%
Mac Studio · M4 Ultra 192GB Q8_0 ~15 17%
Mac Studio · M6 Max 192GB Q8_0 ~16 17%
Mac Studio · M6 Ultra 192GB Q8_0 ~33 17%
Mac Pro · M2 Ultra 192GB Q8_0 ~14 17%
Mac Pro · M4 Ultra 192GB Q8_0 ~15 17%
Mac Pro · M6 Ultra 192GB Q8_0 ~33 17%
MacBook Pro 16" · M6 Ultra 256GB Q8_0 ~33 13%
Mac Studio · M4 Ultra 256GB Q8_0 ~15 13%
Mac Studio · M6 Ultra 256GB Q8_0 ~33 13%
Mac Pro · M4 Ultra 256GB Q8_0 ~15 13%
Mac Pro · M6 Ultra 256GB Q8_0 ~33 13%
MacBook Pro 16" · M6 Ultra 384GB Q8_0 ~33 9%
Mac Studio · M6 Ultra 384GB Q8_0 ~33 9%
Mac Pro · M6 Ultra 384GB Q8_0 ~33 9%
MacBook Air · M1 16GB Q2_K ~3 83%
MacBook Air · M2 16GB Q2_K ~5 83%
MacBook Air · M3 16GB Q2_K ~5 83%
MacBook Air · M4 16GB Q2_K ~6 83%
MacBook Air · M5 16GB Q2_K ~8 83%
MacBook Air · M6 16GB Q2_K ~10 83%
MacBook Pro 14" · M1 Pro 16GB Q2_K ~10 83%
MacBook Pro 14" · M2 Pro 16GB Q2_K ~10 83%
MacBook Pro 14" · M5 16GB Q2_K ~8 83%
MacBook Pro 14" · M6 16GB Q2_K ~10 83%
MacBook Pro 16" · M1 Pro 16GB Q2_K ~10 83%
MacBook Pro 16" · M2 Pro 16GB Q2_K ~10 83%
Mac Mini · M1 16GB Q2_K ~3 83%
Mac Mini · M2 16GB Q2_K ~5 83%
Mac Mini · M2 Pro 16GB Q2_K ~10 83%
Mac Mini · M4 16GB Q2_K ~6 83%
Mac Mini · M6 16GB Q2_K ~10 83%
iMac · M1 16GB Q2_K ~3 83%
iMac · M3 16GB Q2_K ~5 83%
iMac · M4 16GB Q2_K ~6 83%
iMac · M6 16GB Q2_K ~10 83%
MacBook Pro 14" · M3 Pro 18GB Q2_K ~8 74%
MacBook Pro 16" · M3 Pro 18GB Q2_K ~8 74%
MacBook Air · M2 24GB Q4_K_M ~3 81%
MacBook Air · M3 24GB Q4_K_M ~3 81%
MacBook Air · M4 24GB Q4_K_M ~4 81%
MacBook Air · M5 24GB Q4_K_M ~5 81%
MacBook Air · M6 24GB Q4_K_M ~7 81%
MacBook Pro 14" · M4 Pro 24GB Q4_K_M ~9 81%
MacBook Pro 14" · M5 24GB Q4_K_M ~5 81%
MacBook Pro 14" · M5 Pro 24GB Q4_K_M ~10 81%
MacBook Pro 14" · M6 24GB Q4_K_M ~7 81%
MacBook Pro 14" · M6 Pro 24GB Q4_K_M ~13 81%
MacBook Pro 16" · M4 Pro 24GB Q4_K_M ~9 81%
MacBook Pro 16" · M5 Pro 24GB Q4_K_M ~10 81%
MacBook Pro 16" · M6 Pro 24GB Q4_K_M ~13 81%
Mac Mini · M2 24GB Q4_K_M ~3 81%
Mac Mini · M4 24GB Q4_K_M ~4 81%
Mac Mini · M4 Pro 24GB Q4_K_M ~9 81%
Mac Mini · M6 24GB Q4_K_M ~7 81%
Mac Mini · M6 Pro 24GB Q4_K_M ~13 81%
iMac · M3 24GB Q4_K_M ~3 81%
iMac · M4 24GB Q4_K_M ~4 81%
iMac · M6 24GB Q4_K_M ~7 81%
MacBook Air · M1 8GB 166%
MacBook Air · M2 8GB 166%
MacBook Air · M3 8GB 166%
Mac Mini · M1 8GB 166%
Mac Mini · M2 8GB 166%
iMac · M1 8GB 166%
iMac · M3 8GB 166%

Run ERNIE 4.5 VL 28B A3B PT locally on your Mac

ToolPiper downloads, manages, and runs models with one click. Apple Silicon optimized.

Get ToolPiper — Free