SmolLM2 360M
General model by huggingfacetb · 0.36B parameters · Released 2024-10-31
Updated 2026-10-16
Everything this chip runs, machine by machine: MacBook Pro 14" M5 Pro, MacBook Pro 16" M5 Pro, Mac mini M5 Pro
Fit unconfirmed
SmolLM2 360M needs at least 0.7 of the 20.6 GiB available for models at Q8_0. The runtime's working memory is not measured, so the total is unconfirmed.
Specifications
GGUF Sources
Quantization Options
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A fit is confirmed only when every component is known, so a model whose known memory fits reads "Fit unconfirmed" until ToolPiper measures it on your Mac, and one whose known memory alone exceeds the budget reads "Won't fit". Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. The recommendation score weighs declared preferences, not measured answer quality, and becomes a range where evidence is missing.
| Quantization | Memory | Speed | Verdict |
|---|---|---|---|
| Q8_0 Recommended | at least 0.7 GiB | ~444 tok/s · Estimated | Fit unconfirmed |
| Q6_K | at least 0.6 GiB | ~583 tok/s · Estimated | Fit unconfirmed |
| Q5_K_M | at least 0.5 GiB | ~686 tok/s · Estimated | Fit unconfirmed |
| Q4_K_M | at least 0.5 GiB | ~805 tok/s · Estimated | Fit unconfirmed |
| Q3_K_M | at least 0.5 GiB | ~972 tok/s · Estimated | Fit unconfirmed |
| Q2_K | at least 0.4 GiB | ~1,261 tok/s · Estimated | Fit unconfirmed |
Which Mac Can Run SmolLM2 360M?
Affiliate disclosure: the shop icons in this table are Amazon affiliate links. As an Amazon Associate, ModelPiper earns from qualifying purchases. Every fit rating, quantization and tok/s figure below is computed from the hardware specs and is not influenced by that.
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A fit is confirmed only when every component is known, so a model whose known memory fits reads "Fit unconfirmed" until ToolPiper measures it on your Mac, and one whose known memory alone exceeds the budget reads "Won't fit". Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. The recommendation score weighs declared preferences, not measured answer quality, and becomes a range where evidence is missing.
Minimum Mac
Q8_0 · ~145 tok/s · 8% RAM · Fit unconfirmed
Known memory leaves the good-fit margin free; the runtime's working memory is not measured.
Models similar to SmolLM2 360M
Closest matches by use case and parameter count.
Run SmolLM2 360M locally on your Mac
ToolPiper downloads, manages, and runs models with one click. Apple Silicon optimized.
Get ToolPiper free