OTel 2.0 LLM 31B IT
General model by farbodtavakkoli · 31.27B parameters · Released 2026-07-23
Updated 2026-10-16
Everything this chip runs, machine by machine: MacBook Pro 14" M5 Pro, MacBook Pro 16" M5 Pro, Mac mini M5 Pro
Tight fit
EstimatedOTel 2.0 LLM 31B IT needs about 19.8 GB or more of the 20.6 GB available for models at Q5_K_M, leaving little room for the context cache, the recurrent state and the runtime's working memory. ToolPiper checks it on your Mac.
Alternative: Q4_K_M (about 16.9 GB or more, ~9 tok/s · Estimated)
Specifications
Quantization Options
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A browser cannot measure the runtime's working memory, so each fit is graded by the memory it does know and marked Estimated: "Fits with room" has at least 20% more memory available than it is known to need, "Tight fit" less, and "Won't fit" exceeds the budget on known memory alone. Only ToolPiper's check on your Mac replaces the estimate. Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. Recommended order ranks each model at 4-bit when it fits there and lists first the models that run well: room to spare and at least 10 tok/s. It then weighs size and Hugging Face downloads, which stand in for capability and are not measured answer quality, and becomes a range where evidence is missing.
| Quantization | Memory | Speed | Verdict |
|---|---|---|---|
| Q8_0 | about 30.6 GB or more | ~5 tok/s · Estimated | Won't fit |
| Q6_K | about 23.3 GB or more | ~7 tok/s · Estimated | Won't fit |
| Q5_K_M Recommended | about 19.8 GB or more | ~8 tok/s · Estimated | Tight fit |
| Q4_K_M | about 16.9 GB or more | ~9 tok/s · Estimated | Fits with room |
| Q3_K_M | about 14.0 GB or more | ~11 tok/s · Estimated | Fits with room |
| Q2_K | about 10.8 GB or more | ~15 tok/s · Estimated | Fits with room |
Which Mac Can Run OTel 2.0 LLM 31B IT?
Affiliate disclosure: the shop icons in this table are Amazon affiliate links. As an Amazon Associate, ModelPiper earns from qualifying purchases. Every fit rating, quantization and tok/s figure below is computed from the hardware specs and is not influenced by that.
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A browser cannot measure the runtime's working memory, so each fit is graded by the memory it does know and marked Estimated: "Fits with room" has at least 20% more memory available than it is known to need, "Tight fit" less, and "Won't fit" exceeds the budget on known memory alone. Only ToolPiper's check on your Mac replaces the estimate. Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. Recommended order ranks each model at 4-bit when it fits there and lists first the models that run well: room to spare and at least 10 tok/s. It then weighs size and Hugging Face downloads, which stand in for capability and are not measured answer quality, and becomes a range where evidence is missing.
Smallest Mac where it fits with room
Q2_K · ~10 tok/s · 67% RAM · Fits with room (estimated)
| Fit | Mac | Quant | tok/s | RAM % |
|---|---|---|---|---|
| Fits with room | Mac Studio · M5 Ultra 96GB | Q8_0 | ~21 | 32% |
| Fits with room | Mac Studio · M5 Ultra 256GB | Q8_0 | ~21 | 12% |
| Fits with room | Mac Studio · M5 Ultra 512GB | Q8_0 | ~21 | 6% |
| Fits with room | Mac Studio · M3 Ultra 96GB | Q8_0 | ~14 | 32% |
| Fits with room | Mac Studio · M3 Ultra 256GB | Q8_0 | ~14 | 12% |
| Fits with room | Mac Studio · M3 Ultra 512GB | Q8_0 | ~14 | 6% |
| Fits with room | Mac Studio · M1 Ultra 64GB | Q8_0 | ~13 | 48% |
| Fits with room | Mac Studio · M1 Ultra 128GB | Q8_0 | ~13 | 24% |
| Fits with room | Mac Studio · M2 Ultra 64GB | Q8_0 | ~13 | 48% |
| Fits with room | Mac Studio · M2 Ultra 128GB | Q8_0 | ~13 | 24% |
| Fits with room | Mac Studio · M2 Ultra 192GB | Q8_0 | ~13 | 16% |
| Fits with room | MacBook Pro 14" · M5 Max 48GB | Q8_0 | ~10 | 64% |
| Fits with room | MacBook Pro 14" · M5 Max 64GB | Q8_0 | ~10 | 48% |
| Fits with room | MacBook Pro 14" · M5 Max 128GB | Q8_0 | ~10 | 24% |
| Fits with room | MacBook Pro 16" · M5 Max 48GB | Q8_0 | ~10 | 64% |
| Fits with room | MacBook Pro 16" · M5 Max 64GB | Q8_0 | ~10 | 48% |
| Fits with room | MacBook Pro 16" · M5 Max 128GB | Q8_0 | ~10 | 24% |
| Fits with room | Mac Studio · M5 Max 48GB | Q8_0 | ~10 | 64% |
| Fits with room | Mac Studio · M5 Max 64GB | Q8_0 | ~10 | 48% |
| Fits with room | Mac Studio · M5 Max 128GB | Q8_0 | ~10 | 24% |
| Fits with room | MacBook Pro 14" · M1 Pro 16GB | Q2_K | ~10 | 67% |
| Fits with room | MacBook Pro 14" · M2 Pro 16GB | Q2_K | ~10 | 67% |
| Fits with room | MacBook Pro 16" · M1 Pro 16GB | Q2_K | ~10 | 67% |
| Fits with room | MacBook Pro 16" · M2 Pro 16GB | Q2_K | ~10 | 67% |
| Fits with room | Mac mini · M2 Pro 16GB | Q2_K | ~10 | 67% |
| Fits with room | MacBook Pro 14" · M4 Max 48GB | Q8_0 | ~9 | 64% |
| Fits with room | MacBook Pro 14" · M4 Max 64GB | Q8_0 | ~9 | 48% |
| Fits with room | MacBook Pro 14" · M4 Max 128GB | Q8_0 | ~9 | 24% |
| Fits with room | MacBook Pro 16" · M4 Max 48GB | Q8_0 | ~9 | 64% |
| Fits with room | MacBook Pro 16" · M4 Max 64GB | Q8_0 | ~9 | 48% |
| Fits with room | MacBook Pro 16" · M4 Max 128GB | Q8_0 | ~9 | 24% |
| Fits with room | Mac Studio · M4 Max 48GB | Q8_0 | ~9 | 64% |
| Fits with room | Mac Studio · M4 Max 64GB | Q8_0 | ~9 | 48% |
| Fits with room | Mac Studio · M4 Max 128GB | Q8_0 | ~9 | 24% |
| Fits with room | MacBook Air · M5 16GB | Q2_K | ~7 | 67% |
| Fits with room | MacBook Pro 14" · M5 16GB | Q2_K | ~7 | 67% |
| Fits with room | Mac mini · M6 16GB | Q2_K | ~7 | 67% |
| Fits with room | MacBook Pro 14" · M1 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | MacBook Pro 14" · M2 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | MacBook Pro 14" · M2 Max 96GB | Q8_0 | ~7 | 32% |
| Fits with room | MacBook Pro 14" · M3 Max 48GB | Q8_0 | ~7 | 64% |
| Fits with room | MacBook Pro 14" · M3 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | MacBook Pro 14" · M3 Max 128GB | Q8_0 | ~7 | 24% |
| Fits with room | MacBook Pro 16" · M1 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | MacBook Pro 16" · M2 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | MacBook Pro 16" · M2 Max 96GB | Q8_0 | ~7 | 32% |
| Fits with room | MacBook Pro 16" · M3 Max 48GB | Q8_0 | ~7 | 64% |
| Fits with room | MacBook Pro 16" · M3 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | MacBook Pro 16" · M3 Max 128GB | Q8_0 | ~7 | 24% |
| Fits with room | Mac Studio · M1 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | Mac Studio · M2 Max 64GB | Q8_0 | ~7 | 48% |
| Fits with room | Mac Studio · M2 Max 96GB | Q8_0 | ~7 | 32% |
| Fits with room | MacBook Air · M4 16GB | Q2_K | ~6 | 67% |
| Fits with room | MacBook Pro 14" · M4 16GB | Q2_K | ~6 | 67% |
| Fits with room | Mac mini · M4 16GB | Q2_K | ~6 | 67% |
| Fits with room | iMac · M4 16GB | Q2_K | ~6 | 67% |
| Fits with room | MacBook Pro 14" · M5 Pro 48GB | Q8_0 | ~5 | 64% |
| Fits with room | MacBook Pro 14" · M5 Pro 64GB | Q8_0 | ~5 | 48% |
| Fits with room | MacBook Pro 16" · M5 Pro 48GB | Q8_0 | ~5 | 64% |
| Fits with room | MacBook Pro 16" · M5 Pro 64GB | Q8_0 | ~5 | 48% |
| Fits with room | Mac mini · M5 Pro 48GB | Q8_0 | ~5 | 64% |
| Fits with room | Mac mini · M5 Pro 64GB | Q8_0 | ~5 | 48% |
| Fits with room | MacBook Pro 14" · M3 Max 96GB | Q8_0 | ~5 | 32% |
| Fits with room | MacBook Pro 16" · M3 Max 96GB | Q8_0 | ~5 | 32% |
| Fits with room | MacBook Air · M2 16GB | Q2_K | ~5 | 67% |
| Fits with room | MacBook Air · M3 16GB | Q2_K | ~5 | 67% |
| Fits with room | MacBook Pro 14" · M3 16GB | Q2_K | ~5 | 67% |
| Fits with room | Mac mini · M2 16GB | Q2_K | ~5 | 67% |
| Fits with room | iMac · M3 16GB | Q2_K | ~5 | 67% |
| Fits with room | MacBook Pro 14" · M4 Pro 48GB | Q8_0 | ~5 | 64% |
| Fits with room | MacBook Pro 16" · M4 Pro 48GB | Q8_0 | ~5 | 64% |
| Fits with room | Mac mini · M4 Pro 48GB | Q8_0 | ~5 | 64% |
| Fits with room | Mac mini · M4 Pro 64GB | Q8_0 | ~5 | 48% |
| Fits with room | MacBook Air · M1 16GB | Q2_K | ~3 | 67% |
| Fits with room | Mac mini · M1 16GB | Q2_K | ~3 | 67% |
| Fits with room | iMac · M1 16GB | Q2_K | ~3 | 67% |
| Tight fit | MacBook Pro 14" · M1 Max 32GB | Q6_K | ~9 | 73% |
| Tight fit | MacBook Pro 14" · M2 Max 32GB | Q6_K | ~9 | 73% |
| Tight fit | MacBook Pro 16" · M1 Max 32GB | Q6_K | ~9 | 73% |
| Tight fit | MacBook Pro 16" · M2 Max 32GB | Q6_K | ~9 | 73% |
| Tight fit | Mac Studio · M1 Max 32GB | Q6_K | ~9 | 73% |
| Tight fit | Mac Studio · M2 Max 32GB | Q6_K | ~9 | 73% |
| Tight fit | MacBook Pro 14" · M5 Pro 24GB | Q5_K_M | ~8 | 83% |
| Tight fit | MacBook Pro 16" · M5 Pro 24GB | Q5_K_M | ~8 | 83% |
| Tight fit | Mac mini · M5 Pro 24GB | Q5_K_M | ~8 | 83% |
| Tight fit | MacBook Pro 14" · M5 Max 36GB | Q8_0 | ~8 | 85% |
| Tight fit | MacBook Pro 16" · M5 Max 36GB | Q8_0 | ~8 | 85% |
| Tight fit | Mac Studio · M5 Max 36GB | Q8_0 | ~8 | 85% |
| Tight fit | MacBook Pro 14" · M4 Pro 24GB | Q5_K_M | ~7 | 83% |
| Tight fit | MacBook Pro 16" · M4 Pro 24GB | Q5_K_M | ~7 | 83% |
| Tight fit | Mac mini · M4 Pro 24GB | Q5_K_M | ~7 | 83% |
| Tight fit | MacBook Pro 14" · M4 Max 36GB | Q8_0 | ~7 | 85% |
| Tight fit | MacBook Pro 16" · M4 Max 36GB | Q8_0 | ~7 | 85% |
| Tight fit | Mac Studio · M4 Max 36GB | Q8_0 | ~7 | 85% |
| Tight fit | MacBook Pro 14" · M3 Pro 18GB | Q3_K_M | ~5 | 78% |
| Tight fit | MacBook Pro 16" · M3 Pro 18GB | Q3_K_M | ~5 | 78% |
| Tight fit | MacBook Pro 14" · M3 Max 36GB | Q8_0 | ~5 | 85% |
| Tight fit | MacBook Pro 16" · M3 Max 36GB | Q8_0 | ~5 | 85% |
| Tight fit | MacBook Pro 14" · M1 Pro 32GB | Q6_K | ~4 | 73% |
| Tight fit | MacBook Pro 14" · M2 Pro 32GB | Q6_K | ~4 | 73% |
| Tight fit | MacBook Pro 16" · M1 Pro 32GB | Q6_K | ~4 | 73% |
| Tight fit | MacBook Pro 16" · M2 Pro 32GB | Q6_K | ~4 | 73% |
| Tight fit | Mac mini · M2 Pro 32GB | Q6_K | ~4 | 73% |
| Tight fit | Mac mini · M6 24GB | Q5_K_M | ~4 | 83% |
| Tight fit | MacBook Air · M5 24GB | Q5_K_M | ~4 | 83% |
| Tight fit | MacBook Pro 14" · M5 24GB | Q5_K_M | ~4 | 83% |
| Tight fit | Mac mini · M6 32GB | Q6_K | ~4 | 73% |
| Tight fit | MacBook Air · M5 32GB | Q6_K | ~3 | 73% |
| Tight fit | MacBook Pro 14" · M5 32GB | Q6_K | ~3 | 73% |
| Tight fit | MacBook Air · M4 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | MacBook Pro 14" · M4 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | Mac mini · M4 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | iMac · M4 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | MacBook Air · M4 32GB | Q6_K | ~3 | 73% |
| Tight fit | MacBook Pro 14" · M4 32GB | Q6_K | ~3 | 73% |
| Tight fit | Mac mini · M4 32GB | Q6_K | ~3 | 73% |
| Tight fit | iMac · M4 32GB | Q6_K | ~3 | 73% |
| Tight fit | MacBook Air · M2 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | MacBook Air · M3 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | MacBook Pro 14" · M3 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | Mac mini · M2 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | iMac · M3 24GB | Q5_K_M | ~3 | 83% |
| Tight fit | MacBook Pro 14" · M3 Pro 36GB | Q8_0 | ~3 | 85% |
| Tight fit | MacBook Pro 16" · M3 Pro 36GB | Q8_0 | ~3 | 85% |
| Won't fit | MacBook Air · M2 8GB | — | — | 135% |
| Won't fit | MacBook Air · M3 8GB | — | — | 135% |
| Won't fit | MacBook Pro 14" · M3 8GB | — | — | 135% |
| Won't fit | Mac mini · M2 8GB | — | — | 135% |
| Won't fit | iMac · M3 8GB | — | — | 135% |
| Won't fit | MacBook Air · M1 8GB | — | — | 135% |
| Won't fit | Mac mini · M1 8GB | — | — | 135% |
| Won't fit | iMac · M1 8GB | — | — | 135% |
Models similar to OTel 2.0 LLM 31B IT
Closest matches by use case and parameter count.
Run OTel 2.0 LLM 31B IT locally on your Mac
ToolPiper downloads, manages, and runs models with one click. Apple Silicon optimized.
Get ToolPiper free