InternVL3 78B
Multimodal model by opengvlab · 78.41B parameters · Released 2025-04-10
Updated 2026-10-16
Everything this chip runs, machine by machine: MacBook Pro 14" M5 Pro, MacBook Pro 16" M5 Pro, Mac mini M5 Pro
Won't fit
EstimatedInternVL3 78B needs about 27.0 GB or more, which is over the 20.6 GB available for models, so it needs a Mac with more memory.
Specifications
GGUF Sources
Quantization Options
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A browser cannot measure the runtime's working memory, so each fit is graded by the memory it does know and marked Estimated: "Fits with room" has at least 20% more memory available than it is known to need, "Tight fit" less, and "Won't fit" exceeds the budget on known memory alone. Only ToolPiper's check on your Mac replaces the estimate. Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. Recommended order ranks each model at 4-bit when it fits there and lists first the models that run well: room to spare and at least 10 tok/s. It then weighs size and Hugging Face downloads, which stand in for capability and are not measured answer quality, and becomes a range where evidence is missing.
| Quantization | Memory | Speed | Verdict |
|---|---|---|---|
| Q8_0 | about 76.7 GB or more | ~2 tok/s · Estimated | Won't fit |
| Q6_K | about 58.4 GB or more | ~3 tok/s · Estimated | Won't fit |
| Q5_K_M | about 49.7 GB or more | ~3 tok/s · Estimated | Won't fit |
| Q4_K_M | about 42.4 GB or more | ~4 tok/s · Estimated | Won't fit |
| Q3_K_M | about 35.1 GB or more | ~4 tok/s · Estimated | Won't fit |
| Q2_K | about 27.0 GB or more | ~6 tok/s · Estimated | Won't fit |
Which Mac Can Run InternVL3 78B?
Affiliate disclosure: the shop icons in this table are Amazon affiliate links. As an Amazon Associate, ModelPiper earns from qualifying purchases. Every fit rating, quantization and tok/s figure below is computed from the hardware specs and is not influenced by that.
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A browser cannot measure the runtime's working memory, so each fit is graded by the memory it does know and marked Estimated: "Fits with room" has at least 20% more memory available than it is known to need, "Tight fit" less, and "Won't fit" exceeds the budget on known memory alone. Only ToolPiper's check on your Mac replaces the estimate. Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. Recommended order ranks each model at 4-bit when it fits there and lists first the models that run well: room to spare and at least 10 tok/s. It then weighs size and Hugging Face downloads, which stand in for capability and are not measured answer quality, and becomes a range where evidence is missing.
Smallest Mac where it fits with room
Q8_0 · ~5 tok/s · 60% RAM · Fits with room (estimated)
Models similar to InternVL3 78B
Closest matches by use case and parameter count.
Run InternVL3 78B locally on your Mac
ToolPiper downloads, manages, and runs models with one click. Apple Silicon optimized.
Get ToolPiper free