InternVL3 38B
Multimodal model by opengvlab · 38.39B parameters · Released 2025-04-10
Updated 2026-10-16
Everything this chip runs, machine by machine: MacBook Pro 14" M5 Pro, MacBook Pro 16" M5 Pro, Mac mini M5 Pro
Fit unconfirmed
InternVL3 38B needs at least 17.2 of the 20.6 GiB available for models at Q3_K_M. The context cache, the recurrent state and the runtime's working memory are not measured, so the total is unconfirmed.
Specifications
GGUF Sources
Quantization Options
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A fit is confirmed only when every component is known, so a model whose known memory fits reads "Fit unconfirmed" until ToolPiper measures it on your Mac, and one whose known memory alone exceeds the budget reads "Won't fit". Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. The recommendation score weighs declared preferences, not measured answer quality, and becomes a range where evidence is missing.
| Quantization | Memory | Speed | Verdict |
|---|---|---|---|
| Q8_0 | at least 37.5 GiB | ~4 tok/s · Estimated | Won't fit |
| Q6_K | at least 28.6 GiB | ~5 tok/s · Estimated | Won't fit |
| Q5_K_M | at least 24.3 GiB | ~6 tok/s · Estimated | Won't fit |
| Q4_K_M | at least 20.7 GiB | ~8 tok/s · Estimated | Won't fit |
| Q3_K_M Recommended | at least 17.2 GiB | ~9 tok/s · Estimated | Fit unconfirmed |
| Q2_K | at least 13.2 GiB | ~12 tok/s · Estimated | Fit unconfirmed |
Which Mac Can Run InternVL3 38B?
Affiliate disclosure: the shop icons in this table are Amazon affiliate links. As an Amazon Associate, ModelPiper earns from qualifying purchases. Every fit rating, quantization and tok/s figure below is computed from the hardware specs and is not influenced by that.
Unvalidated forecasts for an 8K text context under a declared full-GPU scenario, at the lowest GPU bin sold with the chosen memory. Memory is reported as its components: exact artifact bytes and a KV allocation derived from a declared attention layout where the catalog carries them, a parameter proxy with no error bound where it does not, and the runtime's working memory, which a browser cannot measure. A fit is confirmed only when every component is known, so a model whose known memory fits reads "Fit unconfirmed" until ToolPiper measures it on your Mac, and one whose known memory alone exceeds the budget reads "Won't fit". Estimated speed ignores prompt length and prefill, and can overstate long-context performance. No measured speed error range is available. The recommendation score weighs declared preferences, not measured answer quality, and becomes a range where evidence is missing.
Minimum Mac
Q3_K_M · ~9 tok/s · 72% RAM · Fit unconfirmed
Known memory leaves the good-fit margin free; the context cache, the recurrent state and the runtime's working memory are not measured.
Models similar to InternVL3 38B
Closest matches by use case and parameter count.
- Qwen3 VL 32B Thinking 33.4B · Multimodal
- Muse Glimmer 30B assistant 30B · Multimodal
- Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU 27.8B · Multimodal
- Qwen3.5 9B Base 9.7B · Multimodal
- InternVL3_5 8B HF 8.5B · Multimodal
- InternVL2 4B 4.2B · Multimodal
- InternVL3 9B 9.1B · General
Run InternVL3 38B locally on your Mac
ToolPiper downloads, manages, and runs models with one click. Apple Silicon optimized.
Get ToolPiper free