General model by vikp · 0.31B parameters
texify fits comfortably in your 24 GB Mac using Q8_0 quantization, using 4% of your RAM.
~519 tok/s
Q8_0 · 0.8 GB
| Quantization | Memory | Speed | Fits? |
|---|---|---|---|
| Q8_0 Recommended | 0.8 GB | ~519 tok/s | ✓ |
| Q6_K | 0.8 GB | ~681 tok/s | ✓ |
| Q5_K_M | 0.7 GB | ~801 tok/s | ✓ |
| Q4_K_M | 0.7 GB | ~939 tok/s | ✓ |
| Q3_K_M | 0.7 GB | ~1,135 tok/s | ✓ |
| Q2_K | 0.6 GB | ~1,472 tok/s | ✓ |
ToolPiper downloads, manages, and runs models with one click. Apple Silicon optimized.
Get ToolPiper — Free