How much GPU VRAM do Qwen 2.5 7B, 14B, 32B, and 72B require in Ollama (Q4_K_M)?
At 8K context in GGUF Q4_K_M, Qwen 2.5 7B needs ~6.0 GB (fits 8GB GPUs), 14B needs ~10.9 GB (fits RTX 3060 12GB), 32B needs ~22.6 GB (fits RTX 4090 24GB or 32GB Mac), and 72B needs ~49 GB (fits 64GB Apple Silicon or dual 24GB GPUs).