VRAMNeeded Calculator

What can I run with 16 GB of VRAM?

With 16 GB of VRAM (or unified memory) and an 8K-token conversation, 8 of the 16 language models we track fit comfortably, and the largest is gpt-oss-20b.

Language models (LLMs)

ModelBest precisionMemoryVerdict
gpt-oss-20bOpenAI16-bit (FP16/BF16)14.0 GBFits
Qwen2.5 14B InstructAlibaba Qwen4-bit (Q4_K_M)10.6 GBFits
Qwen3 14BAlibaba Qwen4-bit (Q4_K_M)10.3 GBFits
DeepSeek-R1-0528-Qwen3-8BDeepSeek8-bit (Q8_0)9.9 GBFits
Llama 3.1 8B InstructMeta8-bit (Q8_0)9.6 GBFits
Qwen2.5 7B InstructAlibaba Qwen8-bit (Q8_0)8.6 GBFits
Mistral 7B Instruct v0.3Mistral AI8-bit (Q8_0)8.8 GBFits
Llama 3.2 3B InstructMeta16-bit (FP16/BF16)7.4 GBFits
Qwen3.8 Flash NextAlibaba Qwenneeds 119.6 GB at 4-bit119.6 GB*Too big
gpt-oss-120bOpenAIneeds 63.1 GB at 4-bit63.1 GBToo big
Llama 3.1 70B InstructMetaneeds 45.2 GB at 4-bit45.2 GBToo big
Mixtral 8x7B Instruct v0.1Mistral AIneeds 27.5 GB at 4-bit27.5 GBToo big
Qwen2.5 32B InstructAlibaba Qwenneeds 22.0 GB at 4-bit22.0 GBToo big
Gemma 4 31BGoogleneeds 19.6 GB at 4-bit19.6 GB*Too big
Qwen3.8 27BAlibaba Qwenneeds 18.0 GB at 4-bit18.0 GBToo big
Gemma 4 26B A4BGoogleneeds 17.0 GB at 4-bit17.0 GB*Too big

Memory needed = weights at that precision (real Hugging Face download sizes) + FP16 KV cache for 8,192 tokens. "Fits" means under 90% of 16 GB; "Tight" means 4-bit loads but leaves under 10% free. A * means the KV cache isn't sourced yet, so only the weights are counted. Data checked 2026-10-23.

Image generation, video editing and gaming

WorkloadMin–comfortableVerdict
Stable Diffusion 1.5 (512×512)Image generation4–8 GBComfortable
SDXL 1.0 (1024×1024)Image generation8–12 GBComfortable
FLUX.1 [dev] (1024×1024)Image generation8–16 GBComfortable
Video editing, 1080p (HD)Video editing4–8 GBComfortable
Video editing, 4KVideo editing8–12 GBComfortable
Video editing, 8KVideo editing16–24 GBWorks, tight
Gaming, 1080pGaming8–12 GBComfortable
Gaming, 1440pGaming12–16 GBComfortable
Gaming, 4KGaming16–16 GBComfortable

Ranges come from published guidance (Adobe, Puget Systems, AUTOMATIC1111 and others); the sources are linked in the calculator when you pick a workload.

Other memory sizes

Want a different context length, more than one GPU, or your exact card? Use the What can my GPU run? tool. To check one model in detail, use the VRAM calculator.

Last checked: