VRAMNeeded Calculator

What can I run on an RTX 4070 SUPER 12GB?

We earn commissions when you shop through the links below.

23 models fit in 12 GB — cheapest rental $0.06/hr.

The GeForce RTX 4070 SUPER has 12 GB of GDDR6X on a 192-bit bus, 7,168 CUDA cores, 568 AI TOPS (NVIDIA's figure), 220 W total graphics power, and a 650 W recommended system power.[1] The table below checks every language model in our calculator at three quantizations with an 8K-token context, using the same file sizes and fit rule as the rest of the site.

Best model for the RTX 4070 SUPER 12GB: Qwen2.5 14B Instruct. It is the largest model in our calculator (14.8B parameters) that fits comfortably at 4-bit: Q4_K_M plus an 8K-token FP16 KV cache needs 10.6 GB, under 90% of 12 GB. The highest precision it fits comfortably at is 4-bit (Q4_K_M). In total, 23 of the 50 calculator models fit comfortably at 4-bit on this card.

Model4-bit (Q4_K_M)8-bit (Q8_0)16-bit (FP16/BF16)
Qwen2.5 14B InstructAlibaba Qwen10.6 GB · Fits17.3 GB · Too big31.2 GB · Too big
Qwen2.5-Coder 14BAlibaba Qwen10.6 GB · Fits17.3 GB · Too big31.2 GB · Too big
Qwen3 14BAlibaba Qwen10.3 GB · Fits17.0 GB · Too big30.9 GB · Too big
Phi-4 14BMicrosoft10.7 GB · Fits17.3 GB · Too big31.0 GB · Too big
Gemma 4 12BGoogle7.8 GB · Fits13.3 GB · Too big24.5 GB · Too big
Qwen3.5 9BAlibaba Qwen6.4 GB · Fits10.1 GB · Fits18.7 GB · Too big
Ornith 1.5 9BOrnith AI6.0 GB · Fits10.1 GB · Fits18.7 GB · Too big
DeepSeek-R1-0528-Qwen3-8BDeepSeek6.2 GB · Fits9.9 GB · Fits17.6 GB · Too big
Qwen3 8BAlibaba Qwen6.2 GB · Fits9.9 GB · Fits17.6 GB · Too big
Llama 3.1 8B InstructMeta6.0 GB · Fits9.6 GB · Fits17.1 GB · Too big
Gemma 4 E4BGoogle5.6 GB · Fits8.2 GB · Fits15.2 GB · Too big
Nemotron 3.5 Bolt E4BNVIDIA6.4 GB · Fits8.4 GB · Fits15.2 GB · Too big
Qwen2.5 7B InstructAlibaba Qwen5.2 GB · Fits8.6 GB · Fits15.7 GB · Too big
Qwen2.5-Coder 7BAlibaba Qwen5.2 GB · Fits8.6 GB · Fits15.7 GB · Too big
Mistral 7B Instruct v0.3Mistral AI5.4 GB · Fits8.8 GB · Fits15.6 GB · Too big
Spark-X2.6 4BXHToken3.8 GB · Fits4.7 GB · Fits8.5 GB · Fits
Qwen3 4BAlibaba Qwen3.7 GB · Fits5.5 GB · Fits9.3 GB · Fits
Llama 3.2 3B InstructMeta3.0 GB · Fits4.4 GB · Fits7.4 GB · Fits
Qwen3 1.7BAlibaba Qwen2.2 GB · Fits3.1 GB · Fits5.0 GB · Fits
LFM3 1.7BLiquid AI1.2 GB · Fits1.9 GB · Fits3.6 GB · Fits
Qwen2.5 1.5B InstructAlibaba Qwen1.2 GB · Fits1.9 GB · Fits3.3 GB · Fits
Qwen3 0.6BAlibaba Qwen1.4 GB · Fits1.7 GB · Fits2.4 GB · Fits
Qwen2.5 0.5B InstructAlibaba Qwen0.5 GB · Fits0.6 GB · Fits1.1 GB · Fits
gpt-oss-20bOpenAI11.9 GB · Tight12.3 GB · Too big14.0 GB · Too big (MXFP4 native)
Kimi K3Moonshot AI1,508.9 GB · Too big1,561.4 GB · Too bign/a
Mistral Large 4 (Le Chonk)Mistral AI635.5 GB · Too big1,115.8 GB · Too big2,099.5 GB · Too big
DeepSeek-V4.1-Flash-1017DeepSeek500.7 GB · Too big508.4 GB · Too bign/a
DeepSeek-V3.2DeepSeek406.0 GB · Too big713.9 GB · Too big1,342.9 GB · Too big
GLM-5.3-FlashZ.ai (Zhipu AI)181.5 GB · Too big341.1 GB · Too big641.8 GB · Too big
Qwen3-235B-A22BAlibaba Qwen143.7 GB · Too big251.5 GB · Too big471.9 GB · Too big
Qwen3.8 Flash NextAlibaba Qwen119.8 GB · Too big188.5 GB · Too big354.2 GB · Too big
Ornith-1.5-122BOrnith79.9 GB · Too big132.8 GB · Too big249.6 GB · Too big
Qwen3.5-122B-A10BAlibaba Qwen76.7 GB · Too big130.1 GB · Too big244.5 GB · Too big
gpt-oss-120bOpenAI63.1 GB · Too big63.7 GB · Too big65.7 GB · Too big (MXFP4 native)
Nemotron 3.5 Bolt 74B-A9BNVIDIA50.5 GB · Too big79.1 GB · Too big148.5 GB · Too big
Llama 3.1 70B InstructMeta45.2 GB · Too big77.7 GB · Too big143.8 GB · Too big
Llama 3.3 70B InstructMeta45.2 GB · Too big77.7 GB · Too big143.8 GB · Too big
Mixtral 8x7B Instruct v0.1Mistral AI27.5 GB · Too big50.7 GB · Too big94.5 GB · Too big
Recursive FlintRecursive25.3 GB · Too big42.5 GB · Too big79.8 GB · Too big
Qwen3.6 35B-A3BAlibaba Qwen22.5 GB · Too big38.0 GB · Too big71.2 GB · Too big
Qwen3.8-35B-A3B (Empero Distill)Empero21.9 GB · Too big38.0 GB · Too big71.2 GB · Too big
Nanbeige4.3 33BNanbeige22.5 GB · Too big36.9 GB · Too big68.0 GB · Too big
Qwen2.5 32B InstructAlibaba Qwen22.0 GB · Too big37.0 GB · Too big67.7 GB · Too big
Qwen2.5-Coder 32BAlibaba Qwen22.0 GB · Too big37.0 GB · Too big67.7 GB · Too big
Qwen3 32BAlibaba Qwen21.9 GB · Too big37.0 GB · Too big67.7 GB · Too big
Gemma 4 31BGoogle21.5 GB · Too big34.6 GB · Too big63.3 GB · Too big
Qwen3.8 27BAlibaba Qwen18.0 GB · Too big29.7 GB · Too big55.2 GB · Too big
Gemma 4 26B A4BGoogle17.5 GB · Too big27.3 GB · Too big51.0 GB · Too big
Devstral Small 2 24BMistral AI15.7 GB · Too big26.4 GB · Too big48.5 GB · Too big
LFM2.5-24B-A2BLiquid AI14.7 GB · Too big25.7 GB · Too big48.1 GB · Too big

Each cell is the Hugging Face GGUF file size plus FP16 KV cache for an 8K-token context (or the model's maximum, if shorter). Fits = under 90% of 12 GB; Tight = 90 to 100%; Too big = over 12 GB. * = KV cache not included (no config data). Same data as the VRAM calculator and what can I run with 12 GB. Data checked 2026-11-03.

Check one model at your own context length in the VRAM calculator with the RTX 4070 selected (same 12 GB as the SUPER in our calculator).

Same 12 GB ceiling as an RTX 3060 12GB

Memory decides what fits. The 4070 SUPER, the non-SUPER RTX 4070, and the RTX 3060 12GB all have 12 GB, so they fit the same calculator models at the same quants and context. At 4-bit (Q4_K_M) with an 8K FP16 KV cache, that is 23 of 50 models under our 90% headroom rule (live table above). What changes is speed and efficiency. Specs from NVIDIA:[1][2]

RTX 4070 SUPER RTX 3060 12GB
Memory 12 GB GDDR6X, 192-bit 12 GB GDDR6, 192-bit
CUDA cores 7,168 3,584
AI TOPS (NVIDIA's figure) 568 102
Architecture Ada Lovelace Ampere
Power (NVIDIA spec) 220 W, 650 W system 170 W

We do not invent a tokens/s number for the 4070 SUPER here — our measured speed page has nearby Ada cards from public llama.cpp scoreboards when you want a ballpark. For a same-VRAM speed story with sourced llama-bench rows, see RTX 5070 12GB vs 3060.

When 12 GB is not enough

  • 70B-class models need ~40 GB+ at 4-bit — rent a 48 GB / 80 GB card or pick a smaller model (Llama 3.1 70B cheapest rental).
  • gpt-oss-20b is about 11.9 GB at 4-bit with 8K KV in our calculator — it may load, but it is tight on any 12 GB card.
  • MoE bigger than VRAM: expert offload to system RAM.

More for 12 GB cards

Rent a GPU

Cloud marketplaces rarely list "4070 SUPER" as its own SKU. Use the cheapest 12–16 GB offer or step up to 24 GB. Every number below comes from our dated price file, not an estimate:

ProviderCheapest GPU$ / GPU / hrPlan / note
Vast.ai Referral linkRTX 3060 (12 GB)$0.06Marketplace, verified on-demand · lowest of 28 verified on-demand single-GPU asks
Verified: Nov 10, 2026 10:35 AM PTVerified: Nov 10, 2026 10:35 AM PT
Runpod12-16 GBNo single-GPU on-demand offer in this tier in our 2026-11-09 read
Vast.ai Referral linkRTX 3090 (24 GB)$0.16Marketplace, verified on-demand · lowest of 30 verified on-demand single-GPU asks
Verified: Nov 10, 2026 10:35 AM PTVerified: Nov 10, 2026 10:35 AM PT
Runpod Referral linkRTX A5000 (24 GB)$0.16Community Cloud
Verified: Nov 10, 2026 10:35 AM PTVerified: Nov 10, 2026 10:35 AM PT
Novita AI Referral linkNo GPU rental (API instead)$0.02 / $0.05 per 1M tokensLlama 3.1 8B Instruct API, in / out (not a GPU-hour rate; no hardware to rent)
Verified: Nov 3, 2026Verified: Nov 3, 2026 Price may be stale

Cheapest single-GPU on-demand rates we read from each provider (copied, never estimated). Each row shows its own Verified time (ⓘ on phones); amber + “Price may be stale” means older than 24 hours, so re-check on the provider before you rent. How we read and date prices: methodology. Full table: GPU prices.

Honest note: Vast.ai is a host marketplace (quality varies; the verified on-demand filter helps). Runpod Community Cloud is shared capacity; Secure Cloud costs more. Novita AI does not rent GPUs; it runs open models for you by API. Dated side-by-side: Vast.ai vs Runpod. More: GPU cost per hour · AI APIs.

Some links on this page are affiliate or referral links: we may get a commission or account credit if you sign up. See our disclosure.

Get fit alerts for your GPU

Join the fit-alerts waitlist

Alerts are not running yet. Join the waitlist and pick your card once; when alerts launch we will email you once to confirm, and only after you confirm will you get the first alerts. Unsubscribe any time.

We store only your email and the GPU or VRAM you pick (plus the page you signed up from). A one-way hash of your IP is used for rate limiting only, for about 15 minutes. Unconfirmed sign-ups are deleted after about 30 days. Never sold or shared.

Every number on this page links to its source.

How we calculate + sources ⓘ

Sources

All sources checked on .

  1. NVIDIA, GeForce RTX 4070 Family specs table (RTX 4070 SUPER: 7,168 CUDA cores, 12 GB GDDR6X, 192-bit, 568 AI TOPS, 220 W total graphics power, 650 W required system power; Ada Lovelace). Checked 2026-11-06. https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4070-family/
  2. NVIDIA, GeForce RTX 3060 family specs (12 GB or 8 GB GDDR6, 192-bit, 3,584 CUDA cores, 170 W) and RTX 50 Series dynamic compare (RTX 3060 102 AI TOPS). Checked 2026-11-06. https://www.nvidia.com/en-us/geforce/graphics-cards/30-series/rtx-3060-3060ti/, https://images.nvidia.com/aem-dam/en-zz/Solutions/raw-html/dynamic-specs-table-50-series/v1.1.3.js
  3. Runpod pricing page (Updated November 4, 2026) and Vast.ai verified on-demand marketplace API — rates in data/gpu_prices.json, last_verified 2026-11-05T22:06:00-08:00. Novita AI public model list (API prices), fetched 2026-11-03 (data/novita.json).

Too big for your card? Rent the VRAM by the hour, or upgrade.

Run it on a cloud GPU

No upgrade needed

Rent a 24–80 GB GPU for the hour you need it.

Buy this GPU

Own the VRAM

Compare current GPU prices first on our GPU price table and measured speeds.

We may earn from links marked Affiliate partner or Referral link. Disclosure.

Last checked: