What can I run on an RTX 4070 SUPER 12GB?
We earn commissions when you shop through the links below.
23 models fit in 12 GB — cheapest rental $0.06/hr.
The GeForce RTX 4070 SUPER has 12 GB of GDDR6X on a 192-bit bus, 7,168 CUDA cores, 568 AI TOPS (NVIDIA's figure), 220 W total graphics power, and a 650 W recommended system power.[1] The table below checks every language model in our calculator at three quantizations with an 8K-token context, using the same file sizes and fit rule as the rest of the site.
Best model for the RTX 4070 SUPER 12GB: Qwen2.5 14B Instruct. It is the largest model in our calculator (14.8B parameters) that fits comfortably at 4-bit: Q4_K_M plus an 8K-token FP16 KV cache needs 10.6 GB, under 90% of 12 GB. The highest precision it fits comfortably at is 4-bit (Q4_K_M). In total, 23 of the 50 calculator models fit comfortably at 4-bit on this card.
| Model | 4-bit (Q4_K_M) | 8-bit (Q8_0) | 16-bit (FP16/BF16) |
|---|---|---|---|
| Qwen2.5 14B InstructAlibaba Qwen | 10.6 GB · Fits | 17.3 GB · Too big | 31.2 GB · Too big |
| Qwen2.5-Coder 14BAlibaba Qwen | 10.6 GB · Fits | 17.3 GB · Too big | 31.2 GB · Too big |
| Qwen3 14BAlibaba Qwen | 10.3 GB · Fits | 17.0 GB · Too big | 30.9 GB · Too big |
| Phi-4 14BMicrosoft | 10.7 GB · Fits | 17.3 GB · Too big | 31.0 GB · Too big |
| Gemma 4 12BGoogle | 7.8 GB · Fits | 13.3 GB · Too big | 24.5 GB · Too big |
| Qwen3.5 9BAlibaba Qwen | 6.4 GB · Fits | 10.1 GB · Fits | 18.7 GB · Too big |
| Ornith 1.5 9BOrnith AI | 6.0 GB · Fits | 10.1 GB · Fits | 18.7 GB · Too big |
| DeepSeek-R1-0528-Qwen3-8BDeepSeek | 6.2 GB · Fits | 9.9 GB · Fits | 17.6 GB · Too big |
| Qwen3 8BAlibaba Qwen | 6.2 GB · Fits | 9.9 GB · Fits | 17.6 GB · Too big |
| Llama 3.1 8B InstructMeta | 6.0 GB · Fits | 9.6 GB · Fits | 17.1 GB · Too big |
| Gemma 4 E4BGoogle | 5.6 GB · Fits | 8.2 GB · Fits | 15.2 GB · Too big |
| Nemotron 3.5 Bolt E4BNVIDIA | 6.4 GB · Fits | 8.4 GB · Fits | 15.2 GB · Too big |
| Qwen2.5 7B InstructAlibaba Qwen | 5.2 GB · Fits | 8.6 GB · Fits | 15.7 GB · Too big |
| Qwen2.5-Coder 7BAlibaba Qwen | 5.2 GB · Fits | 8.6 GB · Fits | 15.7 GB · Too big |
| Mistral 7B Instruct v0.3Mistral AI | 5.4 GB · Fits | 8.8 GB · Fits | 15.6 GB · Too big |
| Spark-X2.6 4BXHToken | 3.8 GB · Fits | 4.7 GB · Fits | 8.5 GB · Fits |
| Qwen3 4BAlibaba Qwen | 3.7 GB · Fits | 5.5 GB · Fits | 9.3 GB · Fits |
| Llama 3.2 3B InstructMeta | 3.0 GB · Fits | 4.4 GB · Fits | 7.4 GB · Fits |
| Qwen3 1.7BAlibaba Qwen | 2.2 GB · Fits | 3.1 GB · Fits | 5.0 GB · Fits |
| LFM3 1.7BLiquid AI | 1.2 GB · Fits | 1.9 GB · Fits | 3.6 GB · Fits |
| Qwen2.5 1.5B InstructAlibaba Qwen | 1.2 GB · Fits | 1.9 GB · Fits | 3.3 GB · Fits |
| Qwen3 0.6BAlibaba Qwen | 1.4 GB · Fits | 1.7 GB · Fits | 2.4 GB · Fits |
| Qwen2.5 0.5B InstructAlibaba Qwen | 0.5 GB · Fits | 0.6 GB · Fits | 1.1 GB · Fits |
| gpt-oss-20bOpenAI | 11.9 GB · Tight | 12.3 GB · Too big | 14.0 GB · Too big (MXFP4 native) |
| Kimi K3Moonshot AI | 1,508.9 GB · Too big | 1,561.4 GB · Too big | n/a |
| Mistral Large 4 (Le Chonk)Mistral AI | 635.5 GB · Too big | 1,115.8 GB · Too big | 2,099.5 GB · Too big |
| DeepSeek-V4.1-Flash-1017DeepSeek | 500.7 GB · Too big | 508.4 GB · Too big | n/a |
| DeepSeek-V3.2DeepSeek | 406.0 GB · Too big | 713.9 GB · Too big | 1,342.9 GB · Too big |
| GLM-5.3-FlashZ.ai (Zhipu AI) | 181.5 GB · Too big | 341.1 GB · Too big | 641.8 GB · Too big |
| Qwen3-235B-A22BAlibaba Qwen | 143.7 GB · Too big | 251.5 GB · Too big | 471.9 GB · Too big |
| Qwen3.8 Flash NextAlibaba Qwen | 119.8 GB · Too big | 188.5 GB · Too big | 354.2 GB · Too big |
| Ornith-1.5-122BOrnith | 79.9 GB · Too big | 132.8 GB · Too big | 249.6 GB · Too big |
| Qwen3.5-122B-A10BAlibaba Qwen | 76.7 GB · Too big | 130.1 GB · Too big | 244.5 GB · Too big |
| gpt-oss-120bOpenAI | 63.1 GB · Too big | 63.7 GB · Too big | 65.7 GB · Too big (MXFP4 native) |
| Nemotron 3.5 Bolt 74B-A9BNVIDIA | 50.5 GB · Too big | 79.1 GB · Too big | 148.5 GB · Too big |
| Llama 3.1 70B InstructMeta | 45.2 GB · Too big | 77.7 GB · Too big | 143.8 GB · Too big |
| Llama 3.3 70B InstructMeta | 45.2 GB · Too big | 77.7 GB · Too big | 143.8 GB · Too big |
| Mixtral 8x7B Instruct v0.1Mistral AI | 27.5 GB · Too big | 50.7 GB · Too big | 94.5 GB · Too big |
| Recursive FlintRecursive | 25.3 GB · Too big | 42.5 GB · Too big | 79.8 GB · Too big |
| Qwen3.6 35B-A3BAlibaba Qwen | 22.5 GB · Too big | 38.0 GB · Too big | 71.2 GB · Too big |
| Qwen3.8-35B-A3B (Empero Distill)Empero | 21.9 GB · Too big | 38.0 GB · Too big | 71.2 GB · Too big |
| Nanbeige4.3 33BNanbeige | 22.5 GB · Too big | 36.9 GB · Too big | 68.0 GB · Too big |
| Qwen2.5 32B InstructAlibaba Qwen | 22.0 GB · Too big | 37.0 GB · Too big | 67.7 GB · Too big |
| Qwen2.5-Coder 32BAlibaba Qwen | 22.0 GB · Too big | 37.0 GB · Too big | 67.7 GB · Too big |
| Qwen3 32BAlibaba Qwen | 21.9 GB · Too big | 37.0 GB · Too big | 67.7 GB · Too big |
| Gemma 4 31BGoogle | 21.5 GB · Too big | 34.6 GB · Too big | 63.3 GB · Too big |
| Qwen3.8 27BAlibaba Qwen | 18.0 GB · Too big | 29.7 GB · Too big | 55.2 GB · Too big |
| Gemma 4 26B A4BGoogle | 17.5 GB · Too big | 27.3 GB · Too big | 51.0 GB · Too big |
| Devstral Small 2 24BMistral AI | 15.7 GB · Too big | 26.4 GB · Too big | 48.5 GB · Too big |
| LFM2.5-24B-A2BLiquid AI | 14.7 GB · Too big | 25.7 GB · Too big | 48.1 GB · Too big |
Each cell is the Hugging Face GGUF file size plus FP16 KV cache for an 8K-token context (or the model's maximum, if shorter). Fits = under 90% of 12 GB; Tight = 90 to 100%; Too big = over 12 GB. * = KV cache not included (no config data). Same data as the VRAM calculator and what can I run with 12 GB. Data checked 2026-11-03.
Check one model at your own context length in the VRAM calculator with the RTX 4070 selected (same 12 GB as the SUPER in our calculator).
Same 12 GB ceiling as an RTX 3060 12GB
Memory decides what fits. The 4070 SUPER, the non-SUPER RTX 4070, and the RTX 3060 12GB all have 12 GB, so they fit the same calculator models at the same quants and context. At 4-bit (Q4_K_M) with an 8K FP16 KV cache, that is 23 of 50 models under our 90% headroom rule (live table above). What changes is speed and efficiency. Specs from NVIDIA:[1][2]
| RTX 4070 SUPER | RTX 3060 12GB | |
|---|---|---|
| Memory | 12 GB GDDR6X, 192-bit | 12 GB GDDR6, 192-bit |
| CUDA cores | 7,168 | 3,584 |
| AI TOPS (NVIDIA's figure) | 568 | 102 |
| Architecture | Ada Lovelace | Ampere |
| Power (NVIDIA spec) | 220 W, 650 W system | 170 W |
We do not invent a tokens/s number for the 4070 SUPER here — our measured speed page has nearby Ada cards from public llama.cpp scoreboards when you want a ballpark. For a same-VRAM speed story with sourced llama-bench rows, see RTX 5070 12GB vs 3060.
When 12 GB is not enough
- 70B-class models need ~40 GB+ at 4-bit — rent a 48 GB / 80 GB card or pick a smaller model (Llama 3.1 70B cheapest rental).
- gpt-oss-20b is about 11.9 GB at 4-bit with 8K KV in our calculator — it may load, but it is tight on any 12 GB card.
- MoE bigger than VRAM: expert offload to system RAM.
More for 12 GB cards
- RTX 3060 12GB fit table, the same model list for the older card
- RTX 5070 12GB fit table: Blackwell 12 GB with measured speed vs 3060
- Everything that fits in 12 GB, including image generation and gaming
- Best GPUs for local LLMs: 12 GB
- VRAM calculator
Rent a GPU
Cloud marketplaces rarely list "4070 SUPER" as its own SKU. Use the cheapest 12–16 GB offer or step up to 24 GB. Every number below comes from our dated price file, not an estimate:
| Provider | Cheapest GPU | $ / GPU / hr | Plan / note |
|---|---|---|---|
| Vast.ai Referral link | RTX 3060 (12 GB) | $0.06 | Marketplace, verified on-demand · lowest of 28 verified on-demand single-GPU asks Verified: Nov 10, 2026 10:35 AM PTVerified: Nov 10, 2026 10:35 AM PT |
| Runpod | 12-16 GB | No single-GPU on-demand offer in this tier in our 2026-11-09 read | |
| Vast.ai Referral link | RTX 3090 (24 GB) | $0.16 | Marketplace, verified on-demand · lowest of 30 verified on-demand single-GPU asks Verified: Nov 10, 2026 10:35 AM PTVerified: Nov 10, 2026 10:35 AM PT |
| Runpod Referral link | RTX A5000 (24 GB) | $0.16 | Community Cloud Verified: Nov 10, 2026 10:35 AM PTVerified: Nov 10, 2026 10:35 AM PT |
| Novita AI Referral link | No GPU rental (API instead) | $0.02 / $0.05 per 1M tokens | Llama 3.1 8B Instruct API, in / out (not a GPU-hour rate; no hardware to rent) Verified: Nov 3, 2026Verified: Nov 3, 2026 Price may be stale |
Cheapest single-GPU on-demand rates we read from each provider (copied, never estimated). Each row shows its own Verified time (ⓘ on phones); amber + “Price may be stale” means older than 24 hours, so re-check on the provider before you rent. How we read and date prices: methodology. Full table: GPU prices.
Honest note: Vast.ai is a host marketplace (quality varies; the verified on-demand filter helps). Runpod Community Cloud is shared capacity; Secure Cloud costs more. Novita AI does not rent GPUs; it runs open models for you by API. Dated side-by-side: Vast.ai vs Runpod. More: GPU cost per hour · AI APIs.
Some links on this page are affiliate or referral links: we may get a commission or account credit if you sign up. See our disclosure.
Get fit alerts for your GPU
Join the fit-alerts waitlist
Alerts are not running yet. Join the waitlist and pick your card once; when alerts launch we will email you once to confirm, and only after you confirm will you get the first alerts. Unsubscribe any time.
Every number on this page links to its source.
How we calculate + sources ⓘ
Sources
All sources checked on .
- NVIDIA, GeForce RTX 4070 Family specs table (RTX 4070 SUPER: 7,168 CUDA cores, 12 GB GDDR6X, 192-bit, 568 AI TOPS, 220 W total graphics power, 650 W required system power; Ada Lovelace). Checked 2026-11-06. https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4070-family/
- NVIDIA, GeForce RTX 3060 family specs (12 GB or 8 GB GDDR6, 192-bit, 3,584 CUDA cores, 170 W) and RTX 50 Series dynamic compare (RTX 3060 102 AI TOPS). Checked 2026-11-06. https://www.nvidia.com/en-us/geforce/graphics-cards/30-series/rtx-3060-3060ti/, https://images.nvidia.com/aem-dam/en-zz/Solutions/raw-html/dynamic-specs-table-50-series/v1.1.3.js
- Runpod pricing page (Updated November 4, 2026) and Vast.ai verified on-demand marketplace API — rates in
data/gpu_prices.json, last_verified 2026-11-05T22:06:00-08:00. Novita AI public model list (API prices), fetched 2026-11-03 (data/novita.json).
Too big for your card? Rent the VRAM by the hour, or upgrade.
Run it on a cloud GPU
No upgrade needed
Rent a 24–80 GB GPU for the hour you need it.
Buy this GPU
Own the VRAM
Compare current GPU prices first on our GPU price table and measured speeds.
We may earn from links marked Affiliate partner or Referral link. Disclosure.