Local AI & Hardware, Tested on a Rig We Own
This section is written from a machine that renders AI video every day — an RTX 4080 running Wan through ComfyUI with the full speed stack, plus local LLMs for daily work. Start with the best local AI tools ranking, the VRAM-first GPU buying guide, or the complete Ollama guide. When a model won't fit in VRAM, we say so.
Local AI FAQs
- What do I need to run AI locally?
- A GPU whose VRAM fits your model: ~5GB runs a 7B LLM at Q4 quantization, ~10GB runs 14B, and 24GB opens the 30B class. Our GPU buying guide has the full fit table.
- What is the easiest way to run an LLM on my own PC?
- LM Studio if you want a point-and-click desktop app, Ollama if you're comfortable with one terminal command. Both are free and manage models and quantization for you.
- Can I generate images and video locally too?
- Yes — ComfyUI runs Stable Diffusion, Flux and video models like Wan on consumer GPUs. We render AI video daily on a 16GB RTX 4080 with the Triton/SageAttention/TeaCache speed stack.
Also on AI Video Sensei: AI video tools · AI audio & music