ailocalinference

Learn local AI

9 paths, 47 lessons, 119 questions. Every lesson gives you the plain-English version first, then the technical one, then why it actually matters when you are choosing hardware or debugging a slow setup.

Foundations

Start your journey into local AI inference

3 modules · 8 lessons

The Inference Pipeline

Understand how tokens are generated under the hood

3 modules · 6 lessons

Making Models Fit

Learn how huge models run on small devices via Quantization

2 modules · 4 lessons

Speed Hacks

Advanced optimizations to make inference blisteringly fast

3 modules · 6 lessons

Apple Silicon AI

Why Macs are secretly the best local AI machines

1 module · 1 lesson

Tools & Frameworks

The software ecosystem of local AI

3 modules · 4 lessons

Advanced Topics

Explore the frontier of local AI capabilities

1 module · 1 lesson

NVIDIA Hardware & DGX

NVIDIA graphics cards, DGX Spark, DGX Station, and NVFP4 — the hardware of local AI

5 modules · 9 lessons

Popular Open Source Models

Master Qwen 2.5, DeepSeek-R1, GLM-4, Gemma 2, and Llama 3 — sweet spots, architectures, and local hardware requirements

4 modules · 8 lessons