ailocalinference

← Glossary

DGX Spark

Palm-sized deskside AI supercomputer with 128GB unified memory

Hardware

In plain English

A desktop box that runs large models offline. Two Sparks can cluster over ConnectX to serve 405B parameter models together.

Technically

NVIDIA's compact personal AI supercomputer built on the GB10 Grace Blackwell Superchip: 128GB coherent unified memory, ~1 PFLOP FP4, and full CUDA/DGX OS stack. Scales to multi-node via 200GbE ConnectX networking.

Related terms

GB10 SuperchipNVLink-C2CNVFP4 (Blackwell FP4)MikroTik CRS504-4XQ-IN

Lessons that use it

More in Hardware

DGX StationGB10 SuperchipMikroTik CRS504-4XQ-INMikroTik CRS804-4C-INMikroTik CRS812-8C-4XQ-INNVLink-C2CRoCEv2 (RDMA over Converged Ethernet)VRAM