3 Agents. 3 LLMs. 1 Aging GPU: Engineering Parallel Inference on Bare Metal

This article explains how to run three different LLMs simultaneously on a single 8GB GPU by using C++ layer multiplexing and admission control, overcoming VRAM limitations. It demonstrates a practical approach to parallel inference for multi-agent systems on aging hardware.