Getting Qwen 3.6 27B to 80+ tok/s at Q8 on a mismatched RTX 5080 + RTX 3090 pair came down to motherboard arcana, not model tuning β which is the entire story of serious local inference. The iMil writeup reads like a model-performance post and is actually a plumbing post, and that inversion is the lesson.
- π― The throughput win was PCIe plumbing, not weights: disable CSM, enable Above 4G Decoding and Resizable BAR, and split the x16 slot into 2x8 on a board that actually supports it.
- β οΈ Boot UEFI, never MBR β MBR mode silently forbids using both cards, which is the kind of failure that eats an evening before you suspect the firmware.
- β‘ Q8 over Q4 was bought with VRAM, not magic: a refurbished 24GB 3090 alongside the 5080 moved the rig from ~30 tok/s to 50β60 with MTP, then past 80.
- π Heterogeneous GPUs cooperated fine β Blackwell and Ampere together β so the architectural mismatch was never the ceiling; the board was.
- π 80 tok/s on a 27B at full Q8 at home quietly redraws the build-vs-rent line for anyone doing inference capacity planning.
This rhymes with production serving: latency and throughput get won in the layer below the model β interconnect, memory placement, quantization, batching β long before anyone swaps a checkpoint. The HN discussion has more dual-card setups, and they all confirm the unglamorous truth: the hard part of running an open model isnβt the model. So how much of your βLLM tuningβ time last quarter was actually spent on firmware, drivers, and PCIe lanes?