Intel D270: Why Intel Chose LPDDR5X Over Expensive HBM for AI Inference
Intel’s D270 skips HBM for up to 480GB of LPDDR5X in a 350W air-cooled card, trading bandwidth for capacity and lower cost in AI inference.
Intel’s D270 skips HBM for up to 480GB of LPDDR5X in a 350W air-cooled card, trading bandwidth for capacity and lower cost in AI inference.
Inference makes AI memory capacity and cost efficiency as important as speed. HBF, CXL memory pooling and NVIDIA’s CMX each add a tier below HBM to hold KV cache and context more cheaply.