Bandwidth skyrockets by 60%! Innodisk launches next-generation DDR5 server memory

Industrial storage brand Innodisk has launched a new generation of DDR5 MRDIMM memory modules, with transfer speeds reaching 12,800 MT/s, delivering a 60% bandwidth improvement over existing DDR5 8,000 MT/s RDIMMs, primarily targeting data-intensive scenarios such as AI servers.

MRDIMM stands for Multiplexed Registered DIMM, essentially an upgraded version of server memory.

Innodisk's solution uses two new components — MRCD (Multiplexed Register Clock Driver) and MDB (Multiplexed Data Buffer) — combined with an architecture that simultaneously accesses dual-rank memory, effectively doubling bandwidth while reducing memory controller load and improving latency.

It addresses the so-called "memory wall." With AI large models and robotics applications driving constant CPU and GPU upgrades, if memory can't keep up, even the most powerful processors will be bottlenecked by memory bandwidth, creating a performance gap between processors and memory. MRDIMM is designed to fill that gap.

In terms of compatibility, it uses a 287-pin design and can be directly inserted into existing DDR5 RDIMM slots, allowing upgrades without modifying system designs.

Capacity options range from 32GB to 128GB, supporting a wide temperature range of 0 to 95°C, and includes eFuse and TVS protection to ensure stability and reliability at high speeds.

Applications include generative AI, large language model training, cloud computing servers, edge AI inference, 3D modeling, robotic arms, and more.

Innodisk states that when processing the same AI language model, systems using MRDIMM achieve higher memory bandwidth and compute core utilization, significantly improving token-based data processing efficiency.

The memory is expected to begin sampling in Q4 of this year, with plans to expand capacity and offer customized specifications in the future.