Micron Technology has launched the industry's first 256 GB SOCAMM2 module, the highest-capacity low-power DRAM solution for data centers. Built on the company's monolithic 32 Gb LPDDR5X design, this breakthrough enables AI infrastructure to handle massive workloads with improved power efficiency and reduced physical footprint.

AI and high-performance computing workloads increasingly strain traditional memory architectures, demanding greater capacity, bandwidth, and thermal efficiency. Micron's new SOCAMM2 delivers one-third more capacity than previous 192 GB modules while consuming just one-third the power of equivalent RDIMMs. The solution provides 2 TB of LPDRAM per 8-channel CPU, addressing critical bottlenecks in AI training and inference.

Beyond raw capacity, the 256 GB SOCAMM2 improves inference performance by over 2.3x for long-context LLM workloads and delivers more than 3x better performance per watt than mainstream memory in HPC applications. Its modular design supports liquid cooling and future scalability as AI memory requirements continue to grow.