Micron Launches Second Generation of High Bandwidth Memory (HBM3) in 2023

By Shubham Munde , 31 October, 2023

The technology sector is meeting the need in the new era of generative artificial intelligence (AI) by updating features in their tools and services. Micron has launched the highest-capacity High Bandwidth Memory (HBM) to enhance the generative AI innovation in 2023.

Micron is the first company in the industry to have launched 8-high 24 GB HBM3 (High bandwidth Memory) Gen 2 (second generation) memory with a bandwidth greater than 1.2 terabyte per second and pin speed more than 9.2 Gigabyte per second in 2023. It is more than 50 percent of the improvement in the current High Bandwidth Memory solutions and Micron's HBM3 second generation high bandwidth memory to improve the memory capacity, enhancing the performance and lessening the CPU (Central Processing Unit) offload for faster training and other factors. It will also provide 2.5 times more performance per watt improvement compared to earlier generations of bandwidths. The company's innovation will lessen the training time of large language models like GPT-4, provide space for artificial intelligence interpretation, and deliver total ownership cost, as the trusted sources mentioned. Also, Nvidia looks forward to collaborating with Micron as the latter ventures into high-bandwidth memory. Nvidia says generative AI is progressive computing that benefits from High Bandwidth Memory with energy efficiency in 2023 with its launch of HBM3 G2. Thus, the recent artificial intelligence innovation by Micron helps boost the technological sector, as the implementation of HBM3 second generation helps provide faster data rates and improved thermal responses. Micron's HBM3 second Gen 2 helps its users by minimizing training time by more than 30 percent and giving permits for up to 50 percent of daily queries.

The innovation to enhance the generative AI in the industry, Micron, has achieved a new milestone again in 2023. Also, the company plans to launch more exciting tools by the first half of 2024 that will empower Micron as one of the leading technical AI servers.