The next generation of HBM memories may include GPU cores directly integrated into the die, indicates a report from South Korea. Companies such as NVIDIA and Meta would be working with Samsung and SK hynix to create new memory modules with graphics components to further accelerate their data transmission capacity.
HBM components stack DRAM modules on a base die. The HBM4 includes a controller that will help distribute data to increase the bandwidth and efficiency of each component. The idea would be to have GPU cores together on this die, for a considerable leap in data transmission capacity.
The idea is a common solution in hardware: reducing the distance that data needs to move helps its performance. Additionally, the design could help save energy as well.
The difficulties encountered at the moment, according to the report, are the limited die area in HBM memories, limitations in power delivery to the integrated GPU cores and, of course, cooling. The extra performance offered by the GPU comes at the price of heating the component.
Companies look to HBM for an answer to AI’s hunger for memory
It is no surprise that the study of new solutions for HBM, especially involving NVIDIA, is a response to AI’s growing demand for memory. Kim Joung-Ho, professor at KAIST University in Seoul, is involved in the project and stated that “the speed of technological transition in which the boundary between memory and system semiconductors collapses for the advancement of AI will accelerate.”
The engineer states that domestic companies – such as Samsung and SK hyinx – need to expand their ecosystems beyond memories into the logical segment, involving GPUs, to anticipate the next generation HBM memory market.
Leia mias:
Both NVIDIA and AMD have already shown that they will incorporate more and more memory with their accelerators, and the constant increase in capacity needs to be accompanied by an increase in bandwidth and data transfer to remain practicable. It is interesting to remember that there are also companies looking for solutions outside of HBM altogether.
Source: ET News
Via: TechPowerUp
Join the Adrenaline offer group
Check out the main offers on hardware, components and other electronics that we found online. Video card, motherboard, RAM memory and everything you need to build your PC. By joining our group, you receive daily promotions and have early access to discount coupons.
Join the group and take advantage of promotions
Source: https://www.adrenaline.com.br/hardware/nvidia-e-mais-empresas-estariam-buscando-integrar-gpus-direto-nas-memorias-hbm/
