SK hynix Reportedly Unveils New Solutions Including PIM, HBF, and SALT-KV at AI Infra Summit

According to a report by Korean media, Heraldcorp, Lim Eui-cheol, Vice President of SK hynix in charge of Solution AT, recently delivered a presentation at the "AI Infra Summit" held in the United States. He stated that as AI workloads become increasingly diverse, the existing GPU-HBM architecture alone is no longer sufficient to meet new demands. SK hynix is preparing new solutions combining software and hardware, such as PIM (Processing-in-Memory), HBF, and SALT-KV, to address the needs of these evolving workloads. PIM technology can improve the performance and efficiency of high-end service fast-decoding workloads and is an excellent alternative for overcoming existing limitation. HBF technology can provide high bandwidth and large capacity while improving the efficiency of AI services that need to handle long contexts. SALT-KV technology improves processing efficiency based on consideration of the characteristics and reusability of KV cache, and also has sufficient potential to lead the evolution of AI systems. SK hynix stated that it will enhance its technological competitiveness and actively respond to the diverse demands of the AI era.