Best Top Reviews Online

Samsung Adds Radical Computational Memory to 96 AMD MI100 Graphics Processing Units

96 AMD MI100 GPUs with PIM

Samsung has created the world’s first large-scale computing system that employs GPUs with built-in processing-in-memory (PIM) chips. According to Business Korea, these memory modules, which were loaded onto 96 AMD Instinct MI100 GPUs, increased AI training performance by 2.5x.

PIM is a new type of computer memory that can accelerate computationally complex workflows handled by processors like CPUs and GPUs. Each memory module, as the name implies, is capable of processing data on its own, reducing the amount of data that must travel between the memory and the processor.

Samsung first demonstrated PIM-modified GPUs in October, but it wasn’t until recently that 96 PIM-modified GPUs were combined in a cluster. When compared to standard video memory, these modified MI100 chips not only performed 2.5x better but also consumed 2.67x less power, significantly increasing the GPUs’ efficiency when running AI algorithms.

Samsung has been working on PIM for quite some time. In 2021, the company demonstrated several implementations involving various memory types such as DDR4, LPDDR5X, GDDR6, and HBM2. On a test program involving a Meta AI workload, Samsung saw a 1.8x increase in performance with a 42.6% reduction in power consumption and a 70% reduction in latency in LPDDR5 form. Even more impressive, these results came from a standard server system with no motherboard or CPU modifications (all that changed was a swap to PIM-enabled LPDDR5 DIMMs).

SK Hynix released its PIM modules earlier this year, so Samsung isn’t the only company developing PIM chips. According to preliminary testing, SK Hynix’s GDDR6-AiM (Accelerator in Memory) application accelerated AI processing by 16x while reducing power consumption by 80%. That’s significantly faster than Samsung’s modified MI100s, but we don’t know what SK Hynix tested with, so it’s not a direct comparison.

Regardless, PIM appears to be a powerful solution for accelerating AI-accelerated workflows. “As the head of the AI Research Center at Samsung Electronics Advanced Institute of Technology, I want to make Samsung a semiconductor company that uses AI better than any other company,” Choi Chang-kyu, vice president and head of the AI Research Center at Samsung Electronics Advanced Institute of Technology, told Business Korea.

Why Trust Us?

Best Top Reviews Online was established in 2018 to provide our readers with detailed, truthful, and impartial advice on what to buy. We now have millions of monthly users from all over the world and annually evaluate over a thousand products.

The above article was written by the BestTopReviewsOnline team, which consists of some of the most knowledgeable technical experts in the United States. Our team consists of highly regarded writers with vast experience in smartphones, computer components, technology apps, security, and photography, among other fields.

Related Stories

  • All Post
  • Best Picks
  • Explainers
  • How To
  • News
  • Versus
AMD Ryzen 3000 Series Matisse CPU Specifications

May 11, 2020

According to the Russian price tracking website e-Katalog, AMD’s forthcoming Ryzen 3000-series processor lineup is complete. Notable is the fact that E-Katalog does not sell products. Similar to PCPartPicker, it provides pricing information for a variety of items, including household…

Get more info

Deals

Reviews

Best Products

Buying Guides

Contact Us

About Us

We provide a platform for our customers to rate and review services and products, as well as the stores that sell them. We research and compare the most popular brands and models before narrowing it down to the top ten, providing you with the most comprehensive and reliable buying advice to help you make your decision.

Disclaimer

BestTopReviewsOnline.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com. As an Amazon Associate I earn from qualifying purchases.

 

Address & Map

20 S Santa Cruz Ave, Suite 300, Los Gatos, CA 95030, United States

© 2022 BestTopReviewsOnline.com Pty. Ltd. All Rights Reserved. Licensing: All third-party trademarks, images, and copyrights used on this page are for comparative advertising, criticism, or review. As this is a public forum where users can express their opinions on specific products and businesses, the opinions expressed do not reflect those of BestTopReviewsOnline.com.