insideHPC

In-Memory Computing Could Be an AI Inference Breakthrough

[CONTRIBUTED THOUGHT PIECE] Generative AI is unlocking incredible business opportunities for efficiency, but we still face a formidable challenge undermining widespread adoption: the exorbitant cost ...
Phys.org

A multi-level breakthrough in optical computing—a faster, more efficient, and robust memory cell

For the first time, an international cadre of electrical engineers has developed a new method for photonic in-memory computing that could make optical computing a reality in the near future. The team ...
NextBigFuture

Analog in-memory Computing Attention Mechanism for Fast and Energy-efficient Large Language Models

A Nature paper describes an innovative analog in-memory computing (IMC) architecture tailored for the attention mechanism in large language models (LLMs). They want to drastically reduce latency and ...
Semiconductor Engineering

Is In-Memory Compute Still Alive?

In-memory computing (IMC) has had a rough go, with the most visible attempt at commercialization falling short. And while some companies have pivoted to digital and others have outright abandoned the ...