D-Matrix stacks 3D DRAM to boost AI inference speed
SiliconANGLE: D-Matrix bets stacked DRAM can solve inference’s memory bandwidth problem
As artificial intelligence workloads shift to inference, memory bandwidth decides whether hardware generates tokens quickly or sits idle. D-Matrix Corp. is answering with Raptor, a second-generation chip stacking 3D DRAM beneath its compute logic. AI infrastructure has become a systems game, and winners combine memory, interconnect and software into cohesive designs, according to Satyam Srivastava […] The post D-Matrix bets stacked DRAM can solve inference’s memory bandwidth problem
As artificial intelligence workloads shift toward inference, memory bandwidth has become a critical bottleneck that determines how quickly hardware can generate tokens. A company is developing a chip that stacks 3D DRAM memory directly beneath its compute logic to address this problem, positioning this memory tier between existing SRAM and high-bandwidth memory options in terms of both capacity and performance. The approach aims to improve energy efficiency and hardware utilization by keeping memory close to processors without consuming valuable logic die space. This effort reflects a broader industry shift toward heterogeneous computing systems where different types of processors and accelerators work together as unified clusters.
One short email a day with the stories that matter. Free. Unsubscribe with one click.
Want to go deeper than the news? Explore live, cohort-based AI courses taught by practitioners.
Browse AI courses on MavenFive months to one week: How Texas A&M is speeding scientific research
Universities racing to build AI infrastructure are learning that raw compute changes the pace of science itself, from molecular discovery to materials engineering. AI and high-performance computing are converging, and campus technology leaders are now building like cloud operators. The Texas A&M University System is standing up two major clusters for researchers across its 12 […] The post Five months to one week: How Texas A&M is speeding scientific research appeared first on Silic
Nvidia debuts new Rubin HPC chip, scientific research libraries
Nvidia Corp. today introduced a set of offerings designed to speed up scientific research across a range of fields. The lineup is headlined by Rubin HPC, an upcoming graphics card with significantly more cores than the company’s current flagship chip. It’s joined by over a half-dozen software tools geared towards scientists and engineers. The technologies […] The post Nvidia debuts new Rubin HPC chip, scientific research libraries appeared first on SiliconANGLE.

AI Workloads Hit by Power-Quality Issues at Data Centers
Power quality, not just grid access, is limiting AI growth at US data centers, exposing weaknesses in internal infrastructure and monitoring.

Nvidia AI Surge Comes with $118 Billion in Guarantees
The chipmaker is committing $390 billion to suppliers while helping customers finance powered facilities for AI deployments.
Agentic AI puts the CPU back at center stage as Dell and AMD chase every watt
Agentic AI is rewriting the business development playbook for chipmakers and server builders. Graphics processing units still grab the headlines, but as supercomputing and AI converge, the next wave of demand is landing on central processing units that must fit inside the power budgets data centers already have. The shift has been building for years. […] The post Agentic AI puts the CPU back at center stage as Dell and AMD chase every watt appeared first on SiliconANGLE.

Remember the frontier AI pause? Chip companies don’t either
In October, Nvidia began shipping its most advanced AI computing system, the Vera Rubin NVL72, calling it the “fastest product ramp in the company’s history.” | Image: Nvidia This summer, OpenAI paused its largest planned frontier training run after its AI agents accidentally hacked Hugging Face and early evidence suggested that its next model could independently find and exploit security flaws. In September, Anthropic CEO Dario Amodei called for slowing advances in the most pow