OpenAI and Broadcom announce chip designed for LLM inference at scale
OpenAI, the company behind ChatGPT and Codex and the models those tools utilize, and Broadcom, an established silicon supplier, have announced a new chip called Jalapeño, designed specifically for large language model inference in data centers. The chip is intended to be deployed at large data centers, both companies claim this is just the first generation in a long-term project that will see chips refined over time.Read full article Comments
Get smart on it
OpenAI and Broadcom have announced a custom chip called Jalapeño designed specifically for running large language models in data centers. The chip is an application-specific integrated circuit built from scratch based on insights from OpenAI researchers and OpenAI's roadmap for future models, with both companies claiming it will deliver better performance per watt than existing alternatives. This matters because OpenAI is seeking to own the complete technology stack behind its products while reducing dependence on outside chip suppliers like Nvidia, and more broadly, AI companies are pursuing custom chips to address a global shortage of computing capacity.
Related news
Cerebras stock plunges after earnings as CEO says margin outlook was misunderstood
In its first earnings report since going public, the AI chipmaker forecast a narrower gross margin in its core business, scaring investors.
The memory chip crunch is paying off for this US company
Revenue quadrupled to $41.45 billion compared with the same period a year ago. The company's profit, meanwhile, rose from $1.88 billion to an incredible $28.2 billion year-over-year.
Microsoft’s Wisconsin AI Data Center Campus Now Fully Operational
The Mount Pleasant campus offers a glimpse of how hyperscalers are turning multibillion-dollar AI infrastructure plans into operational capacity.
