OpenAI Fires Up Its First AI Processor: Jalapeño

OpenAI’s first custom chip is made for the servers processing ChatGPT requests. OpenAI’s first custom chip is made for the servers processing ChatGPT requests. OpenAI has just revealed a new “intelligence processor” chip for AI servers made in partnership with Broadcom. The chip, called Jalapeño, is designed to power current and future large language models,according to an announcementon Wednesday. Jalapeño is an ASIC (Application-Specific Integrated Circuit), meaning it’s designed for a specific purpose: AI inference. With AI inference, models process a user’s request to run an agent like Codex or offer a response from ChatGPT, while AI training involves a model consuming vast amounts of data to inform its responses. Itcomes just nine monthsafter OpenAI revealed that it would team up with Broadcom to make its own chips, helping reduce the company’s reliance on the GPUs offered by Nvidia that are in limited supply. In aninterview withReuters, Broadcom CEO Hock Tan says it matches the performance of Nvidia’s Blackwell chips and Google’s Tensor processing units.Microsoft,Meta, andAmazonare among the other AI companies that have also launched custom-designed AI chips recently to power their servers for either training or inference, while still trailing Nvidia’s chips on overall performance. OpenAI calls Jalapeño the “first step in a multi-generation compute platform,” which it expects to deploy by the end of 2026. “While OpenAI is still measuring final performance, early testing shows that Jalapeño will deliver performance per watt substantially better than current state-of-the-art,” OpenAI says. A free daily digest of the news that matters most. This is the title for the native ad