OpenAI and Broadcom Unveil LLM-optimized Inference Chip

OpenAI and Broadcom today unveiled Jalapeño, OpenAI's first Intelligence Processor, which is an accelerator designed specifically for large language model (LLM) inference tasks. The architecture reduces data movement and balances compute, memory, and networking resources to achieve realized utilization much closer to theoretical peak performance. Jalapeño was co-developed from initial design to manufacturing tape-out in just nine months. Engineering samples of the Jalapeño chip are running ML workloads in the lab at production target frequency and power, including GPT‑5.3‑Codex‑Spark.