Barclays: Hot Chips 2026 Signals Shift in AI Race From Peak Compute Power to Energy Efficiency Optimization

According to Chaoxiang research, a Barclays report released on August 31 notes that the core theme of the Hot Chips 2026 conference has shifted from "who has the strongest compute" to "who can deliver the most output with the least power," making token/watt the most critical metric for measuring AI hardware success. Constrained by data center power supply, hardware vendors and hyperscalers alike are pushing system performance to its limits within fixed power budgets. Inference workload partitioning has emerged as a key architectural divergence: NVIDIA and Cerebras employ a partitioned approach that decouples prefill and decode stages, delivering roughly an order-of-magnitude improvement in the token/kW metric, whereas OpenAI's Jalapeno integrates prefill, speculative generation, and decoding entirely on a single chip. Barclays anticipates that both approaches will coexist long-term, with the partitioned strategy likely capturing a larger share over time.