The Circuit

In this episode of The Circuit, Ben Bajarin and Jay Goldberg discuss the launch of Ben's new publication, "The Diligent Stack." The duo then performs a deep dive into TSMC’s recent earnings, analyzing the risks of semiconductor cyclicality, the massive CapEx requirements for the future, and the specific bottlenecks in advanced packaging (CoWoS). Later, they shift focus to OpenAI’s partnership with Cerebras and the introduction of ads to fund massive compute needs. Finally, they break down the latest data on GPU pricing, highlighting the significant premiums hyperscalers charge compared to NeoClouds and the difficulty of tracking pricing for Nvidia's new Grace Blackwell chips.

In this episode, Ben Bajarin and Jay Goldberg discuss the highlights from CES 2023, focusing on the significant advancements in robotics, AI infrastructure, and the competitive landscape among major tech companies like NVIDIA, AMD, and Intel. They explore the themes of modularity in data centers, the evolving role of CPUs, and the challenges posed by memory supply constraints. The conversation also touches on the future of autonomous vehicles and the integration of AI in everyday technology, emphasizing the rapid pace of innovation in the tech industry.

In this conversation, Ben Bajarin and Jay Goldberg engage with Benedict Evans to explore the current state of AI development, its historical context, and future predictions. They discuss the potential for an AI bubble, the importance of productization for user adoption, and the varying levels of AI integration across different industries. The conversation also touches on the comparison between Nvidia and Sun Microsystems, highlighting the challenges and opportunities in the AI landscape.

In this episode, Ben Bajarin, Jay Goldberg, and Austin Lyons delve into the evolving landscape of networking, particularly in the context of AI and GPU technologies. They discuss the transition from traditional networking methods to more complex AI-driven networking, the significance of scaling strategies, and the critical role of SerDes in modern data centers. The conversation also touches on the ongoing debate between copper and optical networking solutions, highlighting the challenges and innovations in the field.

This discussion analyzes the evolving landscape of semiconductor networking and custom silicon, anchored by recent updates from Marvell and Broadcom. Ben and Jay review Marvell’s Industry Analyst Day, noting the company’s strategic pivot toward networking and optical interconnects over pure custom logic. They debate the technical and timeline challenges of shifting AI clusters from copper to optical (fiber) cabling, contrasting Google’s proprietary all-optical approach with the broader merchant market. The conversation then moves to Broadcom’s recent earnings, dissecting the market’s negative reaction to CEO Hawk Tan’s low-energy performance, the looming competitive threat of MediaTek at Google, and the complexities of modeling AI revenue. Finally, they close with a year-end review of AI stock performance, highlighting growing capital sensitivity and skepticism regarding the sustainability of current AI infrastructure spending.