Skip to content
Some content is members-only. Sign in to access.

AI's Next Bottleneck Isn't Compute — It's the Supply Chain Around It

Why HBM scarcity, advanced packaging limits, and networking constraints make Broadcom's systems-level position the real infrastructure play

By KAPUALabs

The central question in Broadcom’s AI-infrastructure opportunity is not simply whether demand for accelerators will grow. It is how that demand will be translated into deployable systems when the relevant constraints extend beyond compute silicon to HBM, advanced packaging, networking, optical connectivity, power, and infrastructure software. Broadcom occupies an unusual position within this evolving industrial organism: it is both a supplier of custom ASICs and a participant in the surrounding systems required to operate them.

The most consistently corroborated element of the thesis is Broadcom’s established role in Google’s TPU supply chain. Broadcom helped develop Google’s TPUs 2,5,31, designs and supplies them 17, and is described as a major supplier 32. Estimates that it retains roughly 80% of Google’s TPU supply 32, or a majority share 32, are less firmly supported. They are nevertheless useful indications of the scale of the relationship, while also highlighting the importance of monitoring supplier diversification.

The evidence base is concentrated in reporting from July 25 through August 7, 2026. The strongest corroborated claims concern the importance of hyperscaler custom accelerators 21, Broadcom’s TPU relationship 2,5,31, CoreWeave’s negative cash flow 8,33, and HBM as a strategic bottleneck 6,7,13. Under present conditions, Broadcom appears well placed to monetize the movement from GPU-dominated AI infrastructure toward a more heterogeneous architecture. Its exposure, however, is not without friction: the company remains dependent on a limited number of hyperscaler customers, critical suppliers, technology transitions, and capital-spending cycles.

The Structural Opportunity: Custom Silicon and the Hyperscaler Model

From merchant GPUs to workload-specific accelerators

The principal structural opportunity is the growth of custom AI silicon. Google, Amazon, Meta, and Microsoft are developing internal accelerators because their large and relatively well-characterized workloads allow them to optimize for specific applications, lower cost per token, and reduce dependence on a single merchant supplier 21. These processors are generally not sold as merchant hardware; they are accessed through the hyperscalers’ own cloud ecosystems 21.

This model need not be interpreted as a threat to Broadcom. Rather, it creates demand for an external ASIC design and supply-chain partner where a hyperscaler does not wish, or is not yet able, to execute the entire program internally. Broadcom is positioned as a leader in custom chips 17, supplies critical data-center components 22, and participates in advanced AI-chip production and Google’s TPU supply chain 32. The relevant distinction is therefore between ownership of the accelerator architecture and participation in the industrial process that turns that architecture into a functioning system.

Google provides the clearest proof point. Alphabet has expanded its TPU program 1,17, TPU sales to Broadcom are increasing 17, and Alphabet is now selling some TPU capacity or chips to customers 17. This arrangement offers a potentially attractive division of labor: the hyperscaler retains control over architecture and cloud distribution, while Broadcom captures design, connectivity, and manufacturing-related content.

The opportunity is reinforced by the movement toward ASIC-based inference and other specialized workloads 17. Custom chips are generally better suited to inference and highly specific tasks than general-purpose merchant GPUs 17. TrendForce’s estimate that ASIC-based AI servers could represent 27.8% of the market in 2026 21 is directionally useful, although it remains a single-source forecast rather than a consensus datapoint.

The market will remain hybrid

We must nevertheless distinguish between the growth of custom silicon and the disappearance of merchant accelerators. Technology companies remain dependent on external accelerator vendors despite their internal programs 34. Merchant GPU vendors continue to sell broadly, while custom-ASIC developers typically expose their hardware through cloud instances 21. The likely equilibrium is therefore hybrid rather than exclusively custom.

NVIDIA remains deeply entrenched through CUDA. Custom kernels, NCCL-tuned distributed training, and TensorRT serving paths can be expensive to port 21. The principal switching costs are engineering time and lost productivity rather than licensing fees 21. AMD is a credible merchant alternative, with production Helios systems 21, substantial HBM capacity 21, and improving ROCm compatibility 21. Its software ecosystem remains narrower than CUDA 21, although standard PyTorch, JAX, vLLM, and SGLang workflows are becoming more portable to ROCm 21.

Over a longer time horizon, that portability could weaken NVIDIA’s software advantage and alter the stability of the broader accelerator ecosystem. For Broadcom, the implication is not that one architecture will replace another, but that the addressable market may expand across both custom ASICs and the networking, memory, packaging, and software required to connect heterogeneous systems.

Broadcom’s Expanding Position in the Ecosystem

Meta uses Broadcom to supply its MTIA custom AI chips 17, plans further MTIA generations through 2027, and announced a co-development partnership with Broadcom in April 2026 21. Broadcom also has a reported opportunity related to OpenAI’s “Jalapeño” processor 29. These individual claims have limited sourcing and should be treated as opportunity indicators rather than as a firm revenue forecast.

The more robust proposition is broader: AI adoption is increasing demand for custom processors, HBM, data-center production capacity, and high-performance networking 32. Broadcom’s position is strongest where a customer requires customized silicon but still needs an experienced partner to integrate design, interconnect, manufacturing, and deployment considerations. Its opportunity is consequently systems-level rather than confined to the sale of a single chip.

The shift toward inference strengthens this interpretation. Inference demand is growing as agents and multi-step tasks increase real-time compute usage 26. In such applications, performance per dollar and utilization may matter more than simple accelerator availability 34. Microsoft’s Maia 200 reportedly delivers approximately 30% higher performance per dollar than prior or alternative systems 34 and improves CPU utilization and GPU efficiency 34. These claims are based on limited sourcing, but they support the economic logic behind custom ASICs and infrastructure software: the preferred architecture may be the one that minimizes total cost per token, power consumption, and idle capacity rather than the one with the highest peak benchmark.

The Supply Chain: HBM, Packaging, and Foundry Access

HBM is a strategic complement to compute

AI accelerators combine dense low-precision compute with adjacent HBM 21. Memory movement is particularly important during token generation because model weights must be read repeatedly 21. GPU generations are using more HBM stacks, increasing from five stacks in NVIDIA’s H100 13 to eight in Rubin 13, while AMD’s MI400 is expected to use 12 stacks 13.

Demand for HBM is therefore expanding beyond NVIDIA GPUs to hyperscaler custom chips, networking, robotics, autonomous vehicles, and industrial automation 13. The market is oligopolistic, with only three established HBM suppliers 13, and HBM production is technically demanding 25. This combination of concentrated supply and increasing content per accelerator creates a structural constraint rather than a temporary procurement inconvenience.

SK hynix is the clearest example. It is identified as NVIDIA’s primary HBM partner 3,31 and is expected to supply nearly two-thirds of NVIDIA’s HBM4 demand 21. NVIDIA has a long-term memory supply agreement with SK hynix 36, while long-term HBM4 agreements are also reported more broadly 10. Tight supply is supporting both HBM and conventional DRAM pricing 31. Broadcom is seeking more memory from suppliers 10, underscoring that even a successful ASIC design remains dependent on access to complementary components.

Packaging may be the binding constraint

We must be careful to distinguish wafer fabrication from the full set of processes required to deliver an AI accelerator. The cluster identifies advanced packaging, HBM, and electricity as the principal constraints 21, and specifically describes advanced packaging rather than process-node availability as the current binding constraint 21. AI infrastructure relies heavily on TSMC’s advanced-packaging capacity 21, while CoWoS allocation is reportedly concentrated and heavily favors NVIDIA 21.

Claims that NVIDIA has locked up more than 50% to 60% of CoWoS capacity 9 should be treated cautiously because these are analyst estimates rather than public TSMC capacity data 21. The more durable conclusion is that access to packaging, HBM, foundry services, and supplier relationships increasingly determines whether an ASIC design can become revenue-generating production.

The reported Samsung-Broadcom collaboration includes Samsung HBM4, advanced-node foundry capacity, and 2.5D/3D packaging 20. It could provide Broadcom with a more integrated route to deliver custom AI hardware while strengthening Samsung’s foundry position 18,24. Samsung’s ability to combine memory, sub-2-nanometer foundry services, and advanced packaging 10 is therefore strategically relevant. The collaboration may improve supply assurance, but its value will ultimately be determined by execution, qualification, production yields, and delivery against customer schedules.

Power, Networking, and Infrastructure Efficiency

Physical infrastructure sets the deployment ceiling

Power and physical infrastructure impose a parallel limit on AI expansion. AI campuses have enormous power requirements 34, and data centers require reliable electricity, transmission, land, water, construction capacity, cooling, networking, and clustered computing equipment 16. Power availability and project execution are primary constraints for infrastructure suppliers 27, while next-generation chips are becoming more expensive and power-hungry 25.

The scale is material. A 20,000-chip Kimi cluster is estimated to require 25–35 megawatts 14, and Meta is targeting approximately three gigawatts of compute capacity by 2028 23. These figures explain why performance per watt and tokens per megawatt are becoming more important than nominal chip availability 21. Some purchased NVIDIA chips may remain idle because power and related infrastructure are unavailable 23. Thus, strong hardware orders do not necessarily translate immediately into deployed and revenue-producing systems.

Networking and software capture value from scarce capacity

This constraint expands the value proposition for Broadcom’s networking and infrastructure-efficiency businesses. Optical transceivers are essential for moving data among thousands of GPUs and storage systems 35. Cluster performance depends not only on processor capacity but also on the network connecting processors and storage 35. AI deployments require high-speed data exchange across large GPU populations 35, making the expansion of AI clusters and hyperscale data centers a primary catalyst for optical-transceiver demand 35.

Broadcom’s outlook is consequently tied to international technology supply chains 30 and to execution in both AI and optical infrastructure 30. The relevant validation conditions include stable optical supply, resilient margins, and successful production ramp-up 30. This is a broader and more demanding proposition than simply forecasting accelerator demand.

Broadcom’s software and infrastructure portfolio adds an efficiency-oriented layer. As server-hardware costs rise, software that increases throughput and reduces the number of physical nodes becomes more valuable 28. Broadcom’s two-node Software-Defined Storage-and-Processing design can reduce hardware requirements by up to 33% 28. The strategy is intended to extend utilization of existing infrastructure 28 and reduce physical hardware requirements 28. This is particularly relevant when GPUs, power, and data-center capacity are scarce.

The limitation is implementation. Integrating Broadcom’s products into heterogeneous customer environments creates an execution burden 19, and multivendor infrastructure increases operational complexity 19. The economic benefit of greater utilization must therefore be weighed against qualification, integration, and operational costs.

Competitive and Financial Risks

MediaTek and the durability of the TPU relationship

The principal competitive threat within Broadcom’s custom-chip franchise is MediaTek’s growing role in Google’s TPU business. MediaTek is identified as a competitor 32, its expanding role is described as the key potential disruption to Broadcom’s growth thesis 32, and concerns about share gains contributed to Broadcom’s relative underperformance 32. This creates a direct tension with claims that Broadcom retains roughly 80% or a majority share of Google’s TPU supply 32.

The appropriate interpretation is conditional. Broadcom’s current position appears strong, but its durability is not assured. The relevant monitoring variables are TPU design wins, production volumes, MediaTek’s qualification progress, and whether Google broadens its supplier base.

Efficiency could moderate memory intensity

A second tension concerns the relationship between AI growth and memory content. HBM demand is likely to increase as accelerators become more capable, but efficiency measures may moderate memory intensity per unit of AI output. NVIDIA may reduce HBM per rack and pursue memory pooling as cost-control measures 13. Memory tiering can also shift some demand from DRAM toward enterprise NVMe or CXL devices 11. These technologies can reduce server acquisition costs 11, and one reported deployment reduced host-memory expenditure by 50% to 65% 11.

Tiering does not eliminate the underlying memory-supply problem, however, and it introduces endurance, reliability, and qualification risks for enterprise NVMe devices 11. HBM remains a major near- to medium-term demand driver, but utilization improvements, pooling, quantization, model distillation, and specialized inference hardware could reduce memory and accelerator demand per unit of AI output 26.

Capital intensity and credit exposure

The most significant financial risk in the ecosystem is that infrastructure investment is capital-intensive and increasingly debt-funded. CoreWeave, a useful indicator of specialized AI-cloud economics, has negative free cash flow 8,33, a debt-to-equity ratio of 10.8 4,33, a negative net margin of approximately 22.7% 33, and a current ratio of 0.5x 33. Analysts expect substantial free-cash-flow losses through 2028 because of GPU purchases and infrastructure expansion 33, while CoreWeave remains heavily dependent on NVIDIA for hardware and financing 12,33.

This creates a broader risk for Broadcom. If neoclouds, hyperscalers, or other buyers face insolvency, downgrades, or financing stress 25, orders for ASICs, networking, optical equipment, and memory could be deferred even if the long-run demand narrative remains intact. Oracle’s debt-funded buildout 15, leverage, and negative free cash flow in anticipation of future cloud demand 15 illustrate the same exposure at a larger platform.

Broadcom’s bullish case therefore rests on sustained AI-infrastructure growth and supply-chain advantages 30, but the valuation case is execution-dependent. Hardware valuations remained high and continued to beat expectations in 2026 26, increasing the possibility that favorable news is already reflected in prices. The company’s outlook remains linked to sustained AI investment 30, successful production ramp-up, optical supply, resilient margins, and delivery against the Samsung arrangement 30.

Implications for Investors

Broadcom’s most important strategic identity is that of a systems-level supplier to AI infrastructure rather than merely a chip designer. Its opportunity is greatest where hyperscalers require customized silicon but still need assistance integrating ASIC design, HBM, advanced packaging, high-speed interconnect, optical networking, and software. The Samsung collaboration is particularly important because it potentially combines Broadcom’s ASIC expertise with Samsung’s manufacturing, HBM, and packaging capabilities 20,24. If executed successfully, it could improve Broadcom’s supply assurance and make the company more valuable to customers seeking an integrated alternative to NVIDIA’s tightly controlled platform.

The company’s moat is increasingly relational and execution-based. It includes long-term customer engineering relationships, custom-ASIC experience, access to critical suppliers, networking and optical content, and software that can improve infrastructure utilization. Its vulnerabilities include MediaTek’s potential TPU share gains, customer concentration, HBM and packaging availability, optical supply, export controls, and a reversal in hyperscaler capital spending.

The comparison with NVIDIA is therefore one of exposure rather than simple superiority. NVIDIA is more directly exposed to merchant accelerators and CUDA. Broadcom’s exposure is distributed across custom ASIC programs, networking, optical infrastructure, and software, but it still depends heavily on a limited group of hyperscaler customers and critical suppliers 22. Improving framework portability could erode NVIDIA’s CUDA advantage 21, while heterogeneous racks could weaken a simple vendor-based competitive model 21. That environment favors suppliers able to integrate multiple components and support mixed architectures, but it also raises the execution burden.

Investors should distinguish durable structural evidence from promotional performance claims. NVIDIA, AMD, and AMD/Cerebras efficiency figures are vendor-provided and not independently verified 21. The AMD-Cerebras claim of five times higher tokens per second per watt is modeled rather than measured and compares against a Cerebras-only configuration 21. Similarly, NVIDIA’s claimed one-tenth cost per token for Rubin versus Blackwell 21 should not be incorporated into base-case forecasts without third-party validation. The investable signal is the direction of travel toward efficiency, disaggregated inference, and heterogeneous racks, not any single advertised performance ratio.

Under current conditions, the evidence suggests that Broadcom is well positioned to benefit from the gradual evolution of AI infrastructure toward custom silicon and integrated systems. The thesis should be tested against production ramp, TPU share retention, optical supply, resilient margins, and measurable gains in cost per token and infrastructure utilization 30. It should not rest on unverified vendor performance claims 21. The central uncertainty is therefore not whether AI infrastructure will expand, but how quickly supply constraints, customer concentration, competing suppliers, financing conditions, and efficiency improvements will alter the equilibrium.

Key takeaways

Comments ()

characters

Sign in to leave a comment.

Loading comments...

No comments yet. Be the first to share your thoughts!

More from KAPUALabs

See all
| Free

AI Infrastructure Shifts from GPUs to Custom Silicon

By KAPUALabs
/
| Free

Virtualization's Security Crisis Tests Broadcom's AI Bet

By KAPUALabs
/
| Free

Broadcom's VMware Bet: Security-Driven Revenue vs. Customer Churn Risk

By KAPUALabs
/
| Free

Broadcom and the Memory Supply Crisis: A Comprehensive Analysis

By KAPUALabs
/