Beyond HBM: Where AI Data Center Spending Goes Next

At first, the AI trade looked simple. More AI meant more GPUs, and more GPUs meant more HBM.

That logic is still important. But a data center does not become useful the moment a chip leaves a factory.

It has to be powered, cooled, connected, packaged, installed, and kept running. That is where the AI story starts to look much wider than a single semiconductor category.

For technology investors, the more useful question may be this: when AI data centers expand, where does the money go after the GPU and HBM order is placed?

Server room at The National Archives in the United Kingdom
Photo: server room at The National Archives · EduVolunteer · CC BY 3.0 · source: https://commons.wikimedia.org/wiki/File:A_view_of_the_server_room_at_The_National_Archives.jpg


Key Takeaways

  • AI infrastructure spending begins with accelerators and memory, then continues through power equipment, cooling systems, networking, packaging materials, and data-center construction.
  • As computing density rises, electricity availability and heat removal become practical limits, not merely operating costs.
  • Advanced package substrates matter because they help connect increasingly complex chips to the rest of the system.
  • Different companies can benefit from the same AI buildout, but their results still depend on order timing, capacity, customer concentration, and margins.


The Key Question: What Happens After the GPU Order?

It is easy to understand why GPUs and HBM receive so much attention. They sit at the center of AI training and inference. Without powerful accelerators and fast memory, there is no modern AI cluster to speak of.

But a large AI cluster is not a box of chips. The chips need servers, the servers need racks, the racks need networking, and the entire facility needs a reliable flow of electricity and a way to move heat out of the building. The AI investment story can therefore spread in stages rather than arrive in one semiconductor order.

The point is not that HBM suddenly becomes less important. It is that HBM is one visible part of a much longer spending chain. NVIDIA’s FY2026 data-center revenue provides the scale of the accelerator buildout; the next question is whether the physical infrastructure can keep pace.



Power Has Become a Physical Constraint

Traditional data centers already consume significant electricity, but AI workloads change the conversation because they can concentrate much more computing power into a smaller footprint. The IEA projects data-center electricity consumption to rise from 485TWh in 2025 to about 950TWh in 2030, while AI-focused data-center demand could triple over the same period.

An AI server rack connected to power equipment, liquid cooling, and a semiconductor substrate in a data center
Original illustration of the power, cooling, and substrate layers behind an AI data center

That shifts attention toward equipment that once looked less glamorous: transformers, switchgear, uninterruptible power systems, power distribution units, busways, backup generation, and the grid connections outside the building. For a cloud provider, the question is not only whether it can buy more servers. It is whether enough power can be delivered to the site, on schedule, with the reliability required for an always-on service.

AI demand may be global, but power availability is local. Two projects with similar server budgets can move at very different speeds if one site has an easier path to interconnection, permitting, and electrical equipment. That difference matters when investors read capital-expenditure headlines.



Cooling Is No Longer a Side Detail

More power becomes more heat. That sounds obvious, but it is becoming one of the defining practical issues in AI infrastructure. Air cooling remains useful across much of the installed base, while higher-density deployments may call for improved airflow management, rear-door heat exchangers, direct-to-chip liquid cooling, or other liquid-based designs.

There is no single cooling architecture for every AI facility. The choice depends on workload, location, water availability, building layout, and an operator’s own engineering preferences. The durable point is that thermal management is moving closer to the center of the purchasing decision.

Cooling also affects construction, maintenance, energy use, and the speed at which additional computing capacity can be brought online. Vertiv’s 2026 results are one example of how suppliers describe the trend toward more complex, infrastructure-intensive AI deployments; they should not be read as proof that every cooling supplier will grow at the same rate.



Why Advanced Substrates Matter

Substrates are less visible than GPUs, but they are a useful reminder that advanced computing depends on specialized manufacturing below the finished chip. In semiconductor packaging, a substrate provides electrical pathways between a chip package and the circuit board. As chips become more complex, with more connections and tighter performance requirements, packaging and substrate technology become more demanding.

This matters in AI systems because high-performance processors, memory, and advanced packaging must work together under demanding electrical and thermal conditions. Ibiden’s announced investment in package substrates for AI and high-performance servers is a concrete example of the supply chain expanding beyond the silicon die.

The market does not reward every substrate supplier in the same way. Technology specifications, yield rates, customer qualification cycles, and capacity expansion all still matter. The broader lesson is simply that AI infrastructure is also a materials-and-manufacturing story.



Related Companies

This theme is better viewed as a map than as a single-stock story. At the chip level, accelerator designers, memory producers, foundries, and advanced-packaging specialists are the most visible participants. At the system level, server makers, networking suppliers, and optical-component companies turn silicon into an operating AI cluster.

Then comes the physical layer. Electrical-equipment manufacturers such as Eaton and Schneider Electric, thermal-management specialists such as Vertiv, data-center operators, engineering firms, and utilities can all sit somewhere along the path between an AI model and a functioning data center. These categories are not interchangeable: each has different lead times, customer dependencies, and margin structures.



Investment Watchpoints

  • Cloud-provider capital-expenditure plans and data-center construction updates
  • Utility interconnection timelines, permitting, and transformer or switchgear lead times
  • Server-rack density and stated cooling architecture
  • Package-substrate capacity additions, utilization, and yield commentary
  • The gap between an announced order and the period when it is recognized as revenue

Demand does not automatically become profit. A company can receive strong orders and still face component shortages, pricing pressure, project delays, or the cost of expanding capacity. This is not a buy-or-sell recommendation; it is a framework for following how AI capital spending moves through a supply chain.



What Could Slow the Story Down?

AI infrastructure spending can be powerful without moving in a straight line. Power shortages, permitting delays, grid upgrades, construction bottlenecks, component availability, and slower-than-expected returns on AI services can all affect the pace of deployment.

There is also a timing issue. Semiconductor orders, server shipments, and facility construction do not always happen in the same quarter. A strong chip cycle does not guarantee that every downstream supplier reports the same kind of growth at the same time.



Appendix. What Do Power, Cooling, and Substrates Actually Do?

Power infrastructure brings electricity from the grid into the facility and distributes it safely to computing equipment. Cooling systems remove the heat created by that equipment. Substrates help connect advanced semiconductor packages to the broader electronic system.

None of these areas may sound as exciting as a new AI-model launch. But without them, even the most advanced chips cannot operate at scale. AI is software at the surface, silicon at the core, and physical infrastructure underneath.



Sources and Update

This article is for general information and industry discussion only; it is not investment advice or a recommendation to buy or sell any security.

댓글 없음:

댓글 쓰기

안녕하세요 :)