CUDO View

The CUDO View

CUDO Observatory editorial ยท Report dated 15 July 2026

AI infrastructure is not a buying problem. It is a systems decision.

The market still talks about GPU supply. Production outcomes are decided by how workload, power, site, cooling, network, storage, security and operations are aligned.

CUDO View sets out what we believe the evidence means, where infrastructure strategy is changing and what serious AI buyers should challenge before they commit capital.

This is CUDO's interpretation of the evidence, not another summary of it.

The market has moved upstream

The constraints that decide AI scale now sit well beyond the accelerator.

71%

Infrastructure-related factors account for 71% of cost-driver selections in CUDO's Land. Power. Compute. research.

32.1%

Power availability is the single most-cited blocker to deploying AI workloads in CUDO's survey.

94.4%

Respondents treat energy procurement as a core part of AI strategy, rising to 99% in the UK.

Source: CUDO Land. Power. Compute., Censuswide research with 701 AI infrastructure decision-makers, February 2026.

CUDO research

Methodology
Six shifts shaping our view

How AI infrastructure decisions are changing

Six shifts in how serious buyers should think about AI infrastructure โ€” each one a CUDO reading of the evidence, with the watches and analysis behind it.

01CUDO interpretation

Cloud abstraction has reached its limit

Cloud trained technology teams to treat physical infrastructure as somebody else's problem. Dense AI clusters reverse that model. Power delivery, cooling, floor loading, network topology and storage throughput now place hard limits on what software can do.

What this changes

Infrastructure, platform and facility teams need to make the design decisions together, before the workload scales.

Read

How AI infrastructure outgrew the cloud model

02CUDO interpretation

Workload placement comes before GPU selection

Training, fine-tuning and real-time inference do not belong in the same infrastructure by default. Training can often move towards power-rich locations and tolerate batching. Inference follows users, latency, data, availability and regulation. A single deployment pattern will usually compromise one of them.

What this changes

Classify the workload first. Then choose the geography, facility, architecture and commercial model.

Read

How AI infrastructure outgrew the cloud model

Building for 70% AI-driven demand

03CUDO interpretation

Power advantage outlasts hardware advantage

Hardware generations turn over quickly and prices eventually converge. Grid position, time to power and long-duration energy contracts do not. Two operators can deploy the same accelerator and still carry radically different cost bases because one has firm power on a deliverable timeline and the other carries grid delay, volatility or short-term exposure.

What this changes

Power contract, electrical delivery and time to power belong in the same investment decision as the GPU.

Read

Why power, not GPUs, now determines the cost of AI at scale

Power efficiency with sustainable energy sources

04CUDO interpretation

The facility is part of the computer

At AI densities, the building directly affects cluster performance. Cooling, electrical distribution, rack layout, fibre paths, network topology, storage and commissioning can create or destroy useful throughput. A cluster is not production-ready because the GPUs switch on.

What this changes

Design and validate the facility and cluster as one system. Test them under sustained workload before production acceptance.

Read

Cooling innovations for AI infrastructure

AI hardware installation and maintenance

05CUDO interpretation

Useful output is the real economic unit

GPU-hour pricing hides the cost of poor architecture fit, low utilisation, storage stalls, network contention and unreliable operations. The useful comparison is the cost and time required to produce the target result at the required quality, latency and reliability.

What this changes

Procurement should demand workload benchmarks, scaling curves, goodput, utilisation and cost per task, not simply a GPU model and hourly rate.

Read

How to select the right GPU for your AI workload

Real-world GPU benchmarks

06CUDO interpretation

Sovereignty is a control model, not a map pin

Data residency is only one layer. Regulated AI also depends on who operates the infrastructure, who can access it, which jurisdiction applies, how controls are audited and how the service recovers when something fails.

What this changes

Security, legal, procurement and infrastructure teams need one operating-control model, not separate checklists.

Read

CUDO Compute completes SOC 2 Type II audit

The decision framework

Start with the outcome. Work backwards through the system.

Teams often start with an allocation and work backwards. A stronger process starts with the workload and connects each decision before capital is committed.

1

Define the workload

  • Training, fine-tuning or inference
  • Model and data profile
  • Latency and availability
  • Sovereignty and security
  • Expected growth
2

Define useful output

  • Throughput
  • Quality
  • Response time
  • Reliability
  • Cost per task or training run
3

Choose the placement

  • Power availability
  • Time to power
  • Energy economics
  • Data gravity
  • Jurisdiction
  • Network proximity
4

Design the physical system

  • Power density
  • Cooling
  • Rack and floor design
  • Network fabric
  • Storage architecture
  • Upgrade path
5

Model the economics

  • Utilisation
  • Goodput
  • Contract term
  • Power exposure
  • Operating cost
  • Multi-generation TCO
6

Prove production readiness

  • Commissioning
  • Burn-in
  • Acceptance testing
  • Monitoring
  • Spares and support
  • Security controls

The decisions interact. A cheaper location can create latency or sovereignty cost. A faster GPU can lose its advantage to storage, networking or low utilisation. A power-ready site can still fail if the facility cannot support the density.

Questions by role

What each decision-maker should challenge

AI infrastructure and platform engineering

Will the proposed system deliver sustained goodput under the target workload, not simply pass component-level tests?

Challenge

  • Architecture fit
  • Scaling efficiency
  • Network and storage bottlenecks
  • Cooling under sustained load
  • Operational resilience

Relevant watches

Finance and procurement

Are we buying useful output and controlled risk over the contract term, or optimising an hourly price that hides the real cost?

Challenge

  • Utilisation assumptions
  • Power exposure
  • Contract duration
  • Cost per task
  • Upgrade and exit risk

Relevant watches

Security, legal and sovereignty

Do we control data, operations, access and recovery across the full stack?

Challenge

  • Jurisdiction
  • Operator access
  • Auditability
  • Data movement
  • Incident response
  • Continuity

Relevant watches

Enterprise AI leadership and investors

Is the programme anchored to deliverable power, realistic infrastructure timelines and a workload that justifies the capital?

Challenge

  • Time to power
  • Demand certainty
  • Workload placement
  • Delivery dependencies
  • Path to productive utilisation

Relevant watches

Deeper CUDO analysis

The research behind the view

CUDO View draws on our Land. Power. Compute. research, technical analysis and operating experience. These pieces develop the underlying arguments in more depth.

CUDO technical analysis

How AI infrastructure outgrew the cloud model

Why dense, vertically scaled AI clusters invalidate the assumptions that governed cloud-era infrastructure.

StrategyArchitectureLand. Power. Compute.

CUDO technical analysis

Why power, not GPUs, now determines the cost of AI at scale

Why grid position, contract structure and delivery timelines increasingly shape compute economics.

PowerEconomicsLocation

CUDO technical analysis

Cooling innovations for AI infrastructure

How rising density is changing facility design, cooling choice and deployment viability.

CoolingBuildDensity

CUDO technical analysis

AI hardware installation and maintenance

What production AI requires across site readiness, rack design, storage, commissioning and ongoing operations.

DeploymentOperationsReliability

CUDO technical analysis

How to select the right GPU for your AI workload

A workload-first framework for architecture fit, memory bandwidth, topology and effective cost.

GPUWorkload fitROI

CUDO technical analysis

Real-world GPU benchmarks

Controlled comparisons showing why price per GPU is not the same as price per useful output.

BenchmarksThroughputCost

CUDO technical analysis

Building for 70% AI-driven demand

How capacity planning, power, cooling and utilisation connect to the economics of AI infrastructure.

CapacityTCOPlanning

CUDO technical analysis

Power efficiency with sustainable energy sources

Why facility efficiency, compute efficiency and workload scheduling need to be considered together.

EfficiencyEnergyUtilisation
Explore all CUDO analysis
What we are watching next

The questions that will shape the next infrastructure cycle

CUDO research agenda

When will energy price differences move workloads?

Not every workload is mobile. CUDO is examining where price sensitivity changes placement and where sovereignty, latency, security or data gravity override the economic case.

Related

CUDO research agenda

Where will inference need to sit?

Inference economics will increasingly be shaped by the trade-off between cheap power, user proximity, availability, data location and response time.

Related

CUDO research agenda

Which facilities can survive the next two hardware generations?

The durable asset is not a single GPU generation. It is a facility and operating model that can absorb rising density, new cooling architectures and changing network requirements.

Related

Turn the view into a deployment decision

Pressure-test workload placement, power assumptions, cluster architecture and multi-year economics with CUDO.

Explore AI infrastructure