For the past few years, the AI infrastructure conversation has been dominated by one metric: Compute. For GPUs, CPUs, memory, interconnect speeds, and power density – these performance benchmarks have multiplied. When the immediate priority is to train large models and move AI from experimentation into real-world use, this focus on compute made sense.
However, as AI adoption matures across Asia Pacific, the structural gap between compute and data becomes critical. Training remains important, yet the next phase of AI will not only be defined by how much compute organizations can deploy, but by how much data AI systems will consume, generate, retain, and reuse over time. The difference becomes even clearer as AI moves into production and inference to drive business value.
AI does not just use data, it creates new data continuously, from context and metadata to outputs, histories, and operational exhaust that many organizations will want to retain for governance, model improvement, or future use.
Different AI workloads also require different storage tiers, from data ingestion and training to inference and long-term retention, because each stage carries fundamentally different requirements for performance, capacity, scale and cost. Once inference begins, the divergence becomes clearer - compute may scale in waves, but data keeps growing without pause.
Data doesn't reset. Unlike compute and memory infrastructure, which follow refresh cycles and can be reused across workloads, data compounds with every training run, every inference, and every interaction.
Over time, AI production environments begin to behave more like data systems than pure compute systems, because the accumulation of data starts to define how those systems scale, operate, and deliver value. This is especially relevant in APAC, where AI adoption is accelerating under different combinations of scale, cost pressure, energy constraints, and regulatory complexity.
Scaling AI Data in Asia Pacific
Growth is evident in APAC. A
report from Deloitte showed that the region is set to become the world’s next data center hub – with approximately US$800 billion in data center investment expected by 2030.
At the same time, AI infrastructure planning in APAC can be complex. The APAC region encompasses a mix of hyper-growth digital economies, markets with established infrastructures, and emerging AI native environments, each with its different set of priorities. In fact, the same report notes that APAC is already home to major data center hubs in China, Japan, and Singapore, while other markets like Australia, India, and Malaysia are rapidly attracting major new investment as demand for storage, analytics and processing accelerate.
As such, the real bottleneck in AI is increasingly less about bursts of processing power but more about managing data at scale. As AI environments grow, organizations must support different tiers of data across the lifecycle: hot data requiring fast access, warm data used intermittently, cold data stored long-term. Collapsing everything into one single high-performance tier may work at small scale, however, it becomes inefficient and economically unsustainable as data volumes grow.
In practical terms, APAC’s AI growth will place pressure not only on compute deployment, but also on the broader data architecture needed to support AI responsibly and economically over time. That is why architecture now matters as much as raw speed. When it comes to scaling, it is about availability, durability, resilience, and the economics of retaining and managing data over time. What matters now is whether the underlying architecture can keep pace as data volumes rise, workloads change, and cost pressures intensify.
Long Term Cost of AI
As AI moves into continuous data generation, the long-term cost of AI will be determined not only by compute, but by how efficiently organizations retain and manage data over time. At scale, the total cost of ownership (TCO) is shaped by the cumulative impact of drive, power consumption, cooling unit, rack space, and operational burden of managing surging volumes of data.
This is why sustainability becomes inseparable from infrastructure design. The issue is not only how to power compute, but how to build AI as data systems that use capacity, energy, and space efficiently - from ingestion and training to inference and long-term retention. Not all data needs to live in the same performance tier, and designing around an all-flash architecture is inefficient and cost prohibitive. Matching storage resources to workload needs allows organizations to use capacity, energy, cooling, and physical space more efficiently across the lifecycle.
For infrastructure leaders, that means treating sustainability and TCO as storage design priorities from the start. Don’t let storage be an afterthought. Assumptions made at the start about retention, tiering, durability, and availability have long-term consequences once systems are in production, and become costly to revisit at scale. Organizations that build with the full data lifecycle in mind will be better positioned to scale AI in a way that is both economically sustainable and operationally resilient.
The Next Phase of AI Will Be Defined by Data System Architecture
The industry is moving beyond a phase where AI infrastructure was framed mainly around chips, benchmarks, and peak model performance. The next phase will be shaped by architecture choices that determine whether systems remain affordable, adaptable, and sustainable as usage expands.
That means asking harder questions such as
How much data should be retained, and for how long? Which workloads require premium performance, and which do not? How should organizations balance access, resilience, governance, and cost? What type of tiered architecture is needed? These are no longer secondary issues. They are central to whether AI can scale in a commercially viable and operationally durable way.
The next winners in AI will not simply be the organizations that deploy the most compute. They will be the ones that understand how AI systems behave over time and build around the reality that AI doesn’t just consume data, it also creates data. At scale, that data becomes the foundation of business value.