Landlocked by Your Data: Why Data Gravity Is the Hidden Constraint on Every AI Workload

Picture of DataStorage Editorial Team

DataStorage Editorial Team

AI INFRASTRUCTURE & WORKFLOWS 9 min read  ·  July 2026
Moving a GPT-3 scale training set once costs roughly $3,875 in egress fees. Moving the LAION-5B dataset once costs roughly $15,800. Neither number includes the engineering time, the re-architecture, or the second move you'll eventually need to make.

Moving a GPT-3 scale training set once costs roughly $3,875 in egress fees, at AWS's standard tiered rates. Moving the LAION-5B dataset, the 240 terabyte corpus behind Stable Diffusion, costs roughly $15,800 once. Those are one-time numbers, for one move, at relatively modest AI-era scale. Enterprises operating at petabyte scale are looking at bills in the tens or hundreds of thousands of dollars every time a dataset needs to relocate, and in AI infrastructure, datasets relocate constantly: to a new GPU provider, a new region, a new training run.

This is data gravity, and it is quietly becoming the single most expensive architectural constraint in AI infrastructure. Compute gets the budget attention. Storage decides whether that compute can actually reach the data it needs, and increasingly, whether it can afford to.

10-15%
of total cloud bill the average organization spends on egress charges
Gartner
8,000%
markup AWS egress fees represent over wholesale transit costs
Cloudflare
20%
of enterprises predicted to run AI workloads locally by 2028, up from under 2% in 2025
Gartner
$900B+
global public cloud spending projected for 2025
Gartner

What Data Gravity Actually Is

The term was coined by Dave McCrory in 2010: large concentrations of data attract applications, services, and infrastructure toward them, the way mass attracts mass under gravity. The larger the dataset, the stronger the pull, and the more expensive and complex it becomes to move. Applications end up migrating toward the data rather than the other way around, because moving the data is the costlier option every time.

In AI infrastructure specifically, this plays out as a direct architectural tension. You want the cheapest or fastest available GPU capacity, which this week might be at a different provider than last week. Your training data, however, is sitting wherever you first landed it, often a hyperscaler you chose years before AI workloads were part of the plan. Every time compute and data are not in the same place, one of them has to move, and moving data is almost always the more expensive option.


Why AI Makes Data Gravity Worse, Not Better

Cloud was supposed to make data portable. In practice, it concentrated data inside a small number of providers who charge specifically for the act of moving it back out. AI has intensified every dimension of that problem at once.

Dataset sizes have exploded

Training and inference pipelines now routinely work with petabyte-scale corpora, logs, embeddings, and checkpoints. A petabyte is roughly 13 years of continuous high-definition video. Moving that volume is a materially different problem than moving a few terabytes of application data ever was.

GPU availability is volatile and provider-specific

Enterprises may need AWS today, a specialized neocloud tomorrow, and a different provider next quarter depending on what capacity is actually available. Every provider switch drags the training data along with it, and the egress bill on that move can exceed whatever savings motivated the switch in the first place.

Agentic AI needs data everywhere, immediately

Agents that query data, trigger processes, and coordinate across systems need fast, at-scale access to enterprise context spread across multiple environments. Each additional system an agent touches increases both governance risk and the pull toward centralizing that data somewhere, which reintroduces gravity even when the original goal was distributed access.

Most enterprise data still sits on-premises

Roughly 80 percent of enterprise data still sits on-premises, according to industry analyst commentary on enterprise storage patterns, while the AI tools that need it run in the cloud. Bridging that gap is not a one-time migration, it is an ongoing tax on every workload that needs both sides.

Free Tool
See What You're Actually Paying Across Providers
Use our Cloud Cost Calculator to compare real pricing, including egress, across AWS, Azure, GCP, Backblaze, Wasabi and more, side by side, in seconds.
Try the Free Calculator →

The Real Cost of Data Gravity

Egress fees are the most visible cost, but far from the only one. Gartner estimates that organizations spend 10 to 15 percent of their total cloud bill on egress charges, against a global public cloud spending base Gartner projected to exceed $900 billion in 2025. Cloudflare has separately documented that AWS's egress fees represent nearly an 8,000 percent markup over wholesale transit costs in North American markets, a figure that is hard to explain as pure cost recovery rather than a deliberate toll on data leaving the platform.

The cost is not only the transfer itself. Data gravity forces architectural compromises that show up elsewhere in the budget: duplicated backup and disaster recovery infrastructure maintained in place rather than consolidated, compute positioned suboptimally because the data can't move to where cheaper or faster compute lives, and abandoned or delayed migrations because the egress bill alone kills the business case. Flexera's 2026 State of the Cloud Report found 53 percent of organizations now cite security and compliance risk with cloud-based AI as their top challenge, a governance burden that compounds every time data sprawls across another environment to chase available compute. This connects directly to why storage functions as the anchor of the AI infrastructure stack rather than a detail to sort out after compute is chosen.


A Worked Example: What Moving Your Data Actually Costs

The math is straightforward once you put real numbers against it.

Dataset Size One-Time Egress Cost
GPT-3 scale training set ~45 TB ~$3,875
LAION-5B (Stable Diffusion data) ~240 TB ~$15,800
Mid-size enterprise data lake 500 TB $40,000+

These are one-time costs, calculated at standard hyperscaler tiered rates. In practice, AI infrastructure rarely involves a single move. A dataset that shifts between a hyperscaler and a neocloud for training, then back for inference, then out again for a provider renegotiation, pays that egress bill multiple times over the life of the project. At petabyte scale, an organization moving even 5 percent of a 50 petabyte estate annually is looking at a bill that can run into eight figures.

Partner Offer
Get Started with Backblaze B2, Zero Egress Fees
Backblaze B2 offers S3-compatible object storage at a fraction of AWS costs, with no egress fees when paired with Cloudflare. Trusted by 500,000+ businesses.
Visit Backblaze B2 →

How to Fight Data Gravity Architecturally

Move compute to the data, not the other way around

The most direct fix is architectural: run training and inference workloads against data where it already lives, rather than centralizing data to chase available compute. Query-in-place engines, external table formats, and data lakehouse architectures increasingly make this practical without duplicating the dataset itself.

Choose zero-egress or low-egress storage for anything that will need to move

Zero-egress providers exist specifically to remove this cost from the equation. Backblaze B2 and Wasabi both offer S3-compatible object storage without the egress penalty that turns a routine provider switch into a five-figure surprise. For any dataset likely to move between GPU providers over its lifetime, this is not a nice-to-have, it is the difference between a switch that pencils out and one that doesn't.

Tier data by how often it actually moves

Not every dataset needs to be positioned for frequent movement. Hot training data and active inference caches justify premium, high-bandwidth positioning. Cold archives and infrequently accessed logs do not, and tiering them appropriately reduces both storage cost and the blast radius of any future egress bill.

Build portability into new pipelines from day one

Design new AI data pipelines with platform independence as a first-class requirement rather than an afterthought. Avoiding proprietary transformation tools and APIs where open alternatives exist keeps the option to move open, even if you don't exercise it immediately.

Budget for egress as an ongoing line item, not a one-time migration cost

Model the recurring cost of data movement between platforms over the life of a workload, not just the cost of the initial migration. Architectural decisions made today generate egress bills for years, and treating that as a sunk one-time cost rather than an ongoing operating expense is how budgets get blindsided.

Fast Checklist Before Your Next GPU or Cloud Switch
  • Calculate the full egress cost of moving your training data before comparing GPU sticker prices.
  • Check whether your target provider or its storage partner charges egress at all.
  • Confirm whether the workload can run against the data in place instead of requiring a full move.
  • Separate data that needs to move from data that can stay tiered and cold.

Key Takeaways

Key Takeaways
  • Data gravity, the tendency for large datasets to attract applications and pull against being moved, has become one of the most expensive constraints in AI infrastructure, not just a storage curiosity.
  • Gartner estimates organizations spend 10 to 15 percent of their total cloud bill on egress charges, against global public cloud spending Gartner projected to exceed $900 billion in 2025.
  • Cloudflare has documented AWS egress fees at nearly an 8,000 percent markup over wholesale transit costs, underscoring that egress pricing functions as a lock-in mechanism as much as a cost-recovery measure.
  • Moving a GPT-3 scale dataset costs roughly $3,875 once, moving LAION-5B costs roughly $15,800 once. At petabyte enterprise scale, annual egress on even a small fraction of the data estate can reach eight figures.
  • Gartner predicts more than 20 percent of enterprises will run AI workloads locally in their own data centers by 2028, up from under 2 percent in early 2025, as organizations architect around data gravity rather than fighting it.
  • The fix is architectural: move compute to data where possible, use zero-egress storage for anything likely to move, tier data by actual mobility needs, and budget egress as a recurring cost rather than a one-time migration line item.

FAQ

Is data gravity the same thing as vendor lock-in?
They're related but not identical. Vendor lock-in describes contractual or technical dependency on a specific provider. Data gravity describes the physical and economic pull that makes moving data expensive regardless of contract terms. Egress fees are the mechanism that turns data gravity into a form of lock-in, but data gravity would exist to some degree even without deliberate pricing designed to discourage movement.
Can data gravity be eliminated entirely?
Not entirely, since some of it is genuine physics: moving petabytes takes real bandwidth and real time regardless of pricing. But the economic portion, the egress fees layered on top of the technical cost, can be substantially reduced by choosing zero-egress storage providers and designing pipelines that query data in place rather than duplicating it.
Does moving to a single hyperscaler solve data gravity?
No, and this is a common misconception. Consolidating onto one hyperscaler doesn't eliminate data gravity, it just relocates the center of it. You still pay significant egress costs to move data out of that hyperscaler later, and you've now built years of AI pipelines, analytics tools, and integrations on top of that single location, deepening the pull rather than escaping it.
How much should I budget for egress on a new AI infrastructure project?
There's no universal percentage, but Gartner's figure of 10 to 15 percent of total cloud spend is a reasonable planning baseline for organizations with meaningful multi-cloud or multi-provider GPU strategies. Model it as a recurring line item tied to how often your specific workloads are likely to move, not a one-time migration cost.
What's the fastest way to reduce data gravity exposure on an existing setup?
Start by identifying which datasets actually move regularly versus which sit untouched. Cold, rarely accessed data can often be tiered to lower-cost, zero-egress storage immediately with minimal risk. That alone typically addresses the largest and easiest share of egress exposure before any bigger architectural changes are needed.
Compute is mobile. Data is not, until you architect it to be, and every dollar you save on cheap GPUs can disappear the moment you have to move the data to reach them.
Weekly Newsletter
Stay Ahead in Cloud Infrastructure
Join 1,200+ CTOs, architects, and cloud professionals who get our weekly briefing on storage strategy, GPU compute, and cloud cost intelligence.
Subscribe Free →

References

  • Gartner: cloud egress spend and public cloud market sizing estimates (2025 to 2026)
  • Gartner: Market Guide for Hybrid AI Infrastructure, prediction on enterprise AI workloads running locally by 2028
  • Cloudflare: documented analysis of AWS egress pricing versus wholesale transit costs
  • Flexera: 2026 State of the Cloud Report
  • DataStorage.com Podcast, Episode 7: Inside the GPU Carrier Layer, with Sunny Smith, Massed Compute

Share this article

🔍 Browse by categories

Free Cloud Cost Calculator

Compare AWS, Google Cloud, Azure, and alternatives like Backblaze B2 Discover how much you could save in seconds

🔥 Trending Articles

Newsletter

Stay Ahead in Cloud
& Data Infrastructure

Get early access to new tools, insights, and research shaping the next wave of cloud and storage innovation.