Episode 7

Inside the GPU Carrier Layer: Sunny Smith of Massed Compute on Neoclouds, AI Infrastructure & the Future of Enterprise Compute

Sunny Smith, Founder & CTO of Massed Compute, joins John Kosturos to pull back the curtain on AI's real infrastructure layer. From why most Neoclouds don't actually own their GPUs, to the storage bottleneck killing AI performance, to a GPU market so scarce vendors are writing preemptible contracts, this is the unfiltered operator view most people never hear. If you're building on AI infrastructure or buying GPU compute, this episode will change how you evaluate your stack.

About This Episode

What Does It Actually Mean to Own the GPU Layer of AI?

John Kosturos sits down with Sunny Smith, Founder and CTO of Massed Compute, one of the few operators building at the true infrastructure layer: owning hardware, deploying GPUs at scale, and powering what he calls the “underlying carrier layer” for next-gen cloud.

Sunny Smith

Sunny Smith

Founder & CTO, Massed Compute

A full-stack executive who still codes. Sunny has lived through every major tech wave: the PC revolution, the internet era, big data, and now AI. He went from selling an ISP in the 90s to building a multi-tiered GPU cloud from the ground up, starting with 20 servers and 160 GPUs.

In This Episode

GPU Ownership Reality

Why most Neoclouds don’t actually own their GPUs and why that matters for you as a buyer.

▶ Watch now

The Dropshipping Problem

How “dropshipping infrastructure” breaks down on the support side when you need it most.

▶ Watch now

Storage as the Achilles Heel

Why storage, not compute, is the true bottleneck of AI and the data locality problem explained.

▶ Watch now

Local Metal Solution

How Massed Compute’s on-prem GPU leasing model solves the enterprise AI dilemma.

▶ Watch now

Agentic AI & Optimization

How agentic AI now runs real-time cluster optimization, replacing what used to take days of human effort.

▶ Watch now

GPU Market Dynamics

Preemptible contracts, 40% down payments, and a seller’s market unlike anything seen in 30 years.

▶ Watch now

Post-Kubernetes Infrastructure

What the next infrastructure layer looks like and why optimization is the real competitive moat.

▶ Watch now

The Capital Question

AI has consumed more inflation-adjusted capital than building the entire US interstate highway system.

▶ Watch now

Who Should Listen

CTOs, Engineering Leaders & Cloud Architects

Evaluating GPU infrastructure providers? This episode teaches you the right due diligence questions to ask, starting with “Do you actually own the GPU?”

FinOps & Procurement Teams

Understand why NVMe prices have tripled, why storage is no longer a rounding error on your cloud bill, and how to think about OpEx vs. CapEx for GPU infrastructure.

AI Builders & Developers

Fine-tuning models, building RAG pipelines, or deploying inference workloads? Sunny breaks down the infrastructure decisions that are silently costing you performance.

Enterprise Decision-Makers in FinTech, Healthcare & Regulated Industries

Learn why the “move everything to the cloud” era is over for IP-sensitive data and what the next-gen on-prem plus cloud hybrid model looks like.

Founders & Operators in the Neo Cloud Space

Get a rare insider view of how a bootstrapped GPU infrastructure company competed, survived, and evolved alongside the hyperscalers.

About Massed Compute

Massed Compute

A GPU infrastructure company that owns and operates its hardware, offering bare metal, virtual machines, and Local Metal on-prem GPU leasing. Serving developers, AI companies, and enterprises needing high-performance compute with white-glove, layer-7 support.

Newsletter

Stay Ahead in Cloud
& Data Infrastructure

Get early access to new tools, insights, and research shaping the next wave of cloud and storage innovation.