EP 65: The AI Bottleneck Nobody's Watching | Troy Liljedahl, Backblaze

Deskripsi

Storage is the least glamorous layer of the AI stack — and often the actual reason GenAI pipelines stall between pilot and production. Sam sits down with Troy, Senior Director of Solutions Engineering at Backblaze, to unpack what's really happening under the hood when AI infrastructure fails to scale.Topics covered:What actually happens when a GPU sits idle — and the opportunity cost most teams don't account forWhy storage bottlenecks are the hidden reason enterprise GenAI adoption stallsBackblaze's role as a capacity and data lake tier for companies building their own modelsInside B2 Overdrive: dedicated bandwidth up to a terabit per second, predictable IOPS, and no egress chargesWhy hyperscalers prioritize large foundational model companies over startups and researchers when resources tightenThe financial case for avoiding egress costs when training on tens to hundreds of petabytes of dataSkills engineers need to survive and prosper in the current AI infrastructure landscape — including agent managementAdvice for new grads entering the storage and infrastructure industryWhy Troy sees parallels between today's AI hype cycle and the dot-com bubble — and why the technology shift is still realWhy human interaction and direct customer conversations remain irreplaceable, even as AI reshapes product developmentGuest Bio: Troy is Senior Director of Solutions Engineering at Backblaze, where he leads the team helping AI customers integrate cloud storage and solve data infrastructure challenges. He has nearly a decade of experience in cloud storage and AI infrastructure at Backblaze.Connect: Find Troy on LinkedIn to learn more about Backblaze's AI storage solutions.