EP 61: "Shadow AI" — And No One's Watching | Rafi Khardalian, Actualyze AI

Description

This episode was recorded live from the Ai4 conference podcast pavilion, where host Mac Goswami sat down with Rafi Khardalian — CEO & co-founder of Actualyze AI, and a former technology leader at Cisco who helped build its container and Kubernetes platforms — about the governance, security, and orchestration layer most enterprises are missing.What's Covered:The Foundation for Enterprise AI — Rafi lays out why a patchwork of point solutions doesn't cut it, and how Actualyze unifies governance and security across every model and provider — at the inference level.The "Shadow AI" Problem — Employees signing up for AI tools on their own, with no governance, no visibility, no controls. Why fragmentation is a company-wide risk, not a per-team one.One Endpoint to Govern Them All — By becoming the sole endpoint for all inference, Actualyze can mask PII, catch secrets and passwords, apply guardrails, and allow or block MCP tool calls — enforcing policy in one place instead of trusting each provider.Why AI ROI Keeps Failing — Rafi's take: the hardest transformation isn't technical, it's cultural. Over-ambitious projects, unbudgeted bills, weak controls — and the trap of building a proprietary LLM you can't scale.Reliable vs. Impressive — What decades of Kubernetes, OpenStack, and large-scale distributed systems taught him about production reliability over demo magic.The Next Five Years — Why the over-rotation on frontier models will give way to small, open-weight, and purpose-built models — and why the real bottleneck is organizational readiness, not technology.Key Quote: "It really comes down to organizational readiness rather than technology readiness. A lot is ready today."Connect with Rafi: LinkedIn: https://www.linkedin.com/in/rkhardalian/ Actualyze AI: https://actualyze.ai/Follow and subscribe to AsembleAI: Spotify | Apple Podcasts | Amazon Music | iHeart Radio | YouTube | Substack