Episode 31: Building BYOC for Fortune 500: The Real Story of Enterprise AI Deployment
Daniel Chalef, founder and CEO of Zep AI, walks through the brutal technical reality of deploying AI products into Fortune 500 environments — zero-trust architectures, Service Control Policies, no-egress VPCs, and broken image supply chains. He explains why pure SaaS AI products can't meet enterprise security bars and how Bring Your Own Cloud (BYOC) deployments actually get shipped into locked-down customer infrastructure.
Special Guests
Daniel Chalef
Founder & CEO of Zep AI, building the Context Lake memory layer for AI agents.
Timestamps
00:00Introduction: Welcome & Speaker Background00:40The Wake-Up Call: When Fortune 500 Knocks01:17Enterprise Reality Check: InfoSec Rules Everything01:38Why Now? The Exponential Curve of AI Intelligence02:51Raw Intelligence vs Applied Intelligence: The Memory Problem04:11Introducing Zep: The Context Lake for AI Agents05:21The Architecture Fork: Death by Terraform vs BYOC06:33Meeting 'The Bar' for Fortune 500 Deployment07:24Three Walls: No Egress, SCPs, Image Supply Chain08:23How We Actually Shipped: Primitives, Vendors, Sponsors11:04Final Architecture Walkthrough: Inside the Customer VPC12:39Three Key Takeaways for Enterprise AI DeploymentRelated Episodes
Episode 18: Deploying Agentic Applications: From Multi-Tenant to "SaaS Anywhere"
In today's session, we're unpacking one of the most critical questions for modern AI companies: How do you actually deploy agentic applications? Join us as we break down how agentic systems will be deployed at scale, what changes SaaS companies must prepare for, and what the future of agent-driven architectures looks like.
Episode 22: Taming AI Complexity with Head of Engineering at Anyscale
Jaikumar Ganesha (JK), Head of Engineering at Anyscale, breaks down modern AI infrastructure challenges and how Ray (the open-source compute framework) is powering production-grade AI at scale. Covers the 'AI complexity wall,' distributed training, and includes a live demo of building a multimodal AI app.
Episode 23: Revolutionizing AI SaaS: Control Plane Innovation and Modern Cloud Models with Anyscale
A conversation filmed at AWS offices in San Francisco about how Anyscale empowers teams to build, scale, and operate complex ML workflows. Covers control plane architecture, the evolution of SaaS, and advice for SaaS founders adapting to the agentic future.