Episode 31: Building BYOC for Fortune 500: The Real Story of Enterprise AI Deployment
Daniel Chalef, founder and CEO of Zep AI, walks through the brutal technical reality of deploying AI products into Fortune 500 environments, zero-trust architectures, Service Control Policies, no-egress VPCs, and broken image supply chains. He explains why pure SaaS AI products can't meet enterprise security bars and how Bring Your Own Cloud (BYOC) deployments actually get shipped into locked-down customer infrastructure.
Special Guests
Daniel Chalef
Founder & CEO of Zep AI, building the Context Lake memory layer for AI agents.
Timestamps
00:00Introduction: Welcome & Speaker Background00:40The Wake-Up Call: When Fortune 500 Knocks01:17Enterprise Reality Check: InfoSec Rules Everything01:38Why Now? The Exponential Curve of AI Intelligence02:51Raw Intelligence vs Applied Intelligence: The Memory Problem04:11Introducing Zep: The Context Lake for AI Agents05:21The Architecture Fork: Death by Terraform vs BYOC06:33Meeting 'The Bar' for Fortune 500 Deployment07:24Three Walls: No Egress, SCPs, Image Supply Chain08:23How We Actually Shipped: Primitives, Vendors, Sponsors11:04Final Architecture Walkthrough: Inside the Customer VPC12:39Three Key Takeaways for Enterprise AI DeploymentRelated Episodes
Episode 37: EP 25: BYOC Anywhere
Paul Paliychuk of Zep AI and Omnistrate co-founder Alok Nikhil lay out ten principles for secure Bring Your Own Cloud deployment: keep the data plane in the customer's account, connect without exposing it, swap static credentials for short-lived identity, and make vendor access revocable by design. They walk through the four levels of BYOC, what changes inside air-gapped environments, and why AI products hit the enterprise security bar far earlier in their life than previous generations of SaaS did. The episode closes with a live demo that turns a Helm chart into a BYOC offering with a self-service customer portal.
Episode 18: Deploying Agentic Applications: From Multi-Tenant to "SaaS Anywhere"
In today's session, we're unpacking one of the most critical questions for modern AI companies: How do you actually deploy agentic applications? Join us as we break down how agentic systems will be deployed at scale, what changes SaaS companies must prepare for, and what the future of agent-driven architectures looks like.
Episode 22: Taming AI Complexity with Head of Engineering at Anyscale
Jaikumar Ganesha (JK), Head of Engineering at Anyscale, breaks down modern AI infrastructure challenges and how Ray (the open-source compute framework) is powering production-grade AI at scale. Covers the 'AI complexity wall,' distributed training, and includes a live demo of building a multimodal AI app.