Sr. Engineering Manager, AI Platform

Leads backend engineering for the AI platform at Illumio, the zero trust segmentation company, working five days a week at its Sunnyvale headquarters. The senior engineering manager heads a team building highly scalable cloud services and AI-driven capabilities for Illumio's security products, and helps set the company's AI roadmap, including agentic workflows, LLM integrations, retrieval-augmented generation and the infrastructure behind them.

The role sets technical strategy for distributed systems, platform APIs and AI-enabled services, defines the architecture of large microservice and event-driven systems, and makes sure services stay highly available across AWS, Azure and GCP. It runs quarterly planning, staffing and architecture reviews, sets engineering standards for reliability, observability, scale and security, and mentors engineering managers and senior engineers. Close partnership with product, security, infrastructure and data science teams is central.

Illumio wants ten years building distributed backend systems, three years leading engineering teams and managers, strong Java, Go or Python, and deep experience with microservices, Kubernetes and Kafka-style event systems. A practical grasp of LLMs, agents, RAG, model serving and agent orchestration is required. Experience leading AI platform or ML infrastructure teams, vector databases, model evaluation and AI observability tools such as Langfuse, and security domain knowledge are a plus. The work involves export-controlled technology.