Engineering Manager, Data Streaming

Leads Data Streaming, a sub-team within Data Ingestion at Horizon3.ai, reporting to the Senior Manager of Data Ingestion. The team collects, normalises and routes the raw data behind NodeZero's autonomous penetration tests: every IP address, open port, credential, vulnerability finding and asset relationship the product discovers passes through its pipelines before it reaches the customer as a finding.

The manager owns engineering execution and team health, runs sprints and design reviews, and grows the group to six or seven engineers. The role sets and owns service levels for ingestion throughput, latency and error rates, builds on-call processes and runbooks, and keeps ingestion schemas stable, managing the data contracts that link the NodeZero runner and Security Research upstream with the Database Platform team downstream as new pentest features arrive. Scaling the pipelines for more customers, larger environments and new data types without matching growth in operating effort is a central goal, done in partnership with the Asset Inventory and Security Research teams.

Horizon3.ai wants someone who has led teams of five to eight engineers running production ingestion or ETL pipelines, with deep knowledge of streaming systems such as Kafka or Kinesis, normalisation and schema evolution at scale, and hands-on Go or Python. PostgreSQL, Kubernetes on AWS and data observability tooling are expected; exposure to scan data, vulnerability feeds or asset inventories is a plus. The role is fully remote with up to 5% travel.