Senior Real-Time Distributed Systems Engineer (AI Bidding Platform)

A large adtech company specializing in real-time bidding and programmatic advertising is looking for a Senior Distributed Systems Engineer. You will be working on the company’s real-time bidding and AI-driven ad optimization engine, which processes millions of ad auctions per second while applying live machine learning models for bid pricing, fraud detection, and audience targeting across global data centers with strict latency requirements under 50 milliseconds.

The environment is primarily Go and Java, with performance-critical components in C++. Systems run on Kubernetes across multiple AWS regions, with Kafka handling high-volume event streaming and Cassandra managing distributed storage. AI models are trained in Python using PyTorch and deployed as low-latency inference services integrated directly into the bidding pipeline. Must-have skills include deep experience designing and operating distributed systems at scale, strong understanding of concurrency, networking, and fault tolerance, and hands-on experience with streaming systems and distributed databases. Experience integrating real-time inference services into high-throughput systems is required. Solid understanding of consistency models, replication, partitioning strategies, and tail-latency optimization is essential. Pluses include experience with model serving frameworks, feature stores, GPU acceleration, and large-scale online learning systems.

You will design and optimize core services that handle extreme throughput while incorporating real-time AI scoring. You will reduce tail latency in inference paths, improve resiliency across distributed components, and troubleshoot cross-service failures in globally distributed environments. You will collaborate with ML engineers to ensure model deployment does not degrade performance and that inference pipelines remain stable under peak load. You will also drive architectural improvements that balance speed, accuracy, and infrastructure cost.

The company operates one of the largest independent real-time advertising exchanges in the market, where milliseconds and model accuracy directly impact revenue. Engineers here solve technically complex problems at the intersection of distributed systems and applied AI. The team values deep systems thinking, measurable performance impact, and ownership of production-scale infrastructure.