About the Team
Our team is responsible for building and optimizing high-performance deterministic message passing pipelines that power critical components of autonomous systems. We focus on performance benchmarking, latency optimization, and distributed computing to ensure efficient message passing and data flow across the system. By leveraging advanced scheduling algorithms, and performance monitoring, we continuously improve the reliability, scalability, and efficiency of our processing framework. We develop a deterministic framefork that facilitates simulation using recorded data.
About the Role
We are looking for a Lead Software Engineer to drive the development and optimization of our high-performance message passing pipeline. In this role, you will design and implement schedulers to minimize latency, develop cost-effective measurement systems, and create data visualization tools for performance analysis. You will also play a key role in defining the team's technical vision, mentoring engineers, and negotiating compute resources. Your expertise in distributed systems, system programming, and performance optimization will directly contribute to the efficiency and scalability of our autonomous system's infrastructure.
What You'll Do
- Site Reliability Engineering:
- Monitor performance improvements and degradations, analyze releases.
- Troubleshooting performance issues.
- Optimize latency:
- Design and implement a scheduler that optimizes critical-path latency in the pipeline.
- Design, develop and support cost-effective measurement system for latency and resources consumption.
- Data processing and visualization:
- Design, develop and support data processing infrastructure for performance measurements. Leverage cloud computing tools, developed in our team.
- Develop and support visualization system for performance analysis.
- Design, develop and support framework for performance testing.
- Leadership, Teamwork, and Negotiation:
- Help define the team's technical vision and roadmap to continuously improve our message passing pipeline.
- Negotiate compute quotas with component owners.
- Mentor, guide and support team members, fostering a culture of high standards and continuous improvement.
What You'll Need
- Master's degree in Computer Science.
- Proficiency in C++ and Python.
- At least 8 years of professional experience in Software development/engineering or equivalent.
- At least 5 years of experience in data processing: Map-Reduce, Spark.
- At least 3 years of experience with system programming on Linux,
- At least 3 years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience.
- Experience in performance benchmarking, profiling (perf, NSys, heaptrack), and optimization.
- Experience with lock-free/wait-free data structures.
- Experience with ROS library.
- Experience with cloud infrastructure: AWS, terraform.
- Experience with visualization tools and data-bases: Clickhouse, Grafana, plotly.
- Strong understanding and working experience with distributed systems.
- Familiarity with well-known algorithms, proficiency with writing complex algorithmic logic.
- Familiarity with self-driving projects' architecture and principles: knowing principles of their work, deployment, data delivery, analytics processes; expertise in servicing and working with self-driving cars and robots.
- Experience as a mentor, tech lead or leading an engineering team.
Nice to Have
Candidates are required to be authorized to work in the U.S. The employer is not offering relocation sponsorship, and remote work options are not available.
