Staff Data Engineer

About the role

Shift5 is building a data platform for onboard operational technology (OT) to deliver cybersecurity, predictive maintenance, and compliance capabilities for defense and commercial fleets. As a Staff Data Engineer you will design, build, and maintain scalable batch and streaming data pipelines while acting as a technical leader for the Product Engineering team.

Key responsibilities

• Design, develop, and operate robust data processing, storage, and integration pipelines using Apache Airflow, Benthos, and AWS services.
• Own end‑to‑end feature development from requirements gathering through design, implementation, testing, and deployment.
• Write clean, well‑documented, testable code and ensure pipeline observability, reliability, and cost‑effectiveness.
• Collaborate with data scientists, transportation engineers, and product managers to create semantic data models and data ontologies.
• Analyze complex data sets to verify data quality and integrity throughout the pipeline.
• Provide occasional field support, including travel to customer sites to assist with data integration and deployment.

Required profile

• Minimum 6 years of engineering experience building data pipelines and platforms.
• Proven ability to lead technical initiatives and mentor junior engineers.
• Strong problem‑solving skills and ability to work in a fast‑paced, multidisciplinary environment.

Required skills

• Apache Airflow
• Benthos
• AWS cloud services