Senior Data Engineer (Hybrid, Gurugram)

About the role

Mechademy is seeking a Senior Data Engineer to design, build and scale mission-critical data systems that power enterprise AI solutions for monitoring and diagnosing high-value industrial assets. The role focuses on reliable data platforms, pipelines and models that enable predictive maintenance and analytics.

Key responsibilities

• Design, develop and maintain scalable batch ETL/ELT and CDC pipelines.
• Ingest data from client systems into the data platform with idempotent, incremental and back‑fill‑safe processes.
• Transform raw data into trusted analytical and machine‑learning‑ready datasets.
• Optimize Spark/PySpark and SQL workloads for large‑scale processing.
• Implement data quality checks, lineage, monitoring and alerting mechanisms.
• Support feature pipelines for machine‑learning and analytics platforms.
• Optimize storage formats, partitioning strategies and query performance.
• Collaborate with ML, product and engineering teams to deliver reliable data solutions.
• Promote best practices for scalability, reliability and maintainability across the data stack.

Required profile

• 4–7 years of hands‑on experience building production‑grade data pipelines.
• Bachelor’s degree in Computer Science, Engineering, Mathematics or a related field.
• Strong focus on data quality, observability, validation and monitoring.

Required skills

• SQL (query optimization and complex transformations)
• Python programming for data engineering workloads
• Spark / PySpark or equivalent distributed processing frameworks
• Data modeling, ETL/ELT, CDC, incremental processing and partitioning
• Workflow orchestration tools such as Dagster, Airflow or Prefect
• Cloud platforms: AWS or Azure