Senior Data Engineer

About the role

We are seeking a Senior Data Engineer to contribute to the design and delivery of our cloud‑native healthcare data platform. You will implement scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines strong hands‑on engineering with collaboration across platform, analytics, and business teams.

Key responsibilities

• Deliver complex data engineering projects in collaboration with cross‑functional teams, from design through production deployment.
• Design and implement batch and near‑real‑time pipelines, reusable ingestion, transformation, validation, and publishing frameworks.
• Contribute to Apache Iceberg implementation, optimization, and metadata management, ensuring efficient storage and query performance.
• Implement data quality frameworks, observability, monitoring, and support operational excellence.
• Participate in architecture discussions, code reviews, and mentor junior engineers.
• Oversee ISMS documentation, risk assessments, and security continuity testing in coordination with the CISO.

Required profile

• 5+ years of data engineering experience with enterprise‑scale initiatives.
• Strong knowledge of AWS services (S3, Glue, Athena, Lake Formation) and security controls (IAM).
• Experience with Apache Iceberg (preferred) and other lake formats such as Delta Lake or Hudi.
• Ability to reliably commute to or relocate to Hyderabad, Telangana.

Required skills

• Python
• SQL
• PySpark / Spark
• AWS S3, Glue, Athena, Lake Formation, IAM
• Apache Iceberg
• Delta Lake or Hudi
• dbt
• Airflow or Step Functions