Data Engineer III

About the role

The Data Engineer III will design, build, and maintain scalable data pipelines and platforms on AWS. You will work closely with data scientists, analysts, and BI teams to turn business requirements into reliable, governed data solutions.

Key responsibilities

• Design and implement ETL/ELT pipelines using AWS Glue, Lambda, Step Functions and orchestrate workflows with Glue Workflows or Step Functions.
• Manage structured and unstructured data in S3, Glue Catalog, DynamoDB, RDS/Aurora, and Redshift, ensuring proper partitioning, indexing and lifecycle policies.
• Integrate data from APIs, on‑prem databases and third‑party tools using AWS Glue, Kinesis or Kafka for both batch and real‑time streaming.
• Optimize query performance on Athena, Databricks and Spark, and choose efficient storage formats such as Parquet or ORC.
• Implement security controls, encryption, IAM roles and Lake Formation policies to meet GDPR and other governance standards.
• Monitor pipeline health with CloudWatch, CloudTrail and custom dashboards, setting up alerts for failures and anomalies.

Required profile

• 3+ years of professional data‑engineering or software‑engineering experience with a strong data focus.
• Proven ability to deliver production‑grade data pipelines across multiple domains.
• Experience working in Agile, cross‑functional teams with product, analytics and data‑science partners.
• Bachelor’s degree in Engineering/Computer Science or equivalent practical experience.

Required skills

• AWS services: S3, Glue, Redshift, Athena, EMR, Lambda, CloudFormation, Kinesis, DynamoDB, SQS, SNS, Lake Formation.
• Programming languages: Python, SQL, Scala.
• Big‑data tools: Apache Spark, Databricks, Hadoop, Kafka.
• DevOps: Git, CI/CD, Terraform, CloudFormation.
• Data‑security and governance practices, VPC, EC2, CloudWatch.

What we offer

• Comprehensive health insurance for you, immediate family and parents.
• Group life and accident insurance, flexible working arrangements.
• Employee assistance program, medical screening, parental and adoption support.
• Subsidized meals in Chennai, long‑service awards and various paid leave types.
• Well‑being initiatives, study assistance, sabbaticals and a supportive inclusive culture.