Data Engineer - Azure Pipelines and ETL

About the role

Chevron's Engineering and Innovation Excellence Center (ENGINE) in Bengaluru brings together the resources and expertise of the Chevron global network with talent in India to enhance agility and technological innovation for energy challenges. It is looking for a Data Engineer to design, build and maintain data pipelines and ETL processes in the Microsoft Azure environment.

Key responsibilities

• Design, develop and maintain data pipelines and ETL processes using Microsoft Azure services such as Azure Data Factory, Azure Synapse, Azure Databricks and Azure Fabric.
• Use Azure data storage accounts (Azure Data Lake Storage Gen 2 and Azure Blob storage) to organize and maintain pipeline outputs.
• Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Optimize data pipelines for performance, scalability and reliability, and ensure data quality and integrity through validation techniques and frameworks.
• Develop and maintain documentation of data processes, configurations and best practices, and manage the CI/CD process for deployment.
• Monitor and troubleshoot pipeline issues and stay current with industry trends and emerging technologies.

Required profile

• Bachelor's degree in Computer Science, Engineering or a related field (or equivalent experience).
• 5-7 years of experience demonstrating high proficiency in programming fundamentals.
• At least 2-8 years of proven experience as a Data Engineer or similar role dealing with data and ETL processes.
• Strong knowledge of Microsoft Azure services, including Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage and Azure Data Lake Gen 2.
• Experience with big data technologies such as Spark.
• Standard work week Monday to Friday; working hours 8:00am to 5:00pm or 1:30pm to 10:30pm, aligned to business requirements.

Required skills

• SQL DML queries against modern RDBMS such as SQL Server and PostgreSQL.
• Software engineering principles applied to data engineering (CI/CD, version control, testing).
• Preferred: Python, PySpark, Parquet, Delta, Avro, API endpoints as data sources, Azure DevOps pipelines, Git workflows, Ansible, and understanding of Azure subscriptions and resource groups.

What we offer

• Opportunity to take part in world-leading energy projects and advance professionally in an inclusive workplace.
• Structured learning, mentorship and growth through impactful projects.
• Comprehensive benefits supporting health, well-being and work-life balance.

Chevron does not sponsor employment visas or consider candidates on time-limited visa status for this position.