This job is no longer available
This job expired on 25/10/2026. It no longer accepts applications.
Senior Data Engineer – Azure Databricks & Python
Numerator · Vadodara
Job description
About the role
We are looking for a Senior Data Engineer to design, build and optimise high‑volume data pipelines that power market‑research insights. The role sits within Numerator’s data platform team and works closely with analysts and developers to deliver reliable, scalable solutions on Azure.
Key responsibilities
- Design and implement robust data pipelines using Python, Apache Spark, PySpark and Databricks on Azure.
- Adhere to Numerator’s coding standards and technology guidelines.
- Develop, maintain and enhance automated test suites in Azure DevOps, including manual, load and exploratory testing.
- Collaborate with Business Analysts and Senior Data Developers to meet sprint objectives and product delivery goals.
- Participate in sprint planning, story estimation and task breakdown.
- Support CI/CD processes and ensure smooth deployment of data solutions.
Required profile
- 7‑10 years of professional experience in data engineering.
- Strong Python programming skills.
- Hands‑on experience with Microsoft Azure cloud services.
- Proven track record using Apache Spark, PySpark and Databricks.
- Experience with Azure DevOps or similar CI/CD pipelines.
- Familiarity with Agile methodologies (Scrum/Kanban).
- Bachelor’s or master’s degree in Computer Science, Data Science or a related field.
Required skills
- Python
- Microsoft Azure
- Azure DevOps
- Apache Spark / PySpark
- Databricks
- CI/CD pipelines
- AI/ML techniques
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Numerator
Vadodara