Elasticsearch Data Engineer (Medallion Architecture)
capgemini-insurance · Hyderabad
Job description
About the role
A client of Capgemini, one of the United States' largest insurers serving more than 10 million households, is hiring a remote Elasticsearch Data Engineer. The engineer will architect, develop and maintain scalable data pipelines in a medallion architecture (bronze, silver/base vault, business vault, gold layers) to deliver high-quality, business-ready datasets.
Key responsibilities
- Design, build and manage end-to-end data pipelines across the medallion architecture, including the bronze, silver (base vault with DBT and orchestration tools) and gold layers.
- Ingest and process raw data using Spark and Amazon EMR for scalable, distributed computation.
- Develop and automate data transformations for the base vault using DBT to standardise and model data efficiently.
Required profile
- At least 5 years of experience as an Elasticsearch Data Engineer on the ELK stack (Elasticsearch, Logstash, Kibana).
- BS in Computer Science, Data Engineering (Big Data, AWS certification), Data Modeling or similar.
- Full English fluency.
Required skills
- Elasticsearch: cluster optimisation, query development, data modelling, performance tuning and administration (4-6 years).
- Spark, Python, ETLs and Amazon EMR (deep experience).
- DBT for data transformation and modelling.
- Apache Airflow, AWS Step Functions or similar.
- Amazon S3 and Apache Iceberg.
- Kubernetes, AWS Lambda, IAM, SNS, API Gateway, VPC, Transit Gateway (intermediate, 3-4 years).
- Jenkins, CloudWatch and JSON (intermediate, 4-6 years).
- Dremio, Looker or equivalent semantic layer tools.
What we offer
- Competitive salary and performance-based bonuses.
- Comprehensive benefits package, private health insurance and pension plan.
- Career development and training opportunities.
- Flexible work arrangements (remote and/or office-based).
- Paid time off.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 21 hours ago
Expires 1 month from now
11 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
capgemini-insurance
Hyderabad
Related job offers
-
NGI Integration Specialist (Azure)
SGS Hyderabad -
Regional Network & Firewall Manager (EEME)
SGS Hyderabad -
Senior Workday Analyst (HCM, Compensation, Security)
Mattel Hyderabad -
Lead Analyst - Qualtrics CX
dentsuaegis IND-DGS Office-Thane-Ashar IT Park -
Senior Manager - Business Intelligence
dentsuaegis IND-DGS Office-Chennai-Tyche Towers