Cloud Data Engineer - AWS
barclays · Pune
Job description
About the role
Barclays is looking for a Cloud Data Engineer in Pune to help shape and deliver its cloud-first data strategy. The role designs and builds scalable AWS data platforms, analytics capabilities and reusable data products, moving trusted data from golden-source systems into governed cloud data layers so it is available for analytics and downstream use.
Key responsibilities
- Design and build batch and event-driven data pipelines using AWS Glue, Step Functions, Lambda, Athena, S3 and EC2
- Ingest data from golden-source systems into governed cloud data layers using enterprise hydration frameworks
- Develop curated data models and reusable data products for analytics, reporting and downstream applications
- Implement data lake and data warehouse patterns, including partitioning, file formats, metadata and performance optimization
- Write transformation logic in SQL and Python or PySpark, with testing, reconciliation and error handling
- Set up workflow orchestration, scheduling, monitoring, alerting, restart and recovery for production pipelines
- Apply data quality, lineage, metadata, security, access control, retention and audit requirements throughout the data lifecycle
- Optimize cloud workloads for performance, reliability, scalability and cost
- Collaborate with data architects, platform engineers, source-system teams, analysts, product owners and governance stakeholders
- Follow engineering standards for source control, peer review, automated testing, CI/CD, documentation and operational support
- Investigate production issues, perform root-cause analysis and implement sustainable fixes
Required profile
- Relevant data engineering experience, including production-grade data pipelines and analytical data platforms
- Strong SQL skills and understanding of data warehousing, dimensional modelling, data lake concepts and ETL/ELT patterns
- Hands-on experience building cloud data solutions on AWS
- Ability to build curated data products, including transformation, validation, reconciliation and publication
- Knowledge of data quality, metadata, lineage, security, encryption, IAM, monitoring and audit controls
- Experience with Git-based source control, automated testing, CI/CD and deployment across dev, test and production
- Strong analytical, troubleshooting, documentation, stakeholder-management and communication skills
Required skills
- AWS Glue, Step Functions, Lambda, Athena, S3, EC2
- Python and/or PySpark
- Desirable: Databricks (Spark, Delta Lake, Unity Catalog), Apache Airflow or Astronomer, Redshift, EMR, Lake Formation, Kinesis, DynamoDB, CloudWatch, IAM, CloudFormation
- Desirable: Terraform, data mesh principles, data observability, AWS or Databricks certification, banking or financial services experience
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 8 hours ago
Expires 1 month from now
4 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
barclays
Pune