Data Engineer - PySpark Developer
barclays · Bengaluru
Job description
About the role
Barclays is hiring a Data Engineer - PySpark Developer in Bengaluru to support the delivery of location strategy projects within agreed plans, budgets, quality and governance standards. The role involves designing, developing and delivering scalable data solutions, building robust data pipelines and supporting large-scale data transformation initiatives. It requires strong expertise in PySpark, AWS cloud technologies, data engineering practices and modern data platform architectures.
Key responsibilities
- Build and maintain data architectures and pipelines that transfer and process durable, complete and consistent data.
- Design and implement data warehouses and data lakes that handle the right data volumes and velocity while meeting security requirements.
- Develop processing and analysis algorithms suited to the data's complexity and volume.
- Collaborate with data scientists to build and deploy machine learning models.
- Work with business stakeholders, architects, product owners and engineering teams to deliver secure, reliable and performant data products.
Required profile
- Experience designing, developing and maintaining scalable data pipelines with PySpark.
- Ability to build and optimise ETL/ELT solutions for large-scale enterprise data processing.
- Delivers high-quality code following best practices, coding standards and automated testing.
- Strong communication skills, able to explain complex information and influence stakeholders.
Required skills
- PySpark and Python
- AWS services such as S3, Glue, EMR, Lambda, EC2, DynamoDB, IAM, CloudWatch and CloudTrail
- Databricks and/or Snowflake
- Airflow and Git-based source control
- Data lake, lakehouse and modern data platform architectures
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 10 hours ago
Expires 1 month from now
14 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
barclays
Bengaluru
Related job offers
-
Senior Site Reliability Engineer - Private Cloud
barclays Bengaluru -
Cloud Developer - Azure Automation (.NET)
Chevron Bengaluru -
Senior Software Engineer - Java/Angular
Publicis Groupe Holdings B.V. Bengaluru -
QA Engineer - Salesforce & Enterprise Applications
labcorp Bengaluru India -
Senior Analyst, Digital Analytics Implementation and Tagging
labcorp Bengaluru India