Data Engineer - GCP, SQL, BigQuery, Dataflow, Knowledge Graphs
hcmportal · In - Tdc 1 (In110)
Job description
About the role
UPS is looking for a Data Engineer with hands-on experience in the Google Cloud data ecosystem and a proven track record. You will design, build and maintain the data infrastructure and pipelines that feed the data warehouse and knowledge graphs, supporting data-driven initiatives across the organization.
Key responsibilities
- Design, build and optimize scalable data pipelines that ingest, transform and load data into the data warehouse and knowledge graphs.
- Implement and manage data solutions on Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Spanner, Dataproc) and Azure Cloud Services.
- Develop and maintain data models, ingest data and write efficient queries in Neo4j and/or Stardog to build and expand the enterprise knowledge graph.
- Apply data quality, validation and governance best practices to ensure accuracy, consistency and reliability.
- Monitor and optimize pipeline and query performance, resolving bottlenecks.
- Work with data scientists, analysts and other engineering teams to meet data requirements.
- Create and maintain documentation of pipelines, data models and knowledge graph schemas.
Required profile
- Bachelor's degree in computer science, engineering or a related quantitative field.
- 5+ years of professional experience as a Data Engineer or in a similar role.
- Strong hands-on experience with GCP data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage and Composer (Apache Airflow).
- Proficiency in Python for data manipulation and pipeline orchestration.
- Experience with SQL and data warehousing concepts, and familiarity with relational data modeling.
- Experience with version control systems such as Git.
Required skills
- Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Spanner, Dataproc)
- Azure Cloud Services
- Neo4j and/or Stardog
- Python
- SQL
- Terraform or another IaC tool (preferred)
- Streaming data technologies such as Kafka (preferred)
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 10 hours ago
Expires 1 month from now
7 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
hcmportal
In - Tdc 1 (In110)
Related job offers
-
Intermediate Applications Developer - Workday Security & Integration
hcmportal IN - TDC 1 (IN110) -
Senior Software Engineer - D365 Finance and Operations
hcmportal IN - TDC 1 (IN110) -
Senior Application Developer
hcmportal IN - TDC 1 (IN110) -
Senior Full Stack Engineer - Enterprise AI
gsk Bengaluru Luxor North Tower -
Full Stack Software Engineer (Data Pipelines)
Chevron Bengaluru