Data Engineer – IBM DataStage (5-7 yrs)

About the role

Capco is seeking a Data Engineer with 5‑7 years of hands‑on experience in IBM DataStage, strong SQL skills in Teradata, and solid Python programming abilities. The role is part of the Marketing Data Warehouse Tribe, responsible for designing, developing, and optimizing data integration pipelines for the BNP Paribas group.

Key responsibilities

• Design, build and maintain ETL pipelines in IBM DataStage to ingest, transform and load data from relational sources and flat files into the enterprise data warehouse.
• Implement dimensional modelling concepts such as star/snowflake schemas, slowly‑changing dimensions, and other data‑warehousing techniques.
• Develop Python and Shell scripts to automate routine tasks and support data‑quality checks.
• Set up CI/CD pipelines using GitLab to automate testing, versioning and deployment across dev, test and prod environments.
• Collaborate with data architects, business analysts and cross‑functional teams to translate functional requirements into technical specifications.
• Provide production support, perform root‑cause analysis of incidents and apply preventive measures.

Required profile

• 5‑7 years of experience creating data‑warehousing solutions with IBM DataStage.
• Strong SQL programming experience, preferably with Teradata.
• Proficient in Python (OOP, exception handling, clean‑code practices).
• Hands‑on experience with CI/CD tools such as GitLab, Jenkins and Ansible.
• Familiarity with scheduling tools like Autosys.
• Experience working in Agile environments.
• Excellent written and verbal communication skills.
• Bachelor’s degree in IT, Computer Science or a related field.

Required skills

• IBM DataStage
• SQL (Teradata)
• Python
• GitLab
• Jenkins
• Ansible
• Autosys (or similar scheduler)
• ALM/QC, JIRA, Confluence, SharePoint