Python Data Engineer – Build Scalable Data Pipelines

About the role

As a Python Data Engineer at Innefu Labs, you will design, build, and maintain scalable data pipelines that power AI-driven analytics and cybersecurity solutions. You will collaborate with data scientists, software developers, and product teams to deliver reliable data processing across structured and unstructured sources.

Key responsibilities

• Design, develop, and maintain robust ETL workflows and data pipelines.
• Build and optimise large‑scale data processing systems for both structured and unstructured data.
• Work extensively with Elasticsearch and data indexing solutions.
• Collaborate with cross‑functional teams to define data requirements and implement scalable solutions.
• Develop data integration frameworks and automation processes.
• Ensure high data quality, integrity, and reliability across systems.
• Monitor, troubleshoot, and optimise pipeline performance and scalability.
• Implement best practices for coding standards, testing, and deployment.
• Mentor junior team members and provide technical guidance.
• Stay updated on emerging data engineering technologies and trends.

Required profile

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering or a related role.
• Strong programming experience in Python, focusing on core Python.
• Hands‑on experience with ETL frameworks and data pipeline development.
• Strong experience with Elasticsearch and large‑scale data handling.
• Knowledge of databases, data warehousing concepts, and distributed systems.
• Familiarity with Django or Flask is a plus.
• Excellent analytical, problem‑solving, communication, and collaboration skills.

Required skills

• Python
• Elasticsearch
• ETL frameworks
• Data pipeline development
• Databases
• Data warehousing
• Distributed systems
• Django (optional)
• Flask (optional)
• Big data technologies
• Cloud platforms