Data Engineer - Python, PySpark, ETL/ELT

About the role

Quest Global is seeking a Data Engineer to design and develop cloud‑native backend microservices that ingest and process healthcare and imaging data. You will work with medical systems, hospital information systems, and imaging standards to enable reliable data pipelines.

Key responsibilities

• Design and develop cloud‑native microservices for collecting data from medical, hospital, radiology, and PACS systems.
• Build ingestion pipelines for DICOM, HL7, and other healthcare data formats.
• Extend data‑collection frameworks to support new sources and cloud‑based workflows.
• Implement fault‑tolerant data‑transport services with retry, error‑handling, monitoring, and dead‑letter mechanisms.
• Package and deploy services using containers and Kubernetes.
• Contribute to automated build, testing, deployment, and CI/CD processes.
• Collaborate with data engineers to ensure schema, integrity, and quality standards.
• Ensure compliance with cybersecurity, data‑privacy, and healthcare regulatory requirements.
• Develop unit, integration, and end‑to‑end tests and maintain clear API and deployment documentation.

Required profile

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
• 5–10 years of experience in backend or cloud software development.
• Proven experience designing REST APIs and microservice architectures.

Required skills

• Python for backend development.
• PySpark for large‑scale data processing.
• Microservices and REST API design.
• Data modelling and schema integration.
• Kubernetes and containerization (Docker).
• CI/CD pipelines and automated testing.
• Knowledge of DICOM and HL7 healthcare data formats.