Senior Data Engineer

About the role

As a Senior Data Engineer at NationsBenefits you will lead the design, development, and implementation of orchestrated data pipeline solutions that support data‑driven initiatives across the organization. You will work closely with data scientists, business analysts, and stakeholders to ensure data accuracy, reliability, and timely delivery. The role emphasizes automation, performance optimization, and continuous improvement of data workflows.

Key responsibilities

• Design, build, and maintain robust data pipelines using DBT, Airflow, Azure Databricks, PySpark, SQL, and Python.
• Continuously monitor, debug, and optimize existing pipelines, including resolving DAG failures.
• Implement data validation, cleansing, and quality checks to guarantee accurate and consistent data.
• Collaborate with cross‑functional teams to understand data requirements and deliver scalable solutions.
• Automate data processing workflows and integrate CI/CD practices.
• Perform ad‑hoc data analysis, develop visualizations, and generate actionable insights for business decision‑making.

Required profile

• Bachelor’s degree in Computer Science, IT, or a related field.
• Minimum 3+ years of hands‑on experience with DBT, Airflow, Azure Databricks, PySpark, SQL, Python, and automation.
• Strong debugging skills and experience with data warehouse / data lake concepts.
• Familiarity with cloud platforms such as Azure, AWS, or GCP.
• Excellent communication, presentation, and problem‑solving abilities.

Required skills

• DBT
• Airflow
• Azure Databricks
• Python
• PySpark
• SQL
• Automation tools
• Reporting tools (SQL‑based dashboards)
• Cloud platforms (Azure, AWS, GCP)