Senior Data Engineer
taskus · Chennai
Job description
About the role
TaskUs, a global provider of outsourced digital services and customer experience, is hiring a Senior Data Engineer. You will build resilient, self-healing data systems that turn raw data into high-fidelity data products, taking the architect's blueprints and turning them into production-grade code. The work mode is remote.
Key responsibilities
- Build and maintain high-throughput ETL/ELT pipelines that feed data into the Lakehouse
- Promote dbt for transformation and PySpark for heavy lifting, with modular, reusable code following strict CI/CD practices
- Implement Data SLAs and monitoring and alerting for data drift and pipeline failures
- Prepare feature-ready datasets with the BI team and Data Scientists
- Optimize SQL and Spark query plans to reduce cost and latency
- Enable local development of complex SQL transformations with DuckDB and build micro-pipelines on single-node containers (Lambda or small ECS tasks)
- Explore using DuckDB as an embedded engine for internal tools and edge processing at local sites
Required profile
- 5+ years in data engineering, including on-call experience
- Expert Python, SQL and PySpark
- Hands-on Databricks (Delta Lake) or Snowflake, with Medallion architecture
- Advanced dbt, including version control, testing and documentation
- Apache Airflow or Prefect for complex, idempotent DAGs; Kafka, Kinesis or Spark Streaming is a big plus
- Terraform or CloudFormation, and Kubernetes (Pods, Deployments, Services, ConfigMaps, Secrets)
- Proven DuckDB use for local development, unit testing and querying up to 100 GB datasets, including Parquet/Iceberg files in S3 or Azure Blob
What we offer
- Competitive industry salaries and comprehensive benefits packages
- Internal mobility and professional growth opportunities
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in India.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 1 hour ago
Expires 1 month from now
6 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
taskus
Chennai
Related job offers
-
IT Applications Analyst - Oracle Fusion Technical Finance
taskus Chennai -
IT Director, Applications (Workday & HR Automation)
taskus Chennai -
Python Software Engineer
Glencore Chennai -
Software Engineer - Backend Distributed Systems
salesforce -
Mainframe Software Development and Quality Engineer
hcmportal IN - TDC 1 (IN110)