Principal Data Engineer

About the role

Atlassian is looking for a Principal Data Engineer to join its Data Engineering team in Bengaluru, India, in a tech lead and architect role. The person builds data solutions and applications that power key business decisions, enables a world-class engineering practice, drives the approach to using data, develops backend systems and data models, and plays an active part in building Atlassian's data-driven culture.

Key responsibilities

• Own the technical evolution of data engineering capabilities and make sure solutions are delivered incrementally, meet outcomes and risks are escalated promptly
• Coordinate the technical aspects of work across data engineering and improve productivity across teams
• Maintain a high bar for data quality and address performance, scale, complexity and security proactively
• Set technical direction, balance customer and business needs with long-term maintainability and scale, and architect solutions
• Lead a team of data engineers through mentoring and coaching, work closely with the engineering manager and give consistent feedback
• Work with counterparts in other departments as part of a multi-functional team

Required profile

• 12+ years of experience as a Data Engineer individual contributor
• At least 2 years as a tech lead for a Data Engineering team
• Track record of delivering large, complex, multi-person or multi-team efforts
• Great communicator with strong cross-team and cross-functional relationships

Required skills

• Streaming pipelines with a microservices architecture for low-latency analytics
• Data infrastructure such as relational databases (SQL), Spark and column stores (e.g. Redshift)
• Scalable data pipelines with Spark and Airflow or similar schedulers
• AWS data services (Redshift, Athena, EMR) or Apache projects (Spark, Flink, Hive, Kafka)
• Preferred: Kappa or Lambda architectures, MDM implementations, Databricks pipelines and APIs

The role is listed as remote; Atlassian hires in countries where it has a legal entity and employees can choose to work from an office, from home or a mix. Benefits, bonuses, commissions and equity may be available.