The Data Engineering Manager is part of the Data Engineering Leadership team within the larger R&D organization overseeing the new development of or the enhancement of data pipelines. The successful candidate will lead a team of four to eight data engineers.
The Data Engineering team is a core to the success of Integral Ad Science. Over the next few years we will migrate the data platform to the cloud (AWS), move key data pipelines to streaming and modernizing some existing batch pipelines to latest batch processing technologies.
The Data Engineering Manager will be integral in driving this transformation by providing technical guidance to the team and through providing the resources the team requires to succeed.
What you’ll do:
- Plan and deliver data engineering projects
- Collaborate with various IAS teams throughout the full software development lifecycle including CI/CD, Product, Architecture
- Manage performance of the team including recurring 1:1s, performance reviews, goal setting and professional development
- Identify roadblocks and remove them proactively
- Implement effective metrics and monitoring processes
- Driving a culture of continuous improvement
- Stay informed about new technologies and trends in data engineering
You should apply if you have most of this:
- B.S. or B.A. in computer science or a related field
- Proficiency in at least one object oriented language (Java, Python or Scala preferred)
- Proficiency in SQL and comfortable working with large datasets to identify insights
- Experience with open source big data technologies (HDFS, Hive, Presto, Pig, MapReduce), Apache Spark is a plus
- Experience designing, developing and deploying data pipelines
- Strong problem solving skills
- Experience managing and mentoring a small team of data engineers
- Experience with AWS ecosystem
- Strong communication skills
