TITLE: Senior Cloud Native Developer Location: New York, NY
Our financial services client is searching for a Senior Cloud Native Developer in New York City to help with their AWS migration. This is a hybrid role where the team is in the office 3 days per week.
What You'll Do:
Drive a high impact and high visibility project that enables data availability, encompasses data analytics, machine learning, and petabyte scale datasets, and provides reliable and timely access to thousands of data sources
Design, architect and support systems for collecting, storing, and analyzing data at scale
Recommend improvements and modifications on new and existing data and ETL pipelines. Create optimal data pipeline architecture and systems using Apache Airflow
Create data analytics for data scientists to innovate, build and optimize our ecosystem
Assemble large, complex data sets that meet functional and non-functional business requirements
Be responsible for ingesting data into our data lake and providing frameworks and services for operating on that data including the use of Spark
Analyze, debug and correct issues with data pipelines
Operate on or build solution required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, AWS and Spark technologies
Skills / Experience You Will Need:
8+ years of experience building high performance scalable enterprise analytics or data centric solutions
5+ years of experience in the design and build of data extraction, transformation, and loading processes by writing custom data pipelines
At least 5 years of experience implementing complex ETL pipelines preferably in connection with Glue and/or Spark
Exceptional coding and design skills in Python or Java/Scala
