Responsibilities:
- Lead a team of 2-3 data engineers to deliver high-quality solutions.
- Design, develop, and maintain data pipelines and ETL processes.
- Collaborate with cross-functional teams to understand data requirements and deliver actionable insights.
- Architect and implement scalable data solutions on AWS cloud infrastructure.
- Ensure data quality, integrity, and security throughout all stages of data processing.
- Provide technical guidance and mentorship to team members.
- Stay updated on industry trends and best practices in data engineering.
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Proven experience as a data engineer, with expertise in Python and SQL.
- Strong understanding of AWS cloud services, such as S3, Redshift, Glue, EMR, etc.
- Experience leading a team of 2-3 people, with a focus on fostering collaboration and driving results.
- Solid understanding of commodities trading or related industries (nice to have).
- Excellent communication and problem-solving skills.
- Ability to thrive in a fast-paced, dynamic environment.
