Data Engineer
Location: Remote
Contract: 6 months initially
Overview
Our client is an innovative technology business transforming how large-scale energy and IoT data is collected, processed and utilised. As the organisation continues to invest in its data platform and analytics capability, they are seeking an experienced Data Engineer to join a growing engineering team.
This is an exciting opportunity to work with modern cloud technologies, designing and maintaining highly scalable data solutions that enable data-driven decision making across the organisation. You'll work with large volumes of structured and unstructured data, building robust pipelines, optimising database performance and delivering scalable cloud-based architectures that support advanced analytics and machine learning initiatives.
The successful candidate will enjoy solving complex technical challenges, thrive in a collaborative environment and be passionate about building high-quality data platforms that drive real business value.
Key Responsibilities
- Design, build and maintain scalable data pipelines supporting business intelligence, analytics and operational reporting.
- Develop and optimise cloud-based data architectures using AWS technologies including S3, Glue, Athena, Redshift and Kinesis.
- Manage, monitor and optimise database environments to maximise performance, reliability and scalability.
- Design solutions for ingesting data from multiple sources including APIs, IoT devices, streaming platforms and traditional databases.
- Build and maintain ETL processes to ensure high-quality, reliable and accessible data across the organisation.
- Analyse database performance bottlenecks and implement improvements to maximise efficiency.
- Work with both structured and unstructured datasets, supporting advanced analytics and machine learning use cases.
- Collaborate closely with software engineers, product teams and data scientists to deliver innovative data solutions.
- Improve storage formats and query performance through optimisation techniques and modern data engineering practices.
- Support the ongoing evolution of the organisation's cloud-based analytics platform and data infrastructure.
- Ensure data quality, governance and best practices are embedded across the engineering lifecycle.
Required Experience
- Proven experience designing and developing modern data engineering solutions.
- Strong hands-on experience with Python, SQL and Linux/Unix environments.
- Experience working with relational and NoSQL database technologies.
- Strong understanding of AWS data services including S3, Glue, Athena, Redshift, Kinesis and related cloud-native technologies.
- Experience building scalable ETL pipelines and processing large volumes of data.
- Knowledge of distributed data architectures and big data platforms.
- Experience optimising database performance, storage formats and query efficiency.
- Excellent understanding of networking fundamentals and distributed systems.
- Strong communication skills with the ability to work effectively with both technical and non-technical stakeholders.
Desirable Experience
- Experience with ClickHouse, Apache Druid or other real-time analytics platforms.
- Knowledge of DynamoDB, MySQL or other large-scale database technologies.
- Exposure to machine learning frameworks such as PyTorch, Keras or scikit-learn.
- Experience supporting analytics or SaaS platforms operating at scale.
- Exposure to energy, utilities, IoT or time-series data environments.
- Experience developing data visualisation solutions and interactive dashboards.
- Degree in Computer Science, Software Engineering, Information Technology or a related discipline.
Skills & Competencies
- Strong analytical and problem-solving abilities.
- Passion for building scalable, high-performance data solutions.
- Excellent attention to detail and commitment to data quality.
- Collaborative team player with strong stakeholder engagement skills.
- Self-motivated with the ability to work independently in a fast-paced environment.
- Strong communication skills with the ability to explain complex technical concepts clearly.
- Agile mindset with a continuous improvement approach.
- Curious, proactive and eager to learn new technologies.
What's on Offer
- Opportunity to work with modern cloud and big data technologies.
- Exposure to cutting-edge AWS data engineering and analytics platforms.
- Collaborative engineering culture focused on innovation and continuous improvement.
- Flexible hybrid working arrangements.
- Opportunity to work on large-scale data platforms supporting advanced analytics and machine learning.
- Competitive salary and benefits package.
- Excellent opportunities for professional development and career progression within a growing technology organisation.
About Korn Ferry
Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit Korn Ferry at www.Kornferry.com
