Senior Data Engineer - AWS

Senior Data Engineer

£75,000 to £90,000

Flexible working - Ideally 2 day a month London

My Client is a market leader in the retail and e-commerce space who invest in innovation, delivering unparalleled shopping experiences to millions of customers in several formats. They are looking for a experienced Senior Data Engineer to join their growing team and help drive their scalable Data management systems.

You should come with a proven track record in managing large-scale data infrastructures and pipelines that support sophisticated analytics. The ideal candidate will be responsible for designing, building, and maintaining robust data solutions that drive strategic decision-making across multiple business units. This role is for someone who principally still loves to code, but who also feels comfortable engaging with stakeholders and mentoring others.

Key Responsibilities:

• Design and implement scalable data architectures using modern cloud platforms. Our client have a strong preference for Snowflake experience, but are open to those from a GCP / AWS / Azure background more generally.
• Develop high-performance ETL/ELT processes for batch and (ideally) real-time data integration.
• Ensure optimal extraction, transformation, loading (ETL) processes by implementing quality checks and balances.
• Collaborate with cross-functional teams including data scientists, analysts, and stakeholders to understand their data needs.
• Support machine learning model deployments by ensuring seamless access to quality datasets.
• Troubleshoot complex issues arising from extensive big-data environments.
• Maintain comprehensive documentation of systems architecture and workflows.

What you need to succeed:

• Ideally, a Bachelor's degree in Computer Science or related field; Master's preferred.
• Several years of demonstrated commercial experience as a Data Engineer or similar role within large-scale environments dealing with large data sets.
• Expertise in SQL & dbt and ideally Kafka
• Significant Python coding skills
• Containerisation experience (Dockers, Kubernetes)
• Cloud Computing experience ( AWS / Azure )
• Strong preference for a Snowflake background but open to Bigquery or Redshift

Unfortunately sponsorship cannot be provided for this role