City of London, London
£70000.00 - £110000.00 per annum + Remote
2 months ago
As a Senior Data Engineer in the Data Engineering team, you will support the on-going technical delivery of the streaming service and play a key role in mentoring junior engineers in delivering reliable, timely, and consumable data for operational use and downstream analytics housed within the Data Warehouse.
In your varied role (not just part of a production line), you will work with high quality data across multiple sources and platforms and gain broad knowledge of cloud-based database design principles, and the system development life cycle and hoping you can influence the architecture.
What do you need?
Expertise in Python or if you are a polygot developer that is interesting too!
Strong experience using AWS (IaC) we also have platforms on GCP so don't be shy!
Strong knowledge of API technologies
Understanding Cloud architecture design patterns - real time, batch workflows and data modelling
Experience with any Cloud Datawarehouse (e.g Redshift/Snowflake) and SQL
A Team Player - approachable and flexible
Data streaming experience e.g Kafka
Comfortable in designing efficient and robust ETL batch workflows
Microservices - Docker/Kubernetes
Experience of database design and best practices
Understanding of Machine Learning
This is a great opportunity to build innovative products from scratch by using the latest Big Data Tools.
Be responsible for developing and maintaining the Data Platform.
Continuous performance improvement of the whole data pipeline and technology stack.
Engaging in design sessions to build new data products for the platform.
If this sounds like the perfect next challenge for you then we would love to hear from you, just email on the details and submit your application!