AWS Data Engineer

  • Location

    England

  • Sector:

    Data

  • Job type:

    Contract

  • Salary:

    Up to £600 per day

  • Contact:

    James Jarvis

  • Contact email:

    james.jarvis@xcede.co.uk

  • Job ref:

    HQ00031141_1595941739

  • Duration:

    3-6 Months

  • Startdate:

    ASAP

AWS / KINESIS / PYTHON / GLUE / DATA PIPELINE / DATALAKE / DATAWAREHOUSING

AWS Data Engineer
Duration: 3 Months
Rate: £600PD
Start: ASAP

My client is building a new high volume, high value, transactional system that interacts with customers through multiple channels and touch-points, web, mobile, email, API. The system will process the transactions of multiple millions of customers, and also process their behavioural data. The platform is AWS and the delivery approach is agile.

They need an experienced data engineer to help design and implement the data platform components that will deliver insight to the business. You will need to be proficient with defining and writing data jobs that run on cloud technologies, and you will also be expected to contribute to the end to end design and implementation
Experience

*Minimum of 3 years commercial experience of working with cloud data pipelines and associated technologies in AWS environments

Essential

*Stream processing & data pipeline coding using Kinesis/Kinesis Firehose, Python and Glue
*Datalake and data warehousing
*Strong coverage of AWS services to include the majority of DynamoDB, Fargate, Aurora, S3, IAM, Lamda, SageMaker, Athena
*Use of code to provision AWS resources such as Terraform or CloudFormation

Desirable

*Practice of Agile/Scrum
*Messaging and queue technologies e.g. SNS
*Use of source control such as Git and CI/CD tools such as Drone or Circle CI
*Map Reduce and ETL
*Familiarity with Machine Learning
*Experience of working with NoSQL and Relational Databases such as MySQL or SQL Server
*Experience of using a micro-service architecture
*Understanding of how data is used to deliver insight across marketing recommendations, analytics & finance