Senior Data Engineer (Scala, Python, Java)

  • Location

    London, England

  • Sector:

    Data

  • Job type:

    Contract

  • Salary:

    £550.00 - £600.00 per day

  • Contact:

    James Jarvis

  • Contact email:

    james.jarvis@xcede.co.uk

  • Job ref:

    HQ00027478_1552559337

  • Published:

    4 months ago

  • Duration:

    6-12 Months

  • Expiry date:

    2019-05-13

  • Startdate:

    ASAP

  • Consultant:

    #

DATA ENGINEER / SCALA / PYTHON / JAVA / SPARK / AWS

Data Engineer
Rate: £550-600PD
Location: London
Duration: 6 Months

Working in a team of data engineers, evolving a Data Platform based on open-source and AWS components.

The platform is end-to-end data solution from ingesting data from internet-of-things sensors and other high-volume sources; validating and storing data; aggregating information, providing a platform to run data-science algorithms; and delivering information back to products; third parties and other systems. Also working on the data lake for business and partnerships with the aim of democratising data within the business.

What will you be up to:

- Writing production quality code including extensive test coverage.
- Designing data systems that will scale to large numbers of users.
- Interfacing with Data Scientists and porting machine learning algorithms to production systems.
- Peer review other engineer's code to ensure quality.
- Deploy services to staging and production environments.

You will have/be:

- Excellent knowledge of Scala or Python or Java and concurrent programming
- Quick learner with eagerness to learn new things and experiment with new technologies
- Basic Mathematical ability to understand linear algebra
- Willing to learn Data Science algorithms and produce code to implement them at scale
- Willing to learn and work on the following technologies:
- AWS
- Spark
- Kafka
- Cassandra
- Kubernetes
- Familiarity with deployment & container technologies including Jenkins, Docker etc
Interest in Real time and distributed systems