Our DACH 2025/26 Salary Guide is live - download here
arrow-leftBack to the previous page

Senior Data Engineer (Distributed Data Processing)

Location:
Remote work, England
Salary:
Remote - UK (O/IR35) & NL, BE, GER (B2B)
Job Type:
ContractRemote
Date Posted:
1 day ago
Expiry Date:
17/01/2026
Job Ref:
BH-124039-2
Start Date:
03/12/2025
Contact:
Sergio Osman
Contact Email:
sergio.osman@xcede.com
Specialism:
Software Engineering & ArchitectureData EngineeringEnglandGermanyUK Remote
Senior Data Engineer (Distributed Data Processing)
UK (O/IR35), Belgium, Netherlands or Germany (B2B)
Fully Remote

We’re looking for a Senior Data Engineer to join a data-intensive SaaS platform operating in a complex, regulated industry.
This is a hands-on senior IC role focused on distributed data processing, Spark-based pipelines, and Python-heavy engineering. You’ll be working on large-scale batch data workflows that power pricing, forecasting, and operational decision-making systems.
The role requires strong engineering judgement, the ability to operate autonomously, and the confidence to mentor others while delivering under tight timelines.
This is not an ML, Data Science, or GenAI role.

What You’ll Be Doing
•    Design, build, and evolve large-scale distributed data pipelines using Spark / PySpark.
•    Develop production-grade Python data workflows that implement complex business logic.
•    Work with Databricks for job execution, orchestration, and optimisation.
•    Own and optimise cloud-based data infrastructure (AWS preferred, Azure also relevant).
•    Optimise data workloads for performance, reliability, and cost.
•    Collaborate with engineers, domain specialists, and delivery teams on client-facing projects.
•    Take ownership of technical initiatives and lead by example within the team.
•    Support and mentor other engineers.

Must-Have Experience
•    Proven experience as a Senior Data Engineer.
•    Strong Python software engineering foundation.
•    Hands-on Spark experience in production (PySpark essential).
•    Real-world experience using Databricks for data pipelines (Spark depth matters most).
•    Experience with large-scale or parallel data processing.
•    Ownership of cloud infrastructure (AWS and/or Azure).
•    Comfortable operating with senior-level autonomy and responsibility.
•    Experience mentoring or supporting other engineers.

Nice-to-Have Experience
•    Experience working with time-series data.
•    Background in utilities, energy, or other data-heavy regulated industries.
•    Exposure to streaming technologies (Kafka, event-driven systems), though the role is primarily batch-focused.

APPLY FOR THIS JOB

For your job application, please fill in the form below.
SHARE THIS JOB
whatsappenvelopelinkedin
Sergio Osman

Sergio Osman

Specialisms: Data, Data Science, Digital & Product Analytics, Marketing & Insight Analytics, Data Engineering, Business Intelligence, Credit Risk & Analytics
whatsappenvelopelinkedin

Latest Jobs