£50000.00 - £90000.00 per annum
3 months ago
Looking for an Azure Data Engineer, to join a Start-Up working on a financial risk product. This solution will create a risk and control data standard library for front office/back office client files such as Cash equities, FX, Algo trading (from various investment banks) with complete data analysis for risk identification, monitoring, and reporting dashboards. There is room for someone to influence architecture & have an influence on the growth of the business.
What will you be doing?
· Developing pipelines to process client risk and control files from the BLOB storage (in various formats such as Excel, JSON, CSV, Flat File) using Python/PySpark and deploy as micro-services.
· Cleansing, transforming, networking (through NLP engine), and analyze for KPI reporting Develop Spark ETL (using Python/PySpark) and deploy in the Azure platform (using Databricks for development and data orchestration for the pipeline).
What technology will you work with?
· Azure, Gen 2, Blob, Databricks, Azure Kubernetes
· Python, Scala, PySpark & API'S
· Spark, CI/CD
Please send your application via the advert or alternatively send your CV to firstname.lastname@example.org.