Lead Data Engineer Job in London Arena

Lead Data Engineer Job in London Arena. Apply for the latest London Arena jobs in Accounting/Financial/Insurance.

Lead Data Engineer Job in London Arena

Job Description
Our client a fast paced payments fintech are combining the agility and flexibility of a high-growth company with the global ambitions and backing of an established brand.

As a Data Engineer you will build and enhance large-scale, real-time and batch data pipelines, processes and data management flows to enable the company to quickly develop fast, scalable and reliable solutions for their customers. Using big data and machine learning, their data platform will capture, normalize and make sense of volumes of real-time information.

Responsibilities
· Engineering new solutions to support core platform functionality.
· Write clean, efficient, thoroughly tested code supported by code reviews
· Develop scalable and highly-performing distributed systems
· Communicate and document solutions and design decisions
· Report on stability and performance of data systems to other technology groups and to management

You will have
· Strong and demonstrable experience in Python and SQL.
· Experience with big data tools like Hadoop, Spark, Kafka, etc…
· Experience with data transformations frameworks dbt, Spark core and Spark streaming
· Experience on designing and implementing CI/CD pipelines for data products.
· Experience with relational SQL and NoSQL databases like CosmosDB, Elasticsearch, etc…
· Preferable experience with Azure Cloud services: AKS, ADLS, Databricks

If this sounds like the role for you then please apply today!

Alternatively, you can refer a friend or colleague by taking part in our fantastic referral schemes! If you have a friend or colleague who would be interested in this role, please refer them to us. For each relevant candidate that you introduce to us (there is no limit) and we place, you will be entitled to our general gift/voucher scheme.

Datatech is one of the UK's leading recruitment agencies in the field of analytics and host of the critically acclaimed event, Women in Data. For more information, visit our website: (url removed)

We can only accept candidates who have the right to work in the UK

Job Type: Permanent, Full Time
Location: London Arena
Category: Accounting/Financial/Insurance
City:
County:
Country: United Kingdom
Salary:
Benefits: