Levy Professionals
Senior Data Engineer (Python, Spark, Azure) | Short term project | Financial Services
We are looking for…
A Senior Data Engineer to join a high-performing data team responsible for building and maintaining a modular ETL framework used for financial reporting and risk systems.
You will work in a modern engineering environment using Python, Apache Spark, and Azure Databricks, contributing to scalable, well-tested, and production-grade data pipelines.
About the role
As a Senior Data Engineer, you will be responsible for extending and maintaining a modular ETL framework that ingests, transforms, and delivers financial data across multiple environments.
You will work across the full lifecycle – from schema design and transformation logic to testing and deployment – within a cloud-based ecosystem.
Responsibilities
- Build and maintain ETL pipelines using Python and Spark
- Apply data engineering best practices and ensure high-quality code standards
- Work with SQL and relational databases for data processing
- Integrate pipelines within Azure DevOps CI/CD workflows
- Support and interact with downstream reporting and risk systems
- Participate in architectural discussions and future improvements
- Ensure robust unit and integration testing
- Collaborate on orchestration using Apache Airflow or Azure Durable Functions (C#)
Experience
- 5+ years of experience in Python development within data engineering
- Strong experience with Apache Spark / PySpark (Databricks preferred)
- Solid understanding of ETL frameworks and data processing patterns
- Experience with SQL and relational databases
- Hands-on experience with CI/CD and Azure DevOps
About Levy Professionals
Since 2000 we provide professional solutions to organizations ranging from tech start-ups to global players. From our offices in Amsterdam and London we have built an international and local network of skilled employed professionals and contractors fuelled by our passion for connecting skills with projects. Over the years we have fulfilled over 1700 requirements and nowadays we consistently have 250+ professionals recruited and relocated from 14 countries allocated to various projects. Our strength is the way that we see and treat people. This will always be a key factor in our strategy for many years to come.
