8,090 Lead Data Engineer jobs in the United Kingdom

Role Title: Lead Data Engineer
Location: Glasgow
Duration: 31/12/2026
Work Setup: 2-3 days onsite
Rate: 400 per day - PAYE via Umbrella Only

Role Description:
Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead one our teams, setting standards, reviewing code, and reviewing what our colleagues build.

Purpose of the role
To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Accountabilities

• Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
• Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
• Development of processing and analysis algorithms fit for the intended data complexity and volumes.
• Collaboration with data scientist to build and deploy machine learning models.

Expectations

• To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures.
• If managing a team, they define jobs and responsibilities, planning for the department's future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements.
• If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L - Listen and be authentic, E - Energise and inspire, A - Align across the enterprise, D - Develop others.
• OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions.
• Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
• Manage and mitigate risks through assessment, in support of the control and governance agenda.
• Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
• Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
• Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
• Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
• Adopt and include the outcomes of extensive research in problem solving processes.
• Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

Job Title: Lead Data Engineer

Role Type: Permanent

Location: Birmingham (Hybrid)

Role Overview

As a Lead Data Engineer, you will be responsible for maintaining data infrastructure on Microsoft Azure and leveraging your expertise in Microsoft BI tools and cloud-based technologies to drive their data initiatives. You will play a critical role in the team optimising data infrastructure.

Key Responsibilities

• Collaborate with cross-functional teams to achieve common business goals.

• Develop and maintain curated business models to support accurate and insightful decision-making.

• Utilise SSRS, SSAS, and SSIS to design, develop, and implement robust reporting and analytics solutions.

• Conduct complex data analysis to identify trends, patterns, and insights that drive business improvement.

• Demonstrate expertise in Azure Synapse and Azure Data Factory/Lakes for data integration, orchestration, and management.

• Implement and optimise data pipelines for seamless and efficient data flow within the Azure ecosystem.

• Extract data from Dynamics to build and enhance curated business models in Synapse/PowerBI.

• Ensure data security, compliance, and best practices are followed in Azure cloud environments.

• Build migration paths to transition from on-premises technologies to the cloud where appropriate.

Essential Skills

• Proven experience as a Lead/Senior Data Engineer.

• Expertise in the Microsoft BI stack, including SSRS, SSAS, and SSIS.

• Hands-on experience with Azure Synapse, Azure Data Factory, and other Azure cloud services.

• Strong analytical and problem-solving skills, with the ability to turn complex data into actionable insights.

• Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams.

• Demonstrated ability to design and implement curated business models for reporting and analysis.

If you are a skilled Lead/Senior Data Engineer, we would like to hear from you. Apply now!

Location: Warwick (Hybrid - once per week onsite)
Remuneration: From 700 per day (via umbrella company)
Contract Details: Fixed Term Contract, 6 months, Full Time

Are you ready to take the lead in transforming data engineering? Our client, a forward-thinking organisation, is seeking a highly skilled and hands-on Lead Data Engineer to drive their Data & Insights platform built on the Azure stack. This is a Databricks-heavy role , ideal for someone who thrives in technical environments and enjoys working directly with cutting-edge tools.

This is not just a leadership role - it's a hands-on engineering opportunity where your Databricks expertise will be front and centre . You'll be the go-to person for all things Databricks, from architecture and configuration to pipeline promotion and troubleshooting.

• Lead and deliver hands-on data engineering across all layers of the Azure-based data platform.
• Act as the Databricks SME (Subject Matter Expert) , overseeing architecture, configuration, and documentation.
• Guide and support the engineering team while contributing directly to development efforts.
• Manage DevOps practices including branch supervision and merging.
• Promote data pipelines and notebooks through development, testing, and production environments.
• Enhance monitoring and control frameworks to ensure platform reliability.
• Provide technical leadership and mentorship to a small team of Data Engineers.

• Extensive hands-on experience with Databricks - this is the core of the role.
• Strong background in Synapse and Azure DevOps.
• Proficiency in SQL and PySpark within a Databricks environment.
• Proven experience leading small engineering teams.
• Skilled in configuration management and technical documentation.

If you're a Databricks expert looking for a role that blends leadership with deep technical involvement, this is your chance to make a real impact. Join a dynamic team and help shape the future of data engineering.

Ready to elevate your career? Apply now and be a vital part of this exciting transformation!

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

Lead Data Engineer

Salary/Rate : £100,000 - £110,000 per annum + Bonus

Location : North London

Company : Retelligence

About Retelligence

Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression.

The Role

Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The company is particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a fast-paced environment.

Key Responsibilities:

• p>Design, develop, and maintain scalable, data pipelines and infrastructure in a GCP environment.

• Integrate multiple data sources to ensure seamless data flow across the organization.

• Build and optimize data models for querying and analytics use cases.

• Develop fault-tolerant, highly available data ingestion and processing pipelines.

• Continuously monitor and improve pipeline performance for low-latency and high-throughput operations.

• Ensure data quality, integrity, and security across all systems.

• Implement effective monitoring, logging, and alerting mechanisms.

• Collaborate with product, engineering, and analytics teams to deliver tailored solutions that meet business needs.

About You

• Strong hands-on experience in data engineering with expertise in Python.

• Proven track record of building and managing data pipelines.

• In-depth experience with Google Cloud Platform (GCP) and its associated tools for data ingestion and processing.

• Familiarity with distributed streaming platforms such as Kafka or similar technologies.

• Advanced knowledge of SQL.

• Experience with data orchestration tools.

• Ability to optimize and refactor data pipelines for improved performance and scalability.

• Strong problem-solving skills and the ability to thrive in a collaborative, fast-paced environment.

Lead Data Engineer

London, UK (Hybrid)

Innovative FinTech

About the Company:

We are partnered with a high-growth FinTech company headquartered in London that is redefining how technology and data can transform financial services. Their mission is to deliver smarter, faster, and more secure financial solutions through cutting-edge platforms powered by data. With rapid expansion and strong investment backing, they are scaling their engineering and data capabilities to support ambitious growth plans.

The Role:

Our client is seeking a Lead Data Engineer to take ownership of their data infrastructure and lead the build-out of scalable, reliable, and secure data pipelines. This is a senior hands-on role, where you'll also provide technical leadership to a small but growing team. You'll work closely with data scientists, analysts, and software engineers to ensure the company's data strategy underpins their innovative financial products.

Key Responsibilities:

• Lead the design, development, and optimisation of data pipelines and ETL processes.
• Architect scalable data solutions to support analytics, machine learning, and real-time financial applications.
• Drive best practices for data engineering, ensuring high levels of data quality, governance, and security.
• Collaborate with cross-functional teams to integrate data systems with wider product and engineering initiatives.
• Mentor and guide junior engineers, fostering a culture of knowledge sharing and continuous improvement.
• Evaluate and implement new technologies, tools, and frameworks to advance the company's data platform.

Candidate Profile:

• Proven experience as a Data Engineer, with strong expertise in designing and managing large-scale data systems.
• Hands-on proficiency with modern data technologies such as Spark, Kafka, Airflow, or dbt.
• Strong SQL skills and experience with cloud platforms (Azure preferred).
• Solid programming background in Python, Scala, or Java.
• Knowledge of data warehousing solutions (e.g. Snowflake, BigQuery, Redshift).
• Strong understanding of data governance, security, and compliance (experience within financial services is a plus).
• Leadership experience, with the ability to mentor, influence, and set technical direction.
• Excellent communication skills and the ability to work effectively in a fast-paced, evolving environment.

Compensation:

• 85,000 - 100,000 base salary + bonus
• Hybrid working environment, with offices in central London.
• The opportunity to play a pivotal role in shaping the data function of a rapidly growing FinTech.
• Exposure to innovative projects and cutting-edge data technologies.
• A collaborative, forward-thinking culture that values technical excellence.

How to Apply

If you're an experienced Lead Data Engineer ready to step into a leadership role and want to make an impact in the FinTech space, we'd love to hear from you.

Please apply via LinkedIn or email your CV .

Please note, sponsorship is not available for this position.

Location: Warwick (Hybrid - once per week onsite)
Remuneration: From 700 per day (via umbrella company)
Contract Details: Fixed Term Contract, 6 months, Full Time

Are you ready to take the lead in transforming data engineering? Our client, a forward-thinking organisation, is seeking a highly skilled and hands-on Lead Data Engineer to drive their Data & Insights platform built on the Azure stack. This is a Databricks-heavy role , ideal for someone who thrives in technical environments and enjoys working directly with cutting-edge tools.

This is not just a leadership role - it's a hands-on engineering opportunity where your Databricks expertise will be front and centre . You'll be the go-to person for all things Databricks, from architecture and configuration to pipeline promotion and troubleshooting.

• Lead and deliver hands-on data engineering across all layers of the Azure-based data platform.
• Act as the Databricks SME (Subject Matter Expert) , overseeing architecture, configuration, and documentation.
• Guide and support the engineering team while contributing directly to development efforts.
• Manage DevOps practices including branch supervision and merging.
• Promote data pipelines and notebooks through development, testing, and production environments.
• Enhance monitoring and control frameworks to ensure platform reliability.
• Provide technical leadership and mentorship to a small team of Data Engineers.

• Extensive hands-on experience with Databricks - this is the core of the role.
• Strong background in Synapse and Azure DevOps.
• Proficiency in SQL and PySpark within a Databricks environment.
• Proven experience leading small engineering teams.
• Skilled in configuration management and technical documentation.

If you're a Databricks expert looking for a role that blends leadership with deep technical involvement, this is your chance to make a real impact. Join a dynamic team and help shape the future of data engineering.

Ready to elevate your career? Apply now and be a vital part of this exciting transformation!

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

Lead Data Engineer

Salary/Rate : £100,000 - £110,000 per annum + Bonus

Location : North London

Company : Retelligence

About Retelligence

Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression.

The Role

Retelligence is seeking a Lead Data Engineer to take a hands-on role in designing and delivering robust, real-time data pipelines and infrastructure in a Google Cloud Platform (GCP) environment. The company is particularly interested in candidates with strong expertise in SQL. As the Lead Data Engineer, you’ll play a critical role in shaping their data architecture and driving transformation. You’ll partner closely with engineering, product, and analytics teams to ensure efficient, high-performance data systems that enable the business to thrive in a fast-paced environment.

Key Responsibilities:

• p>Design, develop, and maintain scalable, data pipelines and infrastructure in a GCP environment.

• Integrate multiple data sources to ensure seamless data flow across the organization.

• Build and optimize data models for querying and analytics use cases.

• Develop fault-tolerant, highly available data ingestion and processing pipelines.

• Continuously monitor and improve pipeline performance for low-latency and high-throughput operations.

• Ensure data quality, integrity, and security across all systems.

• Implement effective monitoring, logging, and alerting mechanisms.

• Collaborate with product, engineering, and analytics teams to deliver tailored solutions that meet business needs.

About You

• Strong hands-on experience in data engineering with expertise in Python.

• Proven track record of building and managing data pipelines.

• In-depth experience with Google Cloud Platform (GCP) and its associated tools for data ingestion and processing.

• Familiarity with distributed streaming platforms such as Kafka or similar technologies.

• Advanced knowledge of SQL.

• Experience with data orchestration tools.

• Ability to optimize and refactor data pipelines for improved performance and scalability.

• Strong problem-solving skills and the ability to thrive in a collaborative, fast-paced environment.

Role Title: Lead Data Engineer
Location: Glasgow
Duration: 31/12/2026
Work Setup: 2-3 days onsite
Rate: 400 per day - PAYE via Umbrella Only

Role Description:
Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead one our teams, setting standards, reviewing code, and reviewing what our colleagues build.

Purpose of the role
To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Accountabilities

• Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
• Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
• Development of processing and analysis algorithms fit for the intended data complexity and volumes.
• Collaboration with data scientist to build and deploy machine learning models.

Expectations

• To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures.
• If managing a team, they define jobs and responsibilities, planning for the department's future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes. They may also lead a number of specialists to influence the operations of a department, in alignment with strategic as well as tactical priorities, while balancing short and long term goals and ensuring that budgets and schedules meet corporate requirements.
• If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L - Listen and be authentic, E - Energise and inspire, A - Align across the enterprise, D - Develop others.
• OR for an individual contributor, they will be a subject matter expert within own discipline and will guide technical direction. They will lead collaborative, multi-year assignments and guide team members through structured assignments, identify the need for the inclusion of other areas of specialisation to complete assignments. They will train, guide and coach less experienced specialists and provide information affecting long term profits, organisational risks and strategic decisions.
• Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
• Manage and mitigate risks through assessment, in support of the control and governance agenda.
• Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
• Demonstrate comprehensive understanding of the organisation functions to contribute to achieving the goals of the business.
• Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
• Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
• Adopt and include the outcomes of extensive research in problem solving processes.
• Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

Job Title: Lead Data Engineer

Role Type: Permanent

Location: Birmingham (Hybrid)

Role Overview

As a Lead Data Engineer, you will be responsible for maintaining data infrastructure on Microsoft Azure and leveraging your expertise in Microsoft BI tools and cloud-based technologies to drive their data initiatives. You will play a critical role in the team optimising data infrastructure.

Key Responsibilities

• Collaborate with cross-functional teams to achieve common business goals.

• Develop and maintain curated business models to support accurate and insightful decision-making.

• Utilise SSRS, SSAS, and SSIS to design, develop, and implement robust reporting and analytics solutions.

• Conduct complex data analysis to identify trends, patterns, and insights that drive business improvement.

• Demonstrate expertise in Azure Synapse and Azure Data Factory/Lakes for data integration, orchestration, and management.

• Implement and optimise data pipelines for seamless and efficient data flow within the Azure ecosystem.

• Extract data from Dynamics to build and enhance curated business models in Synapse/PowerBI.

• Ensure data security, compliance, and best practices are followed in Azure cloud environments.

• Build migration paths to transition from on-premises technologies to the cloud where appropriate.

Essential Skills

• Proven experience as a Lead/Senior Data Engineer.

• Expertise in the Microsoft BI stack, including SSRS, SSAS, and SSIS.

• Hands-on experience with Azure Synapse, Azure Data Factory, and other Azure cloud services.

• Strong analytical and problem-solving skills, with the ability to turn complex data into actionable insights.

• Excellent communication and interpersonal skills, with the ability to collaborate effectively with diverse teams.

• Demonstrated ability to design and implement curated business models for reporting and analysis.

If you are a skilled Lead/Senior Data Engineer, we would like to hear from you. Apply now!