465 Data Engineer jobs in the United Kingdom

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.

• Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
• Develop scalable ETL processes using PySpark and Python
• Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
• Ensure data quality, governance, and performance throughout the migration lifecycle
• Document technical processes and support knowledge transfer to internal teams

• Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
• Proven track record in delivering data migration projects within Azure environments
• Ability to work independently and communicate effectively with technical and non-technical stakeholders
• Previous experience in consultancy or client-facing roles is advantageous

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.

• Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
• Develop scalable ETL processes using PySpark and Python
• Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
• Ensure data quality, governance, and performance throughout the migration lifecycle
• Document technical processes and support knowledge transfer to internal teams

• Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
• Proven track record in delivering data migration projects within Azure environments
• Ability to work independently and communicate effectively with technical and non-technical stakeholders
• Previous experience in consultancy or client-facing roles is advantageous

Our top telecoms client is looking for a Data Engineer to join their team on a staff or contract basis

Our Client has a requirement for a Data Engineer, who will be required to work on a staff or contract basis in Irlam (Manchester).

Role Purpose:

• The BI Data Engineer will be responsible for leading and developing and reporting views to ensure data-driven insights are underpinned by a validated dataset, aligning to the data definitions set out by the business.

  In addition, this role will focus on data engineering, building and managing the infrastructure that allows Freedom Fibre to collect, store, and analyse data. The role will involve designing, building, and maintaining databases to ensure data is readily available, reliable, and efficient for various purposes, including data science and business intelligence. This will also include developing and maintaining API integrations with systems to extract and load data into the database.

  The role will also be responsible for designing, developing, and maintaining interactive Power BI dashboards using advanced SQL and Python to extract, transform, and model data for optimal performance and usability.

Job Role Responsibilities:

• • Create, maintain, and optimise reports and interactive Power BI dashboards to meet internal and external customer needs, using advanced SQL queries and Python scripts for data extraction, transformation, and modelling.
  • Design, build, and maintain scalable database solutions that ensure high availability, security, and performance.
  • Build and maintain ETL (Extract, Transform, Load) pipelines to automate the movement and transformation of data from multiple sources into a central database.
  • Develop and maintain API integrations with business systems to ensure seamless, reliable, and timely data ingestion.
  • Analyse, mine, and process internal data using datasets from business systems to deliver validated outputs.
  • Ensure all data architecture and infrastructure supports both operational and analytical needs, enabling effective data science and BI activities.
  • Work closely and collaboratively with internal FFL departments to ensure the BI Team meets all reporting requirements and deadlines.
  • Drive continuous improvement of processes, highlight data discrepancies, and create operational procedures to address data quality.
  • Input into new system selection and upgrades to ensure data for reporting is correctly generated and stored.
  • Regularly conduct data integrity checks and use automation to enhance efficiency and insight generation.
  • Define and monitor key performance indicators, ensuring alignment with business objectives.
  • Research and implement ways to better utilise company data and automation to deliver results faster and with greater accuracy.

Experience / Skills / Knowledge / Qualifications:

• • Proficiency with Microsoft applications, e.g. Excel formulas, pivots, charts, and Power BI dashboards.
  • Strong knowledge of data management platforms and database design.
  • Hands-on experience with SQL for database querying, optimisation, and Power BI data modelling.
  • Proficiency in Python for data manipulation, automation, and advanced analytics.
  • Experience designing and implementing ETL processes and data pipelines.
  • Experience with API development and integration for data ingestion.
  • Ability to analyse, model, and interpret data, including identifying trends and patterns in complex datasets.
  • Familiarity with programming principles to support automation and data processing tasks.
  • Previous experience within Telecoms, specifically Fibre-related products and understanding of network topologies (POP / XGS-PON) preferred.
  • Strong analytical skills with the ability to collect, organise, analyse, and disseminate large volumes of data accurately.

  Qualifications

  • Ideally qualified to degree level in a relevant subject, or experience equivalent to this
  • Power BI and/or relevant technical certifications (e.g. SQL, Python, Data Engineering, API Development) desirable.

Benefits:

• Staff or contract
• Negotiable rate
• Hybrid working

Company information

At First Recruitment Group we understand just how important it is to secure the right people. That is why our Recruitment Consultants always take the time to understand requirements in detail and offer sound advice to both clients and candidates.  We actively recruit at all levels and this is a superb opportunity for a  Data Engineer looking for new employment.

As part of putting people first, we strive to be an equal opportunities employer and we are always looking to increase the diversity of our workforce, working closely with our clients to ensure everyone is included.

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.

• Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
• Develop scalable ETL processes using PySpark and Python
• Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
• Ensure data quality, governance, and performance throughout the migration lifecycle
• Document technical processes and support knowledge transfer to internal teams

• Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
• Proven track record in delivering data migration projects within Azure environments
• Ability to work independently and communicate effectively with technical and non-technical stakeholders
• Previous experience in consultancy or client-facing roles is advantageous

Data Engineer

I am working with a leading, AI driven organisation that supports its clients' marketing campaigns, expanding its data engineering capabilities and looking for a Data Engineer to join their team. This is a fantastic opportunity to join an award-winning tech business where you will have the opportunity to work at the forefront of data architecture, building distributed systems and leveraging Gen AI tools to accelerate development and improve quality.

You will be encouraged to explore new ways to utilise modern technologies and will be positioned to help mentor other members of the technical team whilst leading innovative technical projects.

As part of this role, you will be responsible for some of the following areas:

• Design and build distributed data pipelines using languages such as Spark, Scala, and Java
• Collaborate with cross-functional teams to deliver user-centric solutions
• Lead on the design and development of relational and non-relational databases
• Apply Gen AI tools to boost development speed and code quality
• Maintain and optimise large-scale data collection processes
• Support the deployment of machine learning models into production

To be successful in the role you will have:

• Creating scalable ETL jobs using Scala and Spark
• Strong understanding of data structures, algorithms, and distributed systems
• Experience working with orchestration tools such as Airflow
• Familiarity with cloud technologies (AWS or GCP)
• Hands-on experience with Gen AI tools for coding and debugging

This is a remote-first role with flexibility to work from anywhere in the UK. Some of the benefits included with the role are listed below:

• Salary of up to 140,000
• Unlimited holiday allowance
• Fully covered private medical care
• Enhanced parental leave policies
• Bespoke training and career development plans
• Regular socials, volunteer days, and a birthday day off

This is just a brief overview of the role. For the full information, simply apply with your CV and I'll be in touch to discuss further. Interviews are already underway, so don't miss out - APPLY now! To do so, please email me at (url removed) or call directly on (phone number removed).

Data Engineer - UK - Remote

A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech company.

About the role:

• Build and maintain distributed data systems processing millions of data points daily.
• Design complex Spark jobs, asynchronous APIs, and scalable data pipelines.
• Collaborate with Data Science and Web teams to deliver user-centric solutions.
• Use Gen AI tools to accelerate development and improve quality.

Requirements:

• Strong experience with Scala, Java, and distributed systems (Spark).
• Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms.
• Familiarity with Gen AI tools for coding and debugging.
• Solid understanding of data structures, algorithms, and database technologies.
• A collaborative mindset and a passion for solving complex problems.

Benefits:

• Trust-Based Vacation Policy - take time off when you need it
• Private Medical Healthcare
• Generous Parental Leave & Pension Scheme
• Monthly Hackdays & Career Development Plans
• Remote first
• And more

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Contact me: (url removed)

Location: Central London (Hybrid - 3 days in office)
Salary: Up to 62,000 per annum
Contract Type: Fixed Term (18 months)

Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking for a hands-on Data Engineer to help build the foundations of their future data estate.

This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets.

You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation.

What You'll Be Doing:

• Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks.
• Integrate data from enterprise systems (e.g. Dynamics, iTrent, Unit4) into a unified data platform.
• Cleanse, transform, and model data to support BI tools (e.g., Power BI) and AI/ML use cases.
• Implement data validation, lineage tracking, and metadata tagging for observability and trust.
• Collaborate with stakeholders to standardise KPIs and support cross-functional reporting.
• Ensure secure handling of sensitive data in line with GDPR and internal policies.

What We're Looking For:

• Solid experience in data engineering or backend data development.
• Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt.
• Proficiency in SQL and Python, with a solid understanding of data modelling and transformation.
• Experience integrating data from enterprise systems (CRM, ERP, HRIS).
• Familiarity with DevOps practices (CI/CD, version control, monitoring) in a data context.

What's On Offer:

• A salary of up to 62,000 depending on experience
• 29 days annual leave plus bank holidays
• A generous pension scheme

This is more than just a technical role-it's a chance to help shape the data future of a globally respected institution. If you're passionate about building high-quality data pipelines and enabling insight through clean, trusted data, we'd love to hear from you.

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Tenth Revolution Group / Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed)

Data Engineer
Location: Derby (Hybrid)
Salary: Up To £52,500 + 12.5% Bonus
Key Skills: Azure, SQL, Python, Power BI, Data Visualization

Are you passionate about building data platforms that power innovation, insight, and advanced analytics? We are looking for a Data Engineer to help shape the future of clean energy by enabling smarter decisions with data.
As part of the growing Digital & Data team, you’ll play a pivotal role in designing and delivering scalable data pipelines, building robust data infrastructure, and creating visualisations that bring insights to life for stakeholders across the business. With exponential growth expected over the next few years, this is a unique opportunity to help shape the foundations of our data strategy at a transformative stage.

What You’ll Be Doing
• Building Data Foundations – Design, build, and optimise secure and scalable data pipelines and infrastructure to support analytics, reporting, and digital applications.
• Engaging with Stakeholders – Partner with business teams to understand data needs, present insights through compelling visualisations, and influence decision-making.
• Data Modelling & Integration – Develop models and integration frameworks that make data accessible, consistent, and reusable across platforms.
• Driving Data Quality – Implement robust validation, cleansing, and monitoring processes to ensure data integrity and compliance.
• Innovation & Future Focus – Explore and experiment with new technologies, including AI and machine learning, to unlock value from complex and unique datasets.
What We’re Looking For
We know there’s no such thing as the _perfect_ candidate. If you meet around 75% of the criteria, we’d still love to hear from you.
• Strong experience with data engineering tools and platforms (e.g. Azure Data Factory, Databricks, SQL, Python).
• Proven ability to engage stakeholders and present insights through data visualisation tools and storytelling.
• Experience with data modelling, warehousing, and integration.
• Interest in and awareness of AI and emerging technologies.
• Ability to thrive in an agile, fast-growing environment, managing both highly complex data and scalable solutions.
Beneficial (but not essential):
• Degree in engineering, science, or IT discipline.
• Microsoft Azure certifications or BCS Data Management qualifications.
• Experience embedding data modelling practices into delivery workflows.

Why Join Us?
• Be at the forefront of a transformational energy programme.
• Work on unique, complex datasets with high-impact outcomes.
• Shape data foundations during a period of rapid organisational growth.
• Flexible and inclusive working environment, with support for work-life balance.
• A culture that values diversity, innovation, and continuous learning.

Data Engineer
Location: Derby (Hybrid)
Salary: Up To £52,500 + 12.5% Bonus
Key Skills: Azure, SQL, Python, Power BI, Data Visualization

• Expertise in SQL and noSQL technologies (e.g., MS SQL, Oracle, MongoDB).
• Experience with data processing and exchange (ETL, ESB, API).
• Strong development skills, particularly with Python.
• Big data experience/knowledge (hadoop etc)
• Advantageous to have knowledge of Generative AI, Natural Language Processing, Object Character Recognition, and containerisation (Docker).

• Meaningful Work: Contribute to mission-critical projects that protect the nation.
• Career Growth: Join a developing structure with significant opportunities to influence strategy.
• Excellent Benefits: Enjoy a competitive package including a pension contribution of up to 14%, a company bonus, and paid overtime.