61 Etl Processes jobs in the United Kingdom

Role:             Data Engineering Manager - Manchester, hybrid

The Team:

A highly passionate bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models.  We are with them to help protect their information, make informed decisions, deliver a personalised service and automate their workloads.  Our engineers might be building data pipelines, modelling data, developing predictive models or automations for repeatable tasks or creation of data products.

The role:

Your role in the division is to lead the team developing our cloud data platform to further build-out our ‘single source of truth’ for company data.  We have a recently implemented technology stack and clear direction of travel, so your initial objectives will be to understand our business data and team capabilities to then expand and improve our Kimball-model data warehouse in Azure, focusing on new datasets, pipeline resilience, performance and security.  You will lead and coach the team in deploying tools and processes to ensure good practice is embedded, in line with our strategic themes of quality, efficiency, empowerment, transparency and governance.  That means you will be conversant with data warehouse modelling, source control, CICD and Infrastructure as Code.

Our technology stack is based on Microsoft software:  Azure, SQL Server and DevOps, using Terraform for infrastructure deployment.  Our source data is also in Microsoft technology, currently on-premise in hosted data centres in the EU and US.

We currently manage our work in Kanban, with the support of a dedicated Delivery Lead, to respond to rapid growth in use-cases for our data.

Tasks & responsibilities include:

-    Deliver good software development lifecycle processes are used for all our software artifacts, including use of source control, unit testing, CICD, IaC 
-    Deliver an enterprise data model considering all our current and likely future data sources
-    Manage the improvement of our Kimball-style data warehouse in Azure
-    Lead and coach a team of engineers to build and maintain the platform
-    Partner with our delivery lead to manage the strategic roadmap and tactical workflow, ensuring that work items are delivered on time and with high quality
-    Ability to communicate clearly with diverse teams, including across our geographic locations
-    Ability to identify when a business need is unclear or ambiguous and ask the right questions
-    Ability to translate a business need into a technical solution, considering scalability, security and resilience
-    Relentless approach to continuous improvement of both processes and individuals

We think you’ll be a great fit if you have:
-    Experience of team leadership, especially of hybrid on- and off-shore teams
-    Experience of managing a team’s workload in collaboration with delivery, project or product professionals
-    Experience of modelling and building an enterprise data warehouse to support analytical workloads
-    Experience of using Azure services including Azure SQL Database, Data Factory, DevOps, Power BI 
-    Experience of good SDLC practices:  source control (git), CI/CD, test and release processes
-    Any experience using any of the following would also be a bonus in our environment:  Dynamics CRM, Rabbit MQ, HubSpot, C# .NET development or legacy Microsoft data technologies (SSIS, SSRS)

We are looking for the right person who is a team player who can communicate effectively and is comfortable working within a diversified, multi-cultural and multi-functional team, both locally and remote, understanding the perspectives of each partner. Above all, someone with the passion to drive and succeed in their own career.

Experience in any of the above would help you to become productive in the job more quickly. We are genuinely committed to your success so, if you don’t quite meet all of our requirements yet, we encourage you to apply anyway and start a conversation.  

Data Engineering Manager

Location:  Leeds (Mostly Remote – 1 Day On-Site)
Salary:  Up to £75,000 per annum

Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just one day on-site per week.

You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.

About You

You might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.

Key Responsibilities

• Lead development of data pipelines and solutions using Databricks, Python, and SQL

• Design and maintain data models supporting analytics and business intelligence

• Build and optimise ELT/ETL processes on AWS or Azure

• Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products

• Champion best practices in testing, CI/CD, version control, and infrastructure as code

• Mentor and support your team, taking ownership of technical delivery and decisions

• Drive continuous improvements in platform performance, cost, and reliability

Key Requirements

• Hands-on experience with Databricks or similar data engineering platforms

• Strong Python and SQL skills in data engineering contexts

• Expertise in data modelling and building analytics-ready datasets

• Experience with AWS or Azure cloud data services

• Proven leadership or mentorship experience

• Excellent communication and stakeholder management

• Agile delivery and DevOps tooling knowledge

Desirable

• Experience with infrastructure-as-code (Terraform, CloudFormation)

• Familiarity with CI/CD pipelines and orchestration tools

• Knowledge of data governance and quality controls

• Experience in regulated or large-scale environments

Apply now to speak with VIQU IT in confidence, or reach out to Phoebe Rees via the VIQU IT website.

Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).

For more exciting roles and opportunities like this, follow us on LinkedIn @VIQU IT Recruitment.

   

Role: Data Engineering Manager

Salary: £65,000- £5,000 per annum

Location: Leeds (One day on site).

VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The ideal candidate will come from a technical background but has recently worked in a managerial role focused on mentoring, coaching, reviewing code, and standard setting. The role will focus on the development of the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. 

Job duties of the Data Engineering Manager: 

• Manage a team of eight engineers, helping to mentor and coach the team.
• Manage  the adoption of automated CI/CD pipelines.
• Implement a new delivery roadmap.
• Contribute to the development of a new Databricks system in AWS (AWS experience is preferred but they are open to managers with Azure experience).
• Cost optimisation.
• Establish data governance frameworks for secure handling of delivery information.

Requirements of the Data Engineering Manager:

• 6+ years experience in a hands on data engineer role, with over a years recent experience in a managerial role, coaching similar sized teams.
• Deep knowledge of the Databricks platform.
• Hands on Python development experience.
• SQL optimisation.
• Experience with large scale data pipeline optimisation.
• Experience with Streaming and Batch Spark workloads.
• Strong people management skills.

Role: Data Engineering Manager

Salary: £65 00- 5,000 per annum

Location: Leeds (One day on site).

To discuss this exciting opportunity in more detail, please APPLY NOW for a no obligation chat with your VIQU Consultant. Additionally, you can contact Jack McManus on (url removed).

If you know someone who would be ideal for this role, by way of showing our appreciation, VIQU is offering an introduction fee up to £1, 0 once your referral has successfully started work with our client (terms apply).

To be the first to hear about other exciting opportunities, technology, and recruitment news, please also follow us at ‘VIQU IT Recruitment’ on LinkedIn, and Twitter: @VIQU_UK

Data Engineering Manager

Location:  Leeds (Mostly Remote – 1 Day On-Site)
Salary:  Up to £75,000 per annum

Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just one day on-site per week.

You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.

About You

You might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.

Key Responsibilities

• Lead development of data pipelines and solutions using Databricks, Python, and SQL

• Design and maintain data models supporting analytics and business intelligence

• Build and optimise ELT/ETL processes on AWS or Azure

• Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products

• Champion best practices in testing, CI/CD, version control, and infrastructure as code

• Mentor and support your team, taking ownership of technical delivery and decisions

• Drive continuous improvements in platform performance, cost, and reliability

Key Requirements

• Hands-on experience with Databricks or similar data engineering platforms

• Strong Python and SQL skills in data engineering contexts

• Expertise in data modelling and building analytics-ready datasets

• Experience with AWS or Azure cloud data services

• Proven leadership or mentorship experience

• Excellent communication and stakeholder management

• Agile delivery and DevOps tooling knowledge

Desirable

• Experience with infrastructure-as-code (Terraform, CloudFormation)

• Familiarity with CI/CD pipelines and orchestration tools

• Knowledge of data governance and quality controls

• Experience in regulated or large-scale environments

Apply now to speak with VIQU IT in confidence, or reach out to Phoebe Rees via the VIQU IT website.

Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).

For more exciting roles and opportunities like this, follow us on LinkedIn @VIQU IT Recruitment.

   

Role:             Data Engineering Manager - Manchester, hybrid

The Team:

A highly passionate bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models.  We are with them to help protect their information, make informed decisions, deliver a personalised service and automate their workloads.  Our engineers might be building data pipelines, modelling data, developing predictive models or automations for repeatable tasks or creation of data products.

The role:

Your role in the division is to lead the team developing our cloud data platform to further build-out our ‘single source of truth’ for company data.  We have a recently implemented technology stack and clear direction of travel, so your initial objectives will be to understand our business data and team capabilities to then expand and improve our Kimball-model data warehouse in Azure, focusing on new datasets, pipeline resilience, performance and security.  You will lead and coach the team in deploying tools and processes to ensure good practice is embedded, in line with our strategic themes of quality, efficiency, empowerment, transparency and governance.  That means you will be conversant with data warehouse modelling, source control, CICD and Infrastructure as Code.

Our technology stack is based on Microsoft software:  Azure, SQL Server and DevOps, using Terraform for infrastructure deployment.  Our source data is also in Microsoft technology, currently on-premise in hosted data centres in the EU and US.

We currently manage our work in Kanban, with the support of a dedicated Delivery Lead, to respond to rapid growth in use-cases for our data.

Tasks & responsibilities include:

-    Deliver good software development lifecycle processes are used for all our software artifacts, including use of source control, unit testing, CICD, IaC 
-    Deliver an enterprise data model considering all our current and likely future data sources
-    Manage the improvement of our Kimball-style data warehouse in Azure
-    Lead and coach a team of engineers to build and maintain the platform
-    Partner with our delivery lead to manage the strategic roadmap and tactical workflow, ensuring that work items are delivered on time and with high quality
-    Ability to communicate clearly with diverse teams, including across our geographic locations
-    Ability to identify when a business need is unclear or ambiguous and ask the right questions
-    Ability to translate a business need into a technical solution, considering scalability, security and resilience
-    Relentless approach to continuous improvement of both processes and individuals

We think you’ll be a great fit if you have:
-    Experience of team leadership, especially of hybrid on- and off-shore teams
-    Experience of managing a team’s workload in collaboration with delivery, project or product professionals
-    Experience of modelling and building an enterprise data warehouse to support analytical workloads
-    Experience of using Azure services including Azure SQL Database, Data Factory, DevOps, Power BI 
-    Experience of good SDLC practices:  source control (git), CI/CD, test and release processes
-    Any experience using any of the following would also be a bonus in our environment:  Dynamics CRM, Rabbit MQ, HubSpot, C# .NET development or legacy Microsoft data technologies (SSIS, SSRS)

We are looking for the right person who is a team player who can communicate effectively and is comfortable working within a diversified, multi-cultural and multi-functional team, both locally and remote, understanding the perspectives of each partner. Above all, someone with the passion to drive and succeed in their own career.

Experience in any of the above would help you to become productive in the job more quickly. We are genuinely committed to your success so, if you don’t quite meet all of our requirements yet, we encourage you to apply anyway and start a conversation.  

Role: Data Engineering Manager

Salary: £65,000- £5,000 per annum

Location: Leeds (One day on site).

VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The ideal candidate will come from a technical background but has recently worked in a managerial role focused on mentoring, coaching, reviewing code, and standard setting. The role will focus on the development of the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. 

Job duties of the Data Engineering Manager: 

• Manage a team of eight engineers, helping to mentor and coach the team.
• Manage  the adoption of automated CI/CD pipelines.
• Implement a new delivery roadmap.
• Contribute to the development of a new Databricks system in AWS (AWS experience is preferred but they are open to managers with Azure experience).
• Cost optimisation.
• Establish data governance frameworks for secure handling of delivery information.

Requirements of the Data Engineering Manager:

• 6+ years experience in a hands on data engineer role, with over a years recent experience in a managerial role, coaching similar sized teams.
• Deep knowledge of the Databricks platform.
• Hands on Python development experience.
• SQL optimisation.
• Experience with large scale data pipeline optimisation.
• Experience with Streaming and Batch Spark workloads.
• Strong people management skills.

Role: Data Engineering Manager

Salary: £65 00- 5,000 per annum

Location: Leeds (One day on site).

To discuss this exciting opportunity in more detail, please APPLY NOW for a no obligation chat with your VIQU Consultant. Additionally, you can contact Jack McManus on (url removed).

If you know someone who would be ideal for this role, by way of showing our appreciation, VIQU is offering an introduction fee up to £1, 0 once your referral has successfully started work with our client (terms apply).

To be the first to hear about other exciting opportunities, technology, and recruitment news, please also follow us at ‘VIQU IT Recruitment’ on LinkedIn, and Twitter: @VIQU_UK

Data Engineering Analyst

Duration: 6 Months (potential to extend)

Location: Leeds or Edinburgh (Hybrid – 2 days per week in-office)

About the Role:

We’re looking for an experienced Data Engineering Analyst to join our team on a 6-month contract. In this role, you'll be instrumental in shaping our data infrastructure, enabling seamless data flows, and delivering actionable insights through advanced analytics and visualization.

What You’ll Be Doing:

• Design, build, and maintain data pipelines using GCP technologies such as BigQuery, Cloud Storage, and Cloud Dataflow
• Develop insightful dashboards and reports in Power BI to support key business decisions
• Write efficient, scalable Python code for data transformation and analysis
• Collaborate across teams to gather requirements and deliver data solutions
• Troubleshoot and optimize existing data systems for performance and scalability

What We’re Looking For:

• Experience in data engineering, data analysis, or a related discipline
• Proven hands-on expertise with GCP services (BigQuery, Cloud Storage, Dataflow)
• Proficiency in Power BI for creating reports and dashboards
• Strong Python skills, including experience with data libraries like Pandas and NumPy
• Solid background in ETL processes, data pipeline design, and data warehousing
• Detail-oriented with excellent problem-solving and communication skills

Nice to Have:

• Knowledge of data governance, quality, and security best practices
• Experience working in Agile environments and using Git for version control

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone’s chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

Data Engineering Lead
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.  
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you  
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.  
+ Working remotely from home or in our office in a flexible hybrid style 
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive 
Working with us  
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.  
Working for you  
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:  
+ Generous holiday allowance with the option to buy additional days 
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year  
+ Health screening, eye care vouchers and private medical benefits 
+ Wellbeing programs 
+ Life assurance 
+ Access to a competitive contributory pension scheme 
+ Long service awards 
+ Save As You Earn share option scheme 
+ Travel Season ticket loan 
+ Maternity, paternity and shared parental leave 
+ Access to emergency care for both the elderly and children 
+ RELX Cares days, giving you time to support the charities and causes that matter to you 
+ Access to employee resource groups with dedicated time to volunteer 
+ Access to extensive learning and development resources 
+ Access to employee discounts via Perks at Work 
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
---
Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: , or please contact 1- .
Please read our Candidate Privacy Policy ( .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.