554 Data Engineering jobs in the United Kingdom
Data Engineering Lead
Posted 11 days ago
Job Viewed
Job Description
Data Engineering Lead
I am working with a forward-thinking professional services organisation that is expanding its Data & Innovation capabilities and looking for a Data Engineering Lead to join their team. This is a fantastic opportunity to take on a hands-on leadership role where you will guide a small team of technical specialists while shaping the future of data engineering, automation, and systems development across the business.
You'll be at the heart of strategic technical delivery, blending architectural oversight with hands-on execution, and mentoring others to build scalable, modern solutions using technologies like Databricks and the Azure tech stack.
Key Responsibilities:
- Provide technical leadership to a small team focusing on data engineering and development
- Define and maintain scalable internal data and systems architecture aligned with business needs
- Lead the design and delivery of complex engineering solutions, ensuring best practices
- Guide the team on prioritised initiatives, ensuring timely and high-quality delivery
- Deliver hands-on technical change and development where required
Skills & Experience Required:
- Strong Data Engineering experience
- Hands-on expertise with the Azure tech stack (Synapse, Data Factory, Data Lake Storage) and Databricks
- Proven ability to lead and mentor technical teams in agile environments
- Ability to work closely with other leaders across the business and have input into strategy planning sessions focusing on technical execution
Benefits:
- Salary of up to 95,000 per year
- 25 days annual leave, plus bank holidays
- Private healthcare schemes and life insurance policies
- Enhanced parental leave policies
- Lifestyle benefits such as cycle to work schemes, retail discounts and vehicle salary sacrifice schemes
Data Engineering Manager
Posted 11 days ago
Job Viewed
Job Description
Location: Leeds (Mostly Remote – 1 Day On-Site)
Salary: Up to £75,000 per annum
Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just one day on-site per week.
You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.
About YouYou might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.
Key Responsibilities-
Lead development of data pipelines and solutions using Databricks, Python, and SQL
-
Design and maintain data models supporting analytics and business intelligence
-
Build and optimise ELT/ETL processes on AWS or Azure
-
Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products
-
Champion best practices in testing, CI/CD, version control, and infrastructure as code
-
Mentor and support your team, taking ownership of technical delivery and decisions
-
Drive continuous improvements in platform performance, cost, and reliability
-
Hands-on experience with Databricks or similar data engineering platforms
-
Strong Python and SQL skills in data engineering contexts
-
Expertise in data modelling and building analytics-ready datasets
-
Experience with AWS or Azure cloud data services
-
Proven leadership or mentorship experience
-
Excellent communication and stakeholder management
-
Agile delivery and DevOps tooling knowledge
-
Experience with infrastructure-as-code (Terraform, CloudFormation)
-
Familiarity with CI/CD pipelines and orchestration tools
-
Knowledge of data governance and quality controls
-
Experience in regulated or large-scale environments
Apply now to speak with VIQU IT in confidence, or reach out to Phoebe Rees via the VIQU IT website.
Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).
For more exciting roles and opportunities like this, follow us on LinkedIn @VIQU IT Recruitment.
Data Engineering Lead
Posted 11 days ago
Job Viewed
Job Description
Data Engineering Lead
I am working with a forward-thinking professional services organisation that is expanding its Data & Innovation capabilities and looking for a Data Engineering Lead to join their team. This is a fantastic opportunity to take on a hands-on leadership role where you will guide a small team of technical specialists while shaping the future of data engineering, automation, and systems development across the business.
You'll be at the heart of strategic technical delivery, blending architectural oversight with hands-on execution, and mentoring others to build scalable, modern solutions using technologies like Databricks and the Azure tech stack.
Key Responsibilities:
- Provide technical leadership to a small team focusing on data engineering and development
- Define and maintain scalable internal data and systems architecture aligned with business needs
- Lead the design and delivery of complex engineering solutions, ensuring best practices
- Guide the team on prioritised initiatives, ensuring timely and high-quality delivery
- Deliver hands-on technical change and development where required
Skills & Experience Required:
- Strong Data Engineering experience
- Hands-on expertise with the Azure tech stack (Synapse, Data Factory, Data Lake Storage) and Databricks
- Proven ability to lead and mentor technical teams in agile environments
- Ability to work closely with other leaders across the business and have input into strategy planning sessions focusing on technical execution
Benefits:
- Salary of up to 95,000 per year
- 25 days annual leave, plus bank holidays
- Private healthcare schemes and life insurance policies
- Enhanced parental leave policies
- Lifestyle benefits such as cycle to work schemes, retail discounts and vehicle salary sacrifice schemes
Data Engineering Manager
Posted 11 days ago
Job Viewed
Job Description
Location: Leeds (Mostly Remote – 1 Day On-Site)
Salary: Up to £75,000 per annum
Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just one day on-site per week.
You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.
About YouYou might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.
Key Responsibilities-
Lead development of data pipelines and solutions using Databricks, Python, and SQL
-
Design and maintain data models supporting analytics and business intelligence
-
Build and optimise ELT/ETL processes on AWS or Azure
-
Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products
-
Champion best practices in testing, CI/CD, version control, and infrastructure as code
-
Mentor and support your team, taking ownership of technical delivery and decisions
-
Drive continuous improvements in platform performance, cost, and reliability
-
Hands-on experience with Databricks or similar data engineering platforms
-
Strong Python and SQL skills in data engineering contexts
-
Expertise in data modelling and building analytics-ready datasets
-
Experience with AWS or Azure cloud data services
-
Proven leadership or mentorship experience
-
Excellent communication and stakeholder management
-
Agile delivery and DevOps tooling knowledge
-
Experience with infrastructure-as-code (Terraform, CloudFormation)
-
Familiarity with CI/CD pipelines and orchestration tools
-
Knowledge of data governance and quality controls
-
Experience in regulated or large-scale environments
Apply now to speak with VIQU IT in confidence, or reach out to Phoebe Rees via the VIQU IT website.
Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).
For more exciting roles and opportunities like this, follow us on LinkedIn @VIQU IT Recruitment.
Data Engineering Lead
Posted 10 days ago
Job Viewed
Job Description
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
---
Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: , or please contact .
Please read our Candidate Privacy Policy ( .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Data Engineering Lead
Posted 10 days ago
Job Viewed
Job Description
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
---
Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: , or please contact .
Please read our Candidate Privacy Policy ( .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Data Engineering Consultant
Posted 14 days ago
Job Viewed
Job Description
Come join us
As a member of the Data Engineering team, you'll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade's Data & AI practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft Fabric and / or Azure Databricks technologies to deliver modern, highly scalable data platforms for all our client's analytics and AI needs. Our clients look to us for innovation, which means you'll have early access to the latest technologies so you can master them and stay ahead of the curve.
Together we do what matters.
What you'll do
* Design, development, and delivery of enterprise-grade analytics solutions based on Azure and Databricks technologies
* Evangelise and evolve best practices for our clients and our team including to mentor your colleagues, supporting their personal development
* Constantly developing technical skills in the latest Azure and Databricks technologies - achieving & maintaining relevant certifications
* Working directly with high profile clients across a variety of sectors to understand their requirements and present solutions to customer sponsors
Skills and experiences
* Demonstrable end-to-end experience in Data Engineering, including large-scale projects
* Experience in working with the latest Azure technologies, such as; Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen 2), Purview, Cosmos DB, Open AI, Azure ML, AI Foundary, Kubernetes,
* Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL
* Confident communicator who is able to explain technical terms to non-technical audiences and mentor junior colleagues
* Leads small development teams: track work, manage assignments, manage capacity, etc.
About you
Characteristics that can spell success for this role
* Analytical, curious, agile
* Team player and good communicator
* Problem-solver, patient, quality-driven
* Self-motivating
* Innovative mindset
Enjoy your career
Some of the best things about working at Avanade
* Opportunity to work for Microsoft's Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
* Real-time access to technical and skilled resources globally
* Collaborate with some of the brightest "Microsoft minds"
* Build your expertise, solve problems, learn, and develop
Find out more about some of our benefits here.
A great place to work
As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.
Create a future for our people that focuses on
- Expanding your thinking - Experimenting courageously - Learning and pivoting
Inspire greatness in our people by
- Empowering every voice - Encouraging boldness - Celebrating progress
Accelerate the impact of our people by
- Amazing the client - Prioritizing what matters - Acting as one
Learn more
To learn more about the types of projects our Data Engineering team works on check out these case studies:
* thyssenkrupp Materials Services uses data to help strike a delicate operational balance
* What matters to SSE Renewables is innovating for a sustainable future
Interested in knowing what's going on inside Avanade? Check out our blogs:
* Avanade Insights - exchange ideas that drive tomorrow's innovation
* Inside Avanade - explore what life is like working at Avanade
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.
Be The First To Know
About the latest Data engineering Jobs in United Kingdom !
Data Engineering Manager
Posted 1 day ago
Job Viewed
Job Description
WHJS1_UKTJ
Data Engineering Manager
Posted 1 day ago
Job Viewed
Job Description
The Data Engineering Manager reports directly to the BI Delivery Manager and is responsible for leading a
team of data engineers in designing, building, and maintaining highly scalable, robust, and reliable data
pipelines within an AWS environment. This role drives the strategic direction for data warehousing, data
modeling, data processing frameworks, and big data initiatives—ensuring data is captured, processed, and
delivered seamlessly to support business intelligence, reporting, and advanced analytics.
A strong candidate will have deep hands-on experience with AWS services (particularly Redshift, Glue, S3), be
adept at managing inbound and outbound integrations with external systems, and excel at mentoring team
members. The Data Engineering Manager will also collaborate extensively with cross-functional
stakeholders—such as product, analytics, reporting, and business teams—to align engineering efforts with
organizational data goals. Experience with Airflow (or a similar workflow orchestration tool) is critical for effective data job scheduling and performance optimization.
We are Allwyn UK, part of the Allwyn Entertainment Group – a multi-national lottery operator with a
market-leading presence in Austria, the Czech Republic, Greece, Cyprus and Italy. We have been officially
awarded the Fourth Licence (10 year licence) to operate the National Lottery starting February 2024.
We’ve developed ground-breaking technologies, built player protection frameworks, and have a proven
track record of making lotteries better. Our aim is to create one of the UK’s most inclusive organisations –
where people can bring the best of themselves, to do their best work, every day, for the benefit of good
causes.
Allwyn is an Equal Opportunity Employer which prides itself in being diverse and inclusive. We do not
tolerate discrimination, harassment, or victimisation in the workplace. All employment decisions at Allwyn
are based on the business needs, the job requirements, and the individual qualifications. Allwyn
encourages applications from individuals regardless of age, disability (visible or hidden), sex, gender
reassignment, sexual orientation, pregnancy and maternity, race, religion or belief and marriage and civil
partnerships.
While the main contribution of the National Lottery to society is through the funds to good causes, at
Allwyn we put our purpose and values at the heart of everything we do. Join us as we embark on a once-in-
a-lifetime, largescale transformation journey to build a bigger, better, and safer National Lottery that
delivers more money to good causes.
Our goal is to create one of the uk’s most inclusive organisations – where people can bring the best of themselves,
To do their best work, every day, for the benefit of good causes.
Allwyn is an Equal Opportunity Employer which prides itself in being diverse and inclusive. We do not tolerate
discrimination, harassment, or victimisation in the workplace. All employment decisions at Allwyn are based
on the business needs, the job requirements, and the individual qualifications. Allwyn encourages
applications from individuals regardless of age, disability (visible or hidden), sex, gender reassignment, sexual
orientation, pregnancy and maternity, race, religion or belief and marriage and civil partnerships.
Responsibilities
1. Team Leadership & Management
· Recruit, mentor, and lead a team of data engineers, providing both technical and professional guidance.
· Foster a culture of ownership, continuous learning, and collaboration within the team.
2. ETL/ELT Development & Architecture
· Design, develop, and optimize ETL/ELT pipelines using AWS Glue, Redshift, and related AWS services.
· Establish best practices for data ingestion, transformations, orchestration, and scheduling.
· Oversee the development of inbound (external-to-internal) and outbound (internal-to-external) data feeds to ensure seamless integration with third-party services and downstream applications.
3. Data Warehouse & Data Modeling
· Create and maintain scalable data models in Redshift to support business intelligence and reporting needs.
· Ensure data architecture adheres to industry best practices, including normalization/denormalization strategies and performance optimization.
· Develop and maintain big data solutions (e.g., Spark, EMR, Hadoop) for large-scale data processing where needed.
4. Infrastructure & Automation
· Implement and manage data lake solutions with AWS S3 and associated ingestion strategies.
· Leverage Infrastructure-as-Code (e.g., CloudFormation, Terraform) to automate resource provisioning and configuration.
5. Effort Estimation & Resource Planning
· Analyze project requirements to accurately estimate the level of effort and resources needed.
· Develop realistic timelines and project plans, ensuring the team delivers solutions on schedule and within budget.
· Monitor ongoing projects against estimates, adjusting plans and resources as needed.
6. Collaboration, Engagement & Design Alignment
· Partner with analytics, product, business, and reporting teams to gather data requirements and translate them into technical solutions.
· Conduct design reviews and regularly synchronize with the reporting team to ensure data pipelines and models align with reporting dashboards and analytics needs.
· Engage with vendor solutions and external technical teams when necessary to enhance or troubleshoot data pipelines.
7. Governance & Compliance
· Implement data governance best practices, ensuring data quality, integrity, and security across pipelines.
· Collaborate with Security and Compliance teams to adhere to data privacy regulations and internal policies.
8. Performance Monitoring & Optimization
· Establish and monitor metrics for ETL performance, proactively addressing bottlenecks and performance issues.
· Continuously review and optimize Redshift cluster configurations, workload management (WLM), and query performance.
· Oversee and optimize big data workloads and streaming pipelines to manage large-scale, high-velocity data ingestion.
9. Release Planning & Deployment of the Data Platform
· Oversee the end-to-end release cycle for data platform enhancements, including scheduling, coordination, and communication with cross-functional teams.
· Ensure thorough testing, documentation, and rollback strategies are in place prior to deployment.
10. ETL Jobs Orchestration & Performance Optimization
· Manage data job orchestration using Airflow (or similar tools, e.g., Step Functions) for efficient scheduling, coordination, and monitoring of data pipelines.
· Continuously analyze and optimize ETL job performance, identifying opportunities for parallelization, resource tuning, and cost efficiency.
· Ensure Airflow DAGs are designed using best practices for error handling, retry strategies, and alerting.
11. Support for Data Ops & Priority Issue Resolution
· Collaborate closely with the Data Ops team to swiftly resolve high-priority issues, ensuring minimal impact on business operations.
· Serve as escalation point for complex data engineering challenges, providing expert guidance in troubleshooting pipeline failures.
12. Code Review & Efficient Unit Testing Practices
· Implement and enforce best practices for code reviews, ensuring adherence to quality and security standards.
· Promote efficient unit testing frameworks and methodologies to reduce defects, enhance reliability, and accelerate development cycles.
Requirements
1. Technical Expertise
· AWS Services: Deep hands-on experience with Redshift, Glue, S3, IAM, Lambda, and related data pipeline services.
· ETL/ELT Tools & Orchestration:
· Expertise in designing and managing pipelines.
· Proficiency in Airflow (preferred) or similar workflow orchestration tools.
· Familiarity with scheduling, logging, alerting, and error-handling best practices. ·
Data Modeling: Strong knowledge of schema design, dimensional modeling, and normalization best practices.
· Big Data Technologies: Experience with Spark, EMR, Hadoop, or other large-scale data processing frameworks.
· Programming Languages: Proficiency in Python, SQL; familiarity with Java/Scala is a plus.
· Version Control & CI/CD: Familiarity with Git, automated testing, and continuous integration practices.
2. Inbound & Outbound Integrations
· Demonstrated experience designing and implementing external data integrations (APIs, file-based, streaming) and delivering data feeds to downstream applications or third-party services.
· Knowledge of security and compliance best practices for external data exchange (e.g., authentication, encryption, data masking).
3. Leadership & Communication
· Demonstrated experience leading high-performing technical teams, including mentorship, performance management, and capacity planning.
· Excellent communication skills to translate complex data requirements into actionable engineering plans and vice versa.
· Proven ability to collaborate effectively with cross-functional stakeholders (Product, Analytics, Reporting, BI, etc.).
4. Project & Effort Management
· Experience managing multiple data initiatives simultaneously, prioritizing tasks, and meeting deadlines.
· Proven track record in accurately estimating project effort, mitigating risks, and staying within budget.
Benefits
- 26 days paid leave (plus bank holidays)
- Annual bonus scheme
- 2 x Life Days
- 4 x Salary of Life Insurance
- Pension: we’ll match your contribution up to 8.5%
- Single Private Health Cover
- £500 Wellness Allowance
- Income Protection
- Enhanced parental leave (maternity and paternity)
- Eye Care, Dental and Cycle To Work schemes
Data Engineering Manager
Posted 2 days ago
Job Viewed
Job Description
This is your chance to lead the charge in shaping the backbone of Virgin Red’s data capability. We’re looking for a passionate Data Engineering Manager to drive our technical vision, guide cross-functional teams, and power up the data platforms that keep our our loyalty products and systems ticking.
Our Virgin Family
Join the Virgin Group – a diverse collective driving change, enhancing customer experience, and having a blast. We're daring, disrupting industries from finance to space, united as part of the Virgin Family.
Virgin Red rewards customers who live the Virgin lifestyle. Earn Virgin Points across our vast partner network, unlocking everyday rewards and exclusive experiences. As the Virgin network hub, we foster deeper customer understanding, opening doors for partners. Bold, distinctive, customer-centric – that's Virgin Red.
We’re a huge brand, but not a huge team, which means we take a hands-on approach while thinking strategically. Everyone rolls up their sleeves to get things done, making it an exciting and collaborative place to work.
Tell me more
- Lead, grow and support a team of up to 15 engineers across multiple squads, blending strategic direction with hands-on guidance.
- Define and deliver a future-fit data engineering roadmap alongside our Principal Data Engineer.
- Drive quality and innovation across our data platform, warehouse and pipelines – ensuring scalability, security and sustainability.
- Keep engineering outcomes sharp and focused, balancing today’s delivery with tomorrow’s tech ambitions.
- Collaborate across Product, Commercial and Marketing teams, aligning data capabilities with business impact.
- Promote a culture of curiosity, inclusion and experimentation, with an eye on emerging AI opportunities.
What you’ll need
- Strong technical know-how, particularly in Python, SQL, modern data stacks (Snowflake, DBT, Spark, Airflow) and cloud platforms like AWS.
- Experience leading high-performing engineering teams with empathy and clarity.
- A knack for building scalable data solutions and making strategic tech decisions without losing sight of day-to-day pragmatism.
- Familiarity with CI/CD, DevOps, data governance and responsible AI practices.
- Strong data modelling skills – e.g. dimensional modelling
- Experience leveraging AI tooling to accelerate and automate tasks
- Experience with Data Mesh practices is a plus
- Confidence in setting direction, managing ambiguity, and bringing people with you – from engineers to execs.
- Curiosity and courage to explore the new, while delivering the now.
The extra details
Role type: Permanent
Location: London hub (approx. 1-2 days per week) & your home space
Salary: £105,000 - £123,000 plus bonus - We're putting our salaries out there for everyone to see - no smoke and mirrors, just honest numbers. We'll offer a salary that matches your skills, always aiming for room to grow.
Working hours: Full time - We embrace flexible working. Let us know what hours empower you to be at your best both professionally and personally, we’ll try to find a perfect match for you and us.
Benefits: Buckle up for an adventure with Virgin! Our benefits package isn't just a list - it's your ticket to an extraordinary career and life. Imagine unlimited leave for your globe-trotting dreams, a "Screw it, let's do it pot" to enjoy being you, and a learning budget to fuel your curiosity. We've got your back with top-notch health care, family support that goes the extra mile, and a pension plan to keep your future bright. From electric vehicles to flexible volunteering, we're not just offering a job - we're inviting you to join a community that celebrates your whole self.
Closing date: 17 September 2025
Some of the attributes that define a Virgin person just can’t be quantified in words. We pride ourselves on welcoming people from all walks of life, with all sorts of skill sets. Most recently, we successfully campaigned to add ‘Dyslexic Thinking’ as a skill on LinkedIn. We truly value passion for Purpose and Sustainability, welcoming creative thinkers and innovators. Any uniqueness is a strength and will be considered an asset to our workforce. If there is something you would like us to consider, to tailor the hiring process to the way you work best, please don’t hesitate to let us know.
Ready to turn your career into the ultimate adventure? Virgin's got the map, the compass, and the crew. Your great adventure awaits!