219 Big Data Technologies jobs in the United Kingdom
Data Engineering Manager
Posted 2 days ago
Job Viewed
Job Description
About Us
TheMathCompany or MathCo® is a global Enterprise AI and Analytics company trusted by leading Fortune 500 and Global 2000 enterprises for data-driven decision-making. Founded in 2016, MathCo builds custom AI and advanced analytics solutions to solve enterprise challenges through its hybrid model. NucliOS, MathCo’s proprietary platform, enables connected intelligence at a lower total cost of ownership (TCO).
At MathCo, we foster an open, transparent, and collaborative culture, making it a great place to work. We provide exciting growth opportunities and value capabilities and attitude over experience, enabling our Mathemagicians to 'Leave a Mark'.
Role Description
- We are seeking a Data Engineering Manager with expertise in the CPG domain and hands-on knowledge of Azure Cloud technologies. Based in the UK, you will lead client-facing programmes, guide engineering teams, and ensure scalable, modern data solutions are delivered to support supply chain, sales, and consumer analytics for global CPG clients.
- This role blends program leadership, client engagement, and technical direction, requiring someone who can translate business objectives into data strategies, coach teams, and ensure delivery excellence.
Job Responsibilities
- Leading Partner with CPG stakeholders to align data engineering solutions with supply chain, sales, and marketing priorities.
- Define solution architectures and oversee end-to-end data pipelines, ETL/ELT processes, and data platform implementations.
- Guide teams in applying best practices across Python, SQL, Databricks, and Delta Lake to deliver high-performance outcomes.
- Manage client programmes, ensuring projects are delivered on time, within scope, and aligned to strategic goals.
- Promote engineering standards, agile ways of working, and CI/CD adoption across teams.
- Act as a trusted advisor, simplifying technical concepts and communicating clearly with business stakeholders.
- Develop and maintain data pipelines using Azure ADF, Databricks, PySpark, and Delta Lake.
- Build and optimise workflows in Python and SQL to support supply chain, sales, and marketing analytics.
- Contribute to CI/CD pipelines using GitHub Actions (or similar) for deployment and testing.
- Monitor production data workflows, provide troubleshooting support, and resolve performance issues.
- Work with managers and architects to translate business requirements into technical designs and solutions.
- Apply engineering best practices including version control, testing, and code reviews.
- Document solutions and share learnings across the team
Being a Mathemagician
- Embody MathCo’s culture and way of working.
- Demonstrate ownership and strive for excellence in delivering results.
- Actively engage and contribute to initiatives fostering company growth.
- Support diversity and appreciate different perspectives.
Required Qualifications
- 8+ years of experience in data engineering, with at least 2+ years in a leadership/programme management role.
- Domain expertise in CPG analytics.
- Strong experience with Azure Data Factory, Databricks, Event Grid, Python, and SQL.
- Proven background designing and overseeing enterprise-scale pipelines and platforms.
- Familiarity with CI/CD processes (GitHub Actions or similar).
- Excellent communication, stakeholder management, and coaching skills.
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Consulting background with Fortune 500/Global 2000 client delivery experience.
Recognitions
- Positioned as a Leader in Top Generative AI Service Providers – PeMa Quadrant 2023 by AIMResearch.
- Recognized among Inspiring Workplaces in North America, 2023.
- Accredited for Inclusive Practices by Great Place to Work Institute, India.
- Recognized among India’s Best Workplaces™ for Diversity, Equity, Inclusion & Belonging 2023 by Great Place To Work® India.
For more information, please visit our website.
Data Engineering Manager
Posted 2 days ago
Job Viewed
Job Description
About Us
TheMathCompany or MathCo® is a global Enterprise AI and Analytics company trusted by leading Fortune 500 and Global 2000 enterprises for data-driven decision-making. Founded in 2016, MathCo builds custom AI and advanced analytics solutions to solve enterprise challenges through its hybrid model. NucliOS, MathCo’s proprietary platform, enables connected intelligence at a lower total cost of ownership (TCO).
At MathCo, we foster an open, transparent, and collaborative culture, making it a great place to work. We provide exciting growth opportunities and value capabilities and attitude over experience, enabling our Mathemagicians to 'Leave a Mark'.
Role Description
- We are seeking a Data Engineering Manager with expertise in the CPG domain and hands-on knowledge of Azure Cloud technologies. Based in the UK, you will lead client-facing programmes, guide engineering teams, and ensure scalable, modern data solutions are delivered to support supply chain, sales, and consumer analytics for global CPG clients.
- This role blends program leadership, client engagement, and technical direction, requiring someone who can translate business objectives into data strategies, coach teams, and ensure delivery excellence.
Job Responsibilities
- Leading Partner with CPG stakeholders to align data engineering solutions with supply chain, sales, and marketing priorities.
- Define solution architectures and oversee end-to-end data pipelines, ETL/ELT processes, and data platform implementations.
- Guide teams in applying best practices across Python, SQL, Databricks, and Delta Lake to deliver high-performance outcomes.
- Manage client programmes, ensuring projects are delivered on time, within scope, and aligned to strategic goals.
- Promote engineering standards, agile ways of working, and CI/CD adoption across teams.
- Act as a trusted advisor, simplifying technical concepts and communicating clearly with business stakeholders.
- Develop and maintain data pipelines using Azure ADF, Databricks, PySpark, and Delta Lake.
- Build and optimise workflows in Python and SQL to support supply chain, sales, and marketing analytics.
- Contribute to CI/CD pipelines using GitHub Actions (or similar) for deployment and testing.
- Monitor production data workflows, provide troubleshooting support, and resolve performance issues.
- Work with managers and architects to translate business requirements into technical designs and solutions.
- Apply engineering best practices including version control, testing, and code reviews.
- Document solutions and share learnings across the team
Being a Mathemagician
- Embody MathCo’s culture and way of working.
- Demonstrate ownership and strive for excellence in delivering results.
- Actively engage and contribute to initiatives fostering company growth.
- Support diversity and appreciate different perspectives.
Required Qualifications
- 8+ years of experience in data engineering, with at least 2+ years in a leadership/programme management role.
- Domain expertise in CPG analytics.
- Strong experience with Azure Data Factory, Databricks, Event Grid, Python, and SQL.
- Proven background designing and overseeing enterprise-scale pipelines and platforms.
- Familiarity with CI/CD processes (GitHub Actions or similar).
- Excellent communication, stakeholder management, and coaching skills.
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Consulting background with Fortune 500/Global 2000 client delivery experience.
Recognitions
- Positioned as a Leader in Top Generative AI Service Providers – PeMa Quadrant 2023 by AIMResearch.
- Recognized among Inspiring Workplaces in North America, 2023.
- Accredited for Inclusive Practices by Great Place to Work Institute, India.
- Recognized among India’s Best Workplaces™ for Diversity, Equity, Inclusion & Belonging 2023 by Great Place To Work® India.
For more information, please visit our website.
Manager Data Engineering
Posted 7 days ago
Job Viewed
Job Description
Would you like to ensure the successful delivery of the Data Platform and Software Innovations?
Do you enjoy creating a collaborative and customer-focused working environment?
About our team:
LexisNexis Intellectual Property, which serves customers in more than 150 countries with 11,300 employees worldwide, is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers.
About the role:
At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve their goals, we support the development of new technologies and processes that ultimately advance humanity.
As the Manager of Data Engineering at LexisNexis Intellectual Property (LNIP), you will lead and grow high-performing engineering teams responsible for delivering robust, scalable data solutions. You will provide both technical and strategic leadership - guiding development practices, overseeing project timelines and resource allocation, and ensuring high-quality, reliable delivery. You'll work closely with cross-functional teams, including product, architecture, and analytics to ensure technical execution is aligned with business priorities. Your leadership will be instrumental in driving platform evolution, enabling downstream use cases, and fostering a culture of accountability, adaptability, and engineering excellence.
Key Responsibilities:
+ Champion platform-first thinking to minimise duplication, improve scalability, and support long-term growth.
+ Communicate proactively and transparently with stakeholders to provide updates, surface risks, and align on direction.
+ Proactively manage team capacity by identifying future resourcing needs, shaping team structure, and partnering with hiring teams to plan.
+ Lead and develop high-performing data engineering teams through coaching, clear goal-setting, and regular feedback.
+ Provide technical and strategic direction to enable the delivery of scalable solutions to complex business problems.
+ Own the planning, execution, and delivery of data engineering projects, ensuring high-quality, production-ready outcomes.
+ Collaborate cross-functionally with product, architecture, and analytics teams to align delivery with business priorities.
+ Ensure people-related processes (e.g., onboarding, remote work, probation) are managed in line with HR and compliance expectations.
+ Foster a culture of continuous improvement through retrospectives, root cause analysis, and data-informed decisions.
Requirements:
+ Hands-on experience within a software development environment.
+ Proven track record of managing and scaling high-performing data engineering teams.
+ Demonstrated experience in coaching and mentoring teams in software development best practices.
+ Strong knowledge of Agile development methodologies, including CI/CD, iterative delivery, and process optimisation.
+ Experience designing, building, and operating large-scale data platforms supporting end-user products, analytics, and BI use cases via ETL processes.
+ Ability to articulate system architecture and identify gaps between current and target states.
+ Experience leading global development teams across multiple time zones.
+ Ability to foster a collaborative learning environment that encourages continuous improvement and knowledge sharing.
Nice to Have:
+ Familiarity with technologies such as Elasticsearch, Solr, PostgreSQL, Databricks, Delta Share, and Delta Lake.
+ Experience working with complex patent and litigation data models.
+ Exposure to external data sources such as DocDB, Espacenet, and USPTO.
+ Proficiency with Pandas and PySpark.
+ Knowledge of software engineering best practices and development lifecycle.
+ Experience with API design, integration, and management.
Why Join Us?
Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply.
Work in a way that works for you
We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Working for you
We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days.
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Save As You Earn share option scheme.
+ Travel Season ticket loan.
+ Electric Vehicle Scheme
+ Optional Dental Insurance
+ Maternity, paternity, and shared parental leave
+ Employee Assistance Programme
+ Access to emergency care for both the elderly and children
+ RECARES days, giving you time to support the charities and causes that matter to you.
+ Access to employee resource groups with dedicated time to volunteer.
+ Access to extensive learning and development resources
+ Access to the employee discounts scheme via Perks at Work
About our business-
At LexisNexis Intellectual Property (LNIP), we believe that whenever a person works on a patent and understands the future trajectory of a specific technology, that person has the potential to fundamentally change how society operates. We are proud to directly support and serve these innovators in their endeavours to better humankind. We enable innovators to accomplish more by helping them make informed decisions, be more productive, comply with regulations, and ultimately achieve superior results. By harnessing the latest advances in machine learning combined with expert analysis, LexisNexis Intellectual Property is disrupting how actionable insight is extracted from patent data. Information can now be accessed with efficiency, accuracy and at a speed that is just not possible by traditional methods. Our overall success is measured by how well we deliver these results .
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
EEO Know Your Rights .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Data Engineering Consultant
Posted 21 days ago
Job Viewed
Job Description
Come join us
As a member of the Data Engineering team, you'll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade's Data & AI practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft Fabric and / or Azure Databricks technologies to deliver modern, highly scalable data platforms for all our client's analytics and AI needs. Our clients look to us for innovation, which means you'll have early access to the latest technologies so you can master them and stay ahead of the curve.
Together we do what matters.
What you'll do
* Design, development, and delivery of enterprise-grade analytics solutions based on Azure and Databricks technologies
* Evangelise and evolve best practices for our clients and our team including to mentor your colleagues, supporting their personal development
* Constantly developing technical skills in the latest Azure and Databricks technologies - achieving & maintaining relevant certifications
* Working directly with high profile clients across a variety of sectors to understand their requirements and present solutions to customer sponsors
Skills and experiences
* Demonstrable end-to-end experience in Data Engineering, including large-scale projects
* Experience in working with the latest Azure technologies, such as; Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen 2), Purview, Cosmos DB, Open AI, Azure ML, AI Foundary, Kubernetes,
* Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL
* Confident communicator who is able to explain technical terms to non-technical audiences and mentor junior colleagues
* Leads small development teams: track work, manage assignments, manage capacity, etc.
About you
Characteristics that can spell success for this role
* Analytical, curious, agile
* Team player and good communicator
* Problem-solver, patient, quality-driven
* Self-motivating
* Innovative mindset
Enjoy your career
Some of the best things about working at Avanade
* Opportunity to work for Microsoft's Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
* Real-time access to technical and skilled resources globally
* Collaborate with some of the brightest "Microsoft minds"
* Build your expertise, solve problems, learn, and develop
Find out more about some of our benefits here.
A great place to work
As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.
Create a future for our people that focuses on
- Expanding your thinking - Experimenting courageously - Learning and pivoting
Inspire greatness in our people by
- Empowering every voice - Encouraging boldness - Celebrating progress
Accelerate the impact of our people by
- Amazing the client - Prioritizing what matters - Acting as one
Learn more
To learn more about the types of projects our Data Engineering team works on check out these case studies:
* thyssenkrupp Materials Services uses data to help strike a delicate operational balance
* What matters to SSE Renewables is innovating for a sustainable future
Interested in knowing what's going on inside Avanade? Check out our blogs:
* Avanade Insights - exchange ideas that drive tomorrow's innovation
* Inside Avanade - explore what life is like working at Avanade
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.
Data Engineering Lead

Posted 7 days ago
Job Viewed
Job Description
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
EEO Know Your Rights .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Data Engineering Lead

Posted 7 days ago
Job Viewed
Job Description
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
EEO Know Your Rights .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Data Engineering Lead
Posted 13 days ago
Job Viewed
Job Description
Location: Remote (Must attend two mandatory in-person events per year)
Employment Type: Full-time
Work Arrangement: Remote
About the RoleOur client, a leader in guided at-home ketamine therapy (a form of psychedelic medicine) with $50 million in funding , is seeking a Data Engineering Lead . This individual will be responsible for building the data engine that powers personalized care, scaled therapy, and measurable patient outcomes.
This role requires strong technical ownership over the data pipeline, and a deep, personal belief in psychedelic medicines and altered states of consciousness. You will drive key business decisions through deep-dive analysis and deploy AI tools to enhance their "Functional Psychiatry" approach.
What You'll Do- Own and evolve the data pipeline (Segment, Stitch, Snowflake, dbt) to ensure the accuracy, reliability, and trust of all metrics and dashboards across the 230-person organization.
- Modernize the data stack and event pipeline to reduce analyst turnaround times and increase data horsepower.
- Implement dbtCloud , backed with an MCP server, to enable the business team to combine AI with Mindbloom-specific data for enhanced insights.
- Conduct deep-dive analyses to drive key business decisions and answer high-impact questions from every department, including the CEO.
- Build and deploy scalable, self-serve tools that empower teams to access insights independently.
- Work closely with the Head of Engineering and Head of Health to define and launch the next major evolution of Functional Psychiatry.
Requirements
- 5+ years of experience in data engineering or analytics engineering (sweet spot is 6-8 years).
- Strong emphasis and hands-on expertise with dbt (Data Build Tool).
- Experience within a startup environment (Series C or earlier) and direct-to-consumer (D2C) experience is highly valued.
- Must possess a deep personal connection to altered states of consciousness and a belief in psychedelic medicines.
- Comfortable owning and evolving pipelines and deploying AI tools.
Benefits
- Salary: $25K - 170K (The estimated annual base salary range for this role is 125,000−$1 0,000 USD.)
- Equity: Heavily valued in the compensation package due to the company's funding and size.
- Visa Sponsorship: Not available .
- Work Policy: Fully remote, with two mandatory in-person events per year (annual company retreat and a team in-person meeting).
Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.
Commitment to Equality and Accessibility:
At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing
MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd’s Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting
Be The First To Know
About the latest Big data technologies Jobs in United Kingdom !
Data Engineering Manager
Posted 22 days ago
Job Viewed
Job Description
The Data Engineering Manager is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business.
With strong technical skills and business acumen to help turn millions of potential data points into actionable insights that can drive product improvements, make our customer acquisition more efficient, improve our customer retention rates, and drive operating efficiencies across the business.
The primary goals of the team are:
- To build and run an data platform which can create and deliver analytics to colleagues and deliver reporting and business insights
- Ingest and transform data from multiple systems, modelling data and engineering data marts to create reusable data assets
- To create a self service BI platform, enabling colleagues across Rentokil Initial to get value from data
Main Responsibilities:
Lead a team of Data Engineers and Analysts to build and operate the Data and Analytics platform for Rentokil Initial.
This role will be pivotal to:
● Defining data principles, data architecture and data governance for the data platform
● Delivering data quality assessments and improvement plans
● Directly and indirectly, delivering key reports and analytical insight to a wide variety of stakeholders
● Supporting the data agenda with platform reporting and strategy Enable the Data Community across Rentokil Initial to get value from data and to empower local Data discovery & insights, using a self-serve framework
- Catalogue & Communicate the Data platform data sets available for use to digital product teams
- Develop report automation use cases demonstrating how migrating from traditional method improves quality of data and improves efficiency
- Explore key innovation initiatives with the business to help reimagine how we use data and find the value in our data
- Collaborate across the organisation to build solutions that serve multiple areas of the business
- Accountable for performance of 3rd party suppliers providing data analysis delivery services
Requirements
Previous experience leading a team of Software Engineers, taking responsibility for their personal development and coaching them on the behaviors needed for success.
● Prior experience of scaling/growing technology teams
● Technical leadership experience, architecting, designing and leading a team through complex software delivery projects to deliver great business outcomes
● Good understanding and track record of delivering complex data solutions using Agile methods including Scrum, SAFe etc.
● Excellent communication skills, capable of talking to people across IT and business, as well as to stakeholders at various levels of the company,
● Advanced experience in designing and creating data models
● Strong with SQL for data interrogation and transformation, a robust understanding of relational data and the ability to manipulate fact data along multiple dimensions.
● Experience with deploying solutions in Cloud (Azure, AWS, GCP), ideally GCP
● Overall business intelligence knowledge
● Experience using ETL tools to deliver data integration for batch and streaming use cases
● Willingness to self-study and learn new skills to handle any upcoming tasks,
● Hands-on experience of modern software CI/CD techniques to automate the build and deployment of data solutions
● Use of source code version control (e.g. Git, Bitbucket)
● Desirable to have experience in the exploitation of real-time processing frameworks (e.g., Apache Spark or Apache Beam) and associated business use cases
● Desirable to have experience working with BigQuery, Java and/or Python
● Experience working with and adhering to Information Security standards, support procedures and incident response
● Strong prioritisation and communication skills
Benefits
- Competitive salary and bonus scheme
- Hybrid working
- Rentokil Initial Reward Scheme
- 23 days holiday, plus 8 bank holidays
- Employee Assistance Programme
- Death in service benefit
- Healthcare
- Free parking
At Rentokil Initial, our customers and colleagues represent diverse backgrounds and experiences. We take pride in being an equal opportunity employer, actively encouraging applications from individuals from all walks of life. Our belief is that everyone irrespective of age, gender, gender identity, gender expression, ethnicity, sexual orientation, disabilities, religion, or beliefs, has the potential to thrive and contribute.
We embrace the differences that make each of our colleagues unique, fostering an inclusive environment where everyone can be their authentic selves and feel a sense of belonging. To ensure that your journey with us is accessible if you have any individual requirements we invite you to communicate any specific needs or preferences you may have during any stage of the recruitment process. Our team is available to support you; feel free to reach out to ( ) if you need anything
Be Yourself in Your Application! At Rentokil Initial, we value innovation, but we want to see the real you! While AI can help with structure and grammar, make sure your application shows your true passion and understanding of the role. A personal touch will help you stand out.
Principal Data Engineering Consultant
Posted today
Job Viewed
Job Description
Principal Data Engineering Consultant
Salary
: £90,000 to £110,000 per annum (depending on experience)
Location
: Remote – must be based within the UK. Occasional visits to see customers and the team.
Interview process:
Two rounds.
1:
Get to know you chat with the People Recruitment Manager ;
2:
Technical competency with the Hiring Lead and a Team Member.
Learn more about us:
YouTube
,
Totally Skewed Podcast
&
Data Science in Production
. Read our
Blogs
.
___
Who Are We?
Advancing Analytics
are a market leader in delivering pioneering analytical solutions for customers all over the world. To thrive in today's market, businesses need to implement AI built on a solid, reliable Data Platform, and we are looking for you to help us build it
Who are we looking for?
Dedicated individuals who blend technical passion with the honesty and empathy needed for client consulting. People who love data and strongly believe in sharing knowledge, skills and wisdom both internally and with the wider data community. Someone who thrives in an agile environment, balancing their technical prowess with the pragmatic needs of the project.
For the Principal Consultant role, we expect a solid understanding of our core tech stack with the ability to see the end-to-end solution across multiple concurrent projects.
Key Responsibilities:
- Microsoft Azure and cloud computing concepts
- Apache Spark – Databricks, Microsoft Fabric or another Spark engine
- Python – we build most of our solutions in Python
- SQL – writing complex high-performance queries, understanding how queries execute on different compute technologies
- Azure Data Factory or other cloud orchestration tools
- Azure Data Lake storage and Delta Lake
- Unity Catalog, Purview or other Data Governance tools
- IAC tool such as Terraform, Azure DevOps
Other technology we like, but isn't essential:
- Visualisation Tools – Power BI, Tableau
- Streaming Data – Azure Stream Analytics, Event Hubs, IoT Hubs
- Building parallel systems – Distributed compute engines
- Azure Functions – Python, C#
Skills / Approaches:
- Requirements gathering and client consulting
- Agile project management including budget and scope management
- Understanding of OO Development Practices
- ETL Approaches – Data Quality, Resilience, Observability
- Understanding of CI/CD Methodologies and SDLC
What will it be like to work for Advancing Analytics?
We are a small company and encourage everyone to have a voice within our collaborative and inclusive team from day one.
As a Microsoft Specialised Partner, Databricks Elite Partner, and AWS Partner, you will have access to the latest tech and training opportunities the industry has to offer. We are aware this is a rapidly changing market and are committed to investing in the long-term goals of our employees. We love being engaged in the wider tech community and frequently present at events, sponsor events such as Big Data London, SQLBits and organise leading community events including Databricks and Microsoft Data & AI meetups around the UK, and the Global AI Bootcamp London.
Aside from offering a competitive salary, we have a great set of benefits and perks including, but not limited to:
- Industry matching Maternity & Paternity policy
- Private Medical & Dental Care plus Eye care scheme
- Health & Wellbeing supplement
- 25 Days Annual Leave, Birthday Leave & Charity Leave
- Away days with the team
- Discretionary Annual Bonus Scheme
- Flexible Working Hours
- Electric Car Scheme
Our company values define us:
Advancing
– Being part of a team that drives innovation and pushing boundaries of what's possible. Our work redefines industry standards and challenges the status quo in the data world every day.
Come as you are
– we are an inclusive company. When you work with us, rest assured you're working in a safe environment.
Zero burnout
– We have seen it happen, and we never want to be a company that pushes our staff to breaking point.
We all level up together
– we have each seen the benefit that being part of a community can have, it is transformational.
Transparency
– We are big believers that there are no secrets in Advancing Analytics, and we try to live this day to day.
Equal opportunities for everyone
At Advancing Analytics both diversity and inclusion are a priority. We are all committed to creating an inclusive environment where everyone feels valued, respected and empowered to be their authentic selves.
We are proud to be an equal opportunity employer; all applicants will be considered without regard to age, ethnicity, religion, sex, sexual orientation, gender identity, family or parental status, national origin, neurodiversity or disability status.
This role profile is intended to provide an overview of the responsibilities and qualifications
required for the Principal Data Engineering Consultant role. It is not an exhaustive list and may be subject to change to meet the needs of the organisation.
Head of Data Engineering
Posted 2 days ago
Job Viewed
Job Description
Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent
Industry: Trading / Commodities
Location: London – Hybrid (4 days in office)
Job Type: Permanent
Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making.
What You’ll Do:
- Lead and manage a global team of data engineers, providing mentorship and direction.
- Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS.
- Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets.
- Deliver new data products and services for traders, analysts, and operational teams.
- Implement and maintain data quality frameworks and best practices.
- Collaborate with front office users, including traders and research analysts, to understand data requirements.
- Partner with senior data scientists, data engineers, and application teams across the business to deliver high-impact solutions.
- Drive innovation and continuous improvement across data engineering practices.
Skills & Experience:
- Experience in data engineering roles, with proven leadership in global teams.
- Strong expertise in financial market data ingestion, ETL/ELT pipelines, data modelling, and provisioning.
- Advanced proficiency in Python and SQL.
- Hands-on experience with AWS data services (e.g. Glue, Redshift, S3, Lambda).
- Background in data quality management and scalable architecture.
- Experience engaging directly with front office users and traders.
- Exposure to energy and metals commodities, power generation, shipping, or weather-related data is desirable.
- Strong communication and stakeholder management skills, with the ability to bridge technical and business teams.
To find out more, please apply directly or connect with me on LinkedIn.