219 Big Data Technologies jobs in the United Kingdom

About Us

TheMathCompany or MathCo® is a global Enterprise AI and Analytics company trusted by leading Fortune 500 and Global 2000 enterprises for data-driven decision-making. Founded in 2016, MathCo builds custom AI and advanced analytics solutions to solve enterprise challenges through its hybrid model. NucliOS, MathCo’s proprietary platform, enables connected intelligence at a lower total cost of ownership (TCO).

At MathCo, we foster an open, transparent, and collaborative culture, making it a great place to work. We provide exciting growth opportunities and value capabilities and attitude over experience, enabling our Mathemagicians to 'Leave a Mark'.

Role Description

• We are seeking a Data Engineering Manager with expertise in the CPG domain and hands-on knowledge of Azure Cloud technologies. Based in the UK, you will lead client-facing programmes, guide engineering teams, and ensure scalable, modern data solutions are delivered to support supply chain, sales, and consumer analytics for global CPG clients.
• This role blends program leadership, client engagement, and technical direction, requiring someone who can translate business objectives into data strategies, coach teams, and ensure delivery excellence.

Job Responsibilities

• Leading Partner with CPG stakeholders to align data engineering solutions with supply chain, sales, and marketing priorities.
• Define solution architectures and oversee end-to-end data pipelines, ETL/ELT processes, and data platform implementations.
• Guide teams in applying best practices across Python, SQL, Databricks, and Delta Lake to deliver high-performance outcomes.
• Manage client programmes, ensuring projects are delivered on time, within scope, and aligned to strategic goals.
• Promote engineering standards, agile ways of working, and CI/CD adoption across teams.
• Act as a trusted advisor, simplifying technical concepts and communicating clearly with business stakeholders.
• Develop and maintain data pipelines using Azure ADF, Databricks, PySpark, and Delta Lake.
• Build and optimise workflows in Python and SQL to support supply chain, sales, and marketing analytics.
• Contribute to CI/CD pipelines using GitHub Actions (or similar) for deployment and testing.
• Monitor production data workflows, provide troubleshooting support, and resolve performance issues.
• Work with managers and architects to translate business requirements into technical designs and solutions.
• Apply engineering best practices including version control, testing, and code reviews.
• Document solutions and share learnings across the team

Being a Mathemagician

• Embody MathCo’s culture and way of working.
• Demonstrate ownership and strive for excellence in delivering results.
• Actively engage and contribute to initiatives fostering company growth.
• Support diversity and appreciate different perspectives.

Required Qualifications

• 8+ years of experience in data engineering, with at least 2+ years in a leadership/programme management role.
• Domain expertise in CPG analytics.
• Strong experience with Azure Data Factory, Databricks, Event Grid, Python, and SQL.
• Proven background designing and overseeing enterprise-scale pipelines and platforms.
• Familiarity with CI/CD processes (GitHub Actions or similar).
• Excellent communication, stakeholder management, and coaching skills.
• Bachelor’s degree in Computer Science, Engineering, or related field.
• Consulting background with Fortune 500/Global 2000 client delivery experience.

Recognitions

• Positioned as a Leader in Top Generative AI Service Providers – PeMa Quadrant 2023 by AIMResearch.
• Recognized among Inspiring Workplaces in North America, 2023.
• Accredited for Inclusive Practices by Great Place to Work Institute, India.
• Recognized among India’s Best Workplaces™ for Diversity, Equity, Inclusion & Belonging 2023 by Great Place To Work® India.

For more information, please visit our website.

Location: Remote (Must attend two mandatory in-person events per year)

Employment Type: Full-time

Work Arrangement: Remote

Our client, a leader in guided at-home ketamine therapy (a form of psychedelic medicine) with $50 million in funding , is seeking a Data Engineering Lead . This individual will be responsible for building the data engine that powers personalized care, scaled therapy, and measurable patient outcomes.

This role requires strong technical ownership over the data pipeline, and a deep, personal belief in psychedelic medicines and altered states of consciousness. You will drive key business decisions through deep-dive analysis and deploy AI tools to enhance their "Functional Psychiatry" approach.

• Own and evolve the data pipeline (Segment, Stitch, Snowflake, dbt) to ensure the accuracy, reliability, and trust of all metrics and dashboards across the 230-person organization.
• Modernize the data stack and event pipeline to reduce analyst turnaround times and increase data horsepower.
• Implement dbtCloud , backed with an MCP server, to enable the business team to combine AI with Mindbloom-specific data for enhanced insights.
• Conduct deep-dive analyses to drive key business decisions and answer high-impact questions from every department, including the CEO.
• Build and deploy scalable, self-serve tools that empower teams to access insights independently.
• Work closely with the Head of Engineering and Head of Health to define and launch the next major evolution of Functional Psychiatry.

Requirements

• 5+ years of experience in data engineering or analytics engineering (sweet spot is 6-8 years).
• Strong emphasis and hands-on expertise with dbt (Data Build Tool).
• Experience within a startup environment (Series C or earlier) and direct-to-consumer (D2C) experience is highly valued.
• Must possess a deep personal connection to altered states of consciousness and a belief in psychedelic medicines.
• Comfortable owning and evolving pipelines and deploying AI tools.

Benefits

• Salary: $25K - 170K (The estimated annual base salary range for this role is 125,000−$1 0,000 USD.)
• Equity: Heavily valued in the compensation package due to the company's funding and size.
• Visa Sponsorship: Not available .
• Work Policy: Fully remote, with two mandatory in-person events per year (annual company retreat and a team in-person meeting).

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.

Commitment to Equality and Accessibility:

At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing 

MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd’s Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting

The Data Engineering Manager is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business.

With strong technical skills and business acumen to help turn millions of potential data points into actionable insights that can drive product improvements, make our customer acquisition more efficient, improve our customer retention rates, and drive operating efficiencies across the business.

The primary goals of the team are:

- To build and run an data platform which can create and deliver analytics to colleagues and deliver reporting and business insights

- Ingest and transform data from multiple systems, modelling data and engineering data marts to create reusable data assets

- To create a self service BI platform, enabling colleagues across Rentokil Initial to get value from data

Main Responsibilities:

Lead a team of Data Engineers and Analysts to build and operate the Data and Analytics platform for Rentokil Initial.

This role will be pivotal to:

● Defining data principles, data architecture and data governance for the data platform

● Delivering data quality assessments and improvement plans

● Directly and indirectly, delivering key reports and analytical insight to a wide variety of stakeholders

● Supporting the data agenda with platform reporting and strategy Enable the Data Community across Rentokil Initial to get value from data and to empower local Data discovery & insights, using a self-serve framework

• Catalogue & Communicate the Data platform data sets available for use to digital product teams
• Develop report automation use cases demonstrating how migrating from traditional method improves quality of data and improves efficiency
• Explore key innovation initiatives with the business to help reimagine how we use data and find the value in our data
• Collaborate across the organisation to build solutions that serve multiple areas of the business
• Accountable for performance of 3rd party suppliers providing data analysis delivery services

Requirements

Previous experience leading a team of Software Engineers, taking responsibility for their personal development and coaching them on the behaviors needed for success.

● Prior experience of scaling/growing technology teams

● Technical leadership experience, architecting, designing and leading a team through complex software delivery projects to deliver great business outcomes

● Good understanding and track record of delivering complex data solutions using Agile methods including Scrum, SAFe etc.

● Excellent communication skills, capable of talking to people across IT and business, as well as to stakeholders at various levels of the company,

● Advanced experience in designing and creating data models

● Strong with SQL for data interrogation and transformation, a robust understanding of relational data and the ability to manipulate fact data along multiple dimensions.

● Experience with deploying solutions in Cloud (Azure, AWS, GCP), ideally GCP

● Overall business intelligence knowledge

● Experience using ETL tools to deliver data integration for batch and streaming use cases

● Willingness to self-study and learn new skills to handle any upcoming tasks,

● Hands-on experience of modern software CI/CD techniques to automate the build and deployment of data solutions

● Use of source code version control (e.g. Git, Bitbucket)

● Desirable to have experience in the exploitation of real-time processing frameworks (e.g., Apache Spark or Apache Beam) and associated business use cases

● Desirable to have experience working with BigQuery, Java and/or Python

● Experience working with and adhering to Information Security standards, support procedures and incident response

● Strong prioritisation and communication skills

Benefits

• Competitive salary and bonus scheme
• Hybrid working
• Rentokil Initial Reward Scheme
• 23 days holiday, plus 8 bank holidays
• Employee Assistance Programme
• Death in service benefit
• Healthcare
• Free parking

At Rentokil Initial, our customers and colleagues represent diverse backgrounds and experiences. We take pride in being an equal opportunity employer, actively encouraging applications from individuals from all walks of life. Our belief is that everyone irrespective of age, gender, gender identity, gender expression, ethnicity, sexual orientation, disabilities, religion, or beliefs, has the potential to thrive and contribute.

We embrace the differences that make each of our colleagues unique, fostering an inclusive environment where everyone can be their authentic selves and feel a sense of belonging. To ensure that your journey with us is accessible if you have any individual requirements we invite you to communicate any specific needs or preferences you may have during any stage of the recruitment process. Our team is available to support you; feel free to reach out to ( ) if you need anything

Be Yourself in Your Application! At Rentokil Initial, we value innovation, but we want to see the real you! While AI can help with structure and grammar, make sure your application shows your true passion and understanding of the role. A personal touch will help you stand out. 

Principal Data Engineering Consultant

Salary
: £90,000 to £110,000 per annum (depending on experience)

Location
: Remote – must be based within the UK. Occasional visits to see customers and the team.

Interview process:
Two rounds.
1:
Get to know you chat with the People Recruitment Manager ;
2:
Technical competency with the Hiring Lead and a Team Member.

Learn more about us:
YouTube
,
Totally Skewed Podcast
&
Data Science in Production
. Read our
Blogs
.

___

Who Are We?

Advancing Analytics
are a market leader in delivering pioneering analytical solutions for customers all over the world. To thrive in today's market, businesses need to implement AI built on a solid, reliable Data Platform, and we are looking for you to help us build it

Who are we looking for?

Dedicated individuals who blend technical passion with the honesty and empathy needed for client consulting. People who love data and strongly believe in sharing knowledge, skills and wisdom both internally and with the wider data community. Someone who thrives in an agile environment, balancing their technical prowess with the pragmatic needs of the project.

For the Principal Consultant role, we expect a solid understanding of our core tech stack with the ability to see the end-to-end solution across multiple concurrent projects.

Key Responsibilities:

• Microsoft Azure and cloud computing concepts
• Apache Spark – Databricks, Microsoft Fabric or another Spark engine
• Python – we build most of our solutions in Python
• SQL – writing complex high-performance queries, understanding how queries execute on different compute technologies
• Azure Data Factory or other cloud orchestration tools
• Azure Data Lake storage and Delta Lake
• Unity Catalog, Purview or other Data Governance tools
• IAC tool such as Terraform, Azure DevOps

Other technology we like, but isn't essential:

• Visualisation Tools – Power BI, Tableau
• Streaming Data – Azure Stream Analytics, Event Hubs, IoT Hubs
• Building parallel systems – Distributed compute engines
• Azure Functions – Python, C#

Skills / Approaches:

• Requirements gathering and client consulting
• Agile project management including budget and scope management
• Understanding of OO Development Practices
• ETL Approaches – Data Quality, Resilience, Observability
• Understanding of CI/CD Methodologies and SDLC

What will it be like to work for Advancing Analytics?

We are a small company and encourage everyone to have a voice within our collaborative and inclusive team from day one.

As a Microsoft Specialised Partner, Databricks Elite Partner, and AWS Partner, you will have access to the latest tech and training opportunities the industry has to offer. We are aware this is a rapidly changing market and are committed to investing in the long-term goals of our employees. We love being engaged in the wider tech community and frequently present at events, sponsor events such as Big Data London, SQLBits and organise leading community events including Databricks and Microsoft Data & AI meetups around the UK, and the Global AI Bootcamp London.

Aside from offering a competitive salary, we have a great set of benefits and perks including, but not limited to:

• Industry matching Maternity & Paternity policy
• Private Medical & Dental Care plus Eye care scheme
• Health & Wellbeing supplement
• 25 Days Annual Leave, Birthday Leave & Charity Leave
• Away days with the team
• Discretionary Annual Bonus Scheme
• Flexible Working Hours
• Electric Car Scheme

Our company values define us:

Advancing
– Being part of a team that drives innovation and pushing boundaries of what's possible. Our work redefines industry standards and challenges the status quo in the data world every day.

Come as you are
– we are an inclusive company. When you work with us, rest assured you're working in a safe environment.

Zero burnout
– We have seen it happen, and we never want to be a company that pushes our staff to breaking point.

We all level up together
– we have each seen the benefit that being part of a community can have, it is transformational.

Transparency
– We are big believers that there are no secrets in Advancing Analytics, and we try to live this day to day.

Equal opportunities for everyone

At Advancing Analytics both diversity and inclusion are a priority. We are all committed to creating an inclusive environment where everyone feels valued, respected and empowered to be their authentic selves.

We are proud to be an equal opportunity employer; all applicants will be considered without regard to age, ethnicity, religion, sex, sexual orientation, gender identity, family or parental status, national origin, neurodiversity or disability status.

This role profile is intended to provide an overview of the responsibilities and qualifications
required for the Principal Data Engineering Consultant role. It is not an exhaustive list and may be subject to change to meet the needs of the organisation.

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent

Industry: Trading / Commodities

Location: London – Hybrid (4 days in office)

Job Type: Permanent

Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making.

What You’ll Do:

• Lead and manage a global team of data engineers, providing mentorship and direction.
• Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS.
• Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets.
• Deliver new data products and services for traders, analysts, and operational teams.
• Implement and maintain data quality frameworks and best practices.
• Collaborate with front office users, including traders and research analysts, to understand data requirements.
• Partner with senior data scientists, data engineers, and application teams across the business to deliver high-impact solutions.
• Drive innovation and continuous improvement across data engineering practices.

Skills & Experience:

• Experience in data engineering roles, with proven leadership in global teams.
• Strong expertise in financial market data ingestion, ETL/ELT pipelines, data modelling, and provisioning.
• Advanced proficiency in Python and SQL.
• Hands-on experience with AWS data services (e.g. Glue, Redshift, S3, Lambda).
• Background in data quality management and scalable architecture.
• Experience engaging directly with front office users and traders.
• Exposure to energy and metals commodities, power generation, shipping, or weather-related data is desirable.
• Strong communication and stakeholder management skills, with the ability to bridge technical and business teams.

To find out more, please apply directly or connect with me on LinkedIn.