40 Etl Processes jobs in London

About Us TheMathCompany or MathCo® is a global Enterprise AI and Analytics company trusted by leading Fortune 500 and Global 2000 enterprises for data-driven decision-making. Founded in 2016, MathCo builds custom AI and advanced analytics solutions to solve enterprise challenges through its hybrid model. NucliOS, MathCo’s proprietary platform, enables connected intelligence at a lower total cost of ownership (TCO). At MathCo, we foster an open, transparent, and collaborative culture, making it a great place to work. We provide exciting growth opportunities and value capabilities and attitude over experience, enabling our Mathemagicians to 'Leave a Mark'. Role Description We are seeking a Data Engineering Manager with expertise in the CPG domain and hands-on knowledge of Azure Cloud technologies. Based in the UK, you will lead client-facing programmes, guide engineering teams, and ensure scalable, modern data solutions are delivered to support supply chain, sales, and consumer analytics for global CPG clients. This role blends program leadership, client engagement, and technical direction, requiring someone who can translate business objectives into data strategies, coach teams, and ensure delivery excellence. Job Responsibilities Leading Partner with CPG stakeholders to align data engineering solutions with supply chain, sales, and marketing priorities. Define solution architectures and oversee end-to-end data pipelines, ETL/ELT processes, and data platform implementations. Guide teams in applying best practices across Python, SQL, Databricks, and Delta Lake to deliver high-performance outcomes. Manage client programmes, ensuring projects are delivered on time, within scope, and aligned to strategic goals. Promote engineering standards, agile ways of working, and CI/CD adoption across teams. Act as a trusted advisor, simplifying technical concepts and communicating clearly with business stakeholders. Develop and maintain data pipelines using Azure ADF, Databricks, PySpark, and Delta Lake. Build and optimise workflows in Python and SQL to support supply chain, sales, and marketing analytics. Contribute to CI/CD pipelines using GitHub Actions (or similar) for deployment and testing. Monitor production data workflows, provide troubleshooting support, and resolve performance issues. Work with managers and architects to translate business requirements into technical designs and solutions. Apply engineering best practices including version control, testing, and code reviews. Document solutions and share learnings across the team Being a Mathemagician Embody MathCo’s culture and way of working. Demonstrate ownership and strive for excellence in delivering results. Actively engage and contribute to initiatives fostering company growth. Support diversity and appreciate different perspectives. Required Qualifications 8 years of experience in data engineering, with at least 2 years in a leadership/programme management role. Domain expertise in CPG analytics. Strong experience with Azure Data Factory, Databricks, Event Grid, Python, and SQL. Proven background designing and overseeing enterprise-scale pipelines and platforms. Familiarity with CI/CD processes (GitHub Actions or similar). Excellent communication, stakeholder management, and coaching skills. Bachelor’s degree in Computer Science, Engineering, or related field. Consulting background with Fortune 500/Global 2000 client delivery experience. Recognitions Positioned as a Leader in Top Generative AI Service Providers – PeMa Quadrant 2023 by AIMResearch. Recognized among Inspiring Workplaces in North America, 2023. Accredited for Inclusive Practices by Great Place to Work Institute, India. Recognized among India’s Best Workplaces™ for Diversity, Equity, Inclusion & Belonging 2023 by Great Place To Work® India. For more information, please visit our website.

Manager - Data Engineering
Would you like to ensure the successful delivery of the Data Platform and Software Innovations?
Do you enjoy creating a collaborative and customer-focused working environment?
About our team:
LexisNexis Intellectual Property, which serves customers in more than 150 countries with 11,300 employees worldwide, is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers.
About the role:
At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve their goals, we support the development of new technologies and processes that ultimately advance humanity.
As the Manager of Data Engineering at LexisNexis Intellectual Property (LNIP), you will lead and grow high-performing engineering teams responsible for delivering robust, scalable data solutions. You will provide both technical and strategic leadership - guiding development practices, overseeing project timelines and resource allocation, and ensuring high-quality, reliable delivery. You'll work closely with cross-functional teams, including product, architecture, and analytics to ensure technical execution is aligned with business priorities. Your leadership will be instrumental in driving platform evolution, enabling downstream use cases, and fostering a culture of accountability, adaptability, and engineering excellence.
Key Responsibilities:
+ Champion platform-first thinking to minimise duplication, improve scalability, and support long-term growth.
+ Communicate proactively and transparently with stakeholders to provide updates, surface risks, and align on direction.
+ Proactively manage team capacity by identifying future resourcing needs, shaping team structure, and partnering with hiring teams to plan.
+ Lead and develop high-performing data engineering teams through coaching, clear goal-setting, and regular feedback.
+ Provide technical and strategic direction to enable the delivery of scalable solutions to complex business problems.
+ Own the planning, execution, and delivery of data engineering projects, ensuring high-quality, production-ready outcomes.
+ Collaborate cross-functionally with product, architecture, and analytics teams to align delivery with business priorities.
+ Ensure people-related processes (e.g., onboarding, remote work, probation) are managed in line with HR and compliance expectations.
+ Foster a culture of continuous improvement through retrospectives, root cause analysis, and data-informed decisions.
Requirements:
+ Hands-on experience within a software development environment.
+ Proven track record of managing and scaling high-performing data engineering teams.
+ Demonstrated experience in coaching and mentoring teams in software development best practices.
+ Strong knowledge of Agile development methodologies, including CI/CD, iterative delivery, and process optimisation.
+ Experience designing, building, and operating large-scale data platforms supporting end-user products, analytics, and BI use cases via ETL processes.
+ Ability to articulate system architecture and identify gaps between current and target states.
+ Experience leading global development teams across multiple time zones.
+ Ability to foster a collaborative learning environment that encourages continuous improvement and knowledge sharing.
Nice to Have:
+ Familiarity with technologies such as Elasticsearch, Solr, PostgreSQL, Databricks, Delta Share, and Delta Lake.
+ Experience working with complex patent and litigation data models.
+ Exposure to external data sources such as DocDB, Espacenet, and USPTO.
+ Proficiency with Pandas and PySpark.
+ Knowledge of software engineering best practices and development lifecycle.
+ Experience with API design, integration, and management.
Why Join Us?
Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply.
Work in a way that works for you
We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.
Working for you
We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days.
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Save As You Earn share option scheme.
+ Travel Season ticket loan.
+ Electric Vehicle Scheme
+ Optional Dental Insurance
+ Maternity, paternity, and shared parental leave
+ Employee Assistance Programme
+ Access to emergency care for both the elderly and children
+ RECARES days, giving you time to support the charities and causes that matter to you.
+ Access to employee resource groups with dedicated time to volunteer.
+ Access to extensive learning and development resources
+ Access to the employee discounts scheme via Perks at Work
About our business-
At LexisNexis Intellectual Property (LNIP), we believe that whenever a person works on a patent and understands the future trajectory of a specific technology, that person has the potential to fundamentally change how society operates. We are proud to directly support and serve these innovators in their endeavours to better humankind. We enable innovators to accomplish more by helping them make informed decisions, be more productive, comply with regulations, and ultimately achieve superior results. By harnessing the latest advances in machine learning combined with expert analysis, LexisNexis Intellectual Property is disrupting how actionable insight is extracted from patent data. Information can now be accessed with efficiency, accuracy and at a speed that is just not possible by traditional methods. Our overall success is measured by how well we deliver these results .
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
EEO Know Your Rights .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.

Our talented Data Engineering team is made up of globally recognised experts - and there's room for more analytical, innovative, client-driven data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let's talk. Take your skills to a new level and launch a career where you can truly do what matters.
Come join us
As a member of the Data Engineering team, you'll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade's Data & AI practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft Fabric and / or Azure Databricks technologies to deliver modern, highly scalable data platforms for all our client's analytics and AI needs. Our clients look to us for innovation, which means you'll have early access to the latest technologies so you can master them and stay ahead of the curve.
Together we do what matters.
What you'll do
* Design, development, and delivery of enterprise-grade analytics solutions based on Azure and Databricks technologies
* Evangelise and evolve best practices for our clients and our team including to mentor your colleagues, supporting their personal development
* Constantly developing technical skills in the latest Azure and Databricks technologies - achieving & maintaining relevant certifications
* Working directly with high profile clients across a variety of sectors to understand their requirements and present solutions to customer sponsors
Skills and experiences
* Demonstrable end-to-end experience in Data Engineering, including large-scale projects
* Experience in working with the latest Azure technologies, such as; Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen 2), Purview, Cosmos DB, Open AI, Azure ML, AI Foundary, Kubernetes,
* Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL
* Confident communicator who is able to explain technical terms to non-technical audiences and mentor junior colleagues
* Leads small development teams: track work, manage assignments, manage capacity, etc.
About you
Characteristics that can spell success for this role
* Analytical, curious, agile
* Team player and good communicator
* Problem-solver, patient, quality-driven
* Self-motivating
* Innovative mindset
Enjoy your career
Some of the best things about working at Avanade
* Opportunity to work for Microsoft's Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
* Real-time access to technical and skilled resources globally
* Collaborate with some of the brightest "Microsoft minds"
* Build your expertise, solve problems, learn, and develop
Find out more about some of our benefits here.
A great place to work
As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.
Create a future for our people that focuses on
- Expanding your thinking - Experimenting courageously - Learning and pivoting
Inspire greatness in our people by
- Empowering every voice - Encouraging boldness - Celebrating progress
Accelerate the impact of our people by
- Amazing the client - Prioritizing what matters - Acting as one
Learn more
To learn more about the types of projects our Data Engineering team works on check out these case studies:
* thyssenkrupp Materials Services uses data to help strike a delicate operational balance
* What matters to SSE Renewables is innovating for a sustainable future
Interested in knowing what's going on inside Avanade? Check out our blogs:
* Avanade Insights - exchange ideas that drive tomorrow's innovation
* Inside Avanade - explore what life is like working at Avanade
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.

Data Engineering Lead
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.  
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you  
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.  
+ Working remotely from home or in our office in a flexible hybrid style 
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive 
Working with us  
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.  
Working for you  
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:  
+ Generous holiday allowance with the option to buy additional days 
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year  
+ Health screening, eye care vouchers and private medical benefits 
+ Wellbeing programs 
+ Life assurance 
+ Access to a competitive contributory pension scheme 
+ Long service awards 
+ Save As You Earn share option scheme 
+ Travel Season ticket loan 
+ Maternity, paternity and shared parental leave 
+ Access to emergency care for both the elderly and children 
+ RELX Cares days, giving you time to support the charities and causes that matter to you 
+ Access to employee resource groups with dedicated time to volunteer 
+ Access to extensive learning and development resources 
+ Access to employee discounts via Perks at Work 
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact .
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here .
Please read our Candidate Privacy Policy .
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers:
EEO Know Your Rights .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.

Data Engineering Lead (Psychedelic Therapy)

Location: Remote (Must attend two mandatory in-person events per year)

Employment Type: Full-time

Work Arrangement: Remote

About the Role

Our client, a leader in guided at-home ketamine therapy (a form of psychedelic medicine) with $50 million in funding , is seeking a Data Engineering Lead . This individual will be responsible for building the data engine that powers personalized care, scaled therapy, and measurable patient outcomes.

This role requires strong technical ownership over the data pipeline, and a deep, personal belief in psychedelic medicines and altered states of consciousness. You will drive key business decisions through deep-dive analysis and deploy AI tools to enhance their "Functional Psychiatry" approach.

What You'll Do

• Own and evolve the data pipeline (Segment, Stitch, Snowflake, dbt) to ensure the accuracy, reliability, and trust of all metrics and dashboards across the 230-person organization.
• Modernize the data stack and event pipeline to reduce analyst turnaround times and increase data horsepower.
• Implement dbtCloud , backed with an MCP server, to enable the business team to combine AI with Mindbloom-specific data for enhanced insights.
• Conduct deep-dive analyses to drive key business decisions and answer high-impact questions from every department, including the CEO.
• Build and deploy scalable, self-serve tools that empower teams to access insights independently.
• Work closely with the Head of Engineering and Head of Health to define and launch the next major evolution of Functional Psychiatry.

Requirements

• 5+ years of experience in data engineering or analytics engineering (sweet spot is 6-8 years).
• Strong emphasis and hands-on expertise with dbt (Data Build Tool).
• Experience within a startup environment (Series C or earlier) and direct-to-consumer (D2C) experience is highly valued.
• Must possess a deep personal connection to altered states of consciousness and a belief in psychedelic medicines.
• Comfortable owning and evolving pipelines and deploying AI tools.

Benefits

• Salary: $25K - 170K (The estimated annual base salary range for this role is 125,000−$1 0,000 USD.)
• Equity: Heavily valued in the compensation package due to the company's funding and size.
• Visa Sponsorship: Not available .
• Work Policy: Fully remote, with two mandatory in-person events per year (annual company retreat and a team in-person meeting).

Due to the high volume of applications we anticipate, we regret that we are unable to provide individual feedback to all candidates. If you do not hear back from us within 4 weeks of your application, please assume that you have not been successful on this occasion. We genuinely appreciate your interest and wish you the best in your job search.

Commitment to Equality and Accessibility:

At MLabs, we are committed to offer equal opportunities to all candidates. We ensure no discrimination, accessible job adverts, and providing information in accessible formats. Our goal is to foster a diverse, inclusive workplace with equal opportunities for all. If you need any reasonable adjustments during any part of the hiring process or you would like to see the job-advert in an accessible format please let us know at the earliest opportunity by emailing 

MLabs Ltd collects and processes the personal information you provide such as your contact details, work history, resume, and other relevant data for recruitment purposes only. This information is managed securely in accordance with MLabs Ltd’s Privacy Policy and Information Security Policy, and in compliance with applicable data protection laws. Your data may be shared only with clients and trusted partners where necessary for recruitment purposes. You may request the deletion of your data or withdraw your consent at any time by contacting

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading / Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data requirements. Partner with senior data scientists, data engineers, and application teams across the business to deliver high-impact solutions. Drive innovation and continuous improvement across data engineering practices. Skills & Experience: Experience in data engineering roles, with proven leadership in global teams. Strong expertise in financial market data ingestion, ETL/ELT pipelines, data modelling, and provisioning. Advanced proficiency in Python and SQL. Hands-on experience with AWS data services (e.g. Glue, Redshift, S3, Lambda). Background in data quality management and scalable architecture. Experience engaging directly with front office users and traders. Exposure to energy and metals commodities, power generation, shipping, or weather-related data is desirable. Strong communication and stakeholder management skills, with the ability to bridge technical and business teams. To find out more, please apply directly or connect with me on LinkedIn.

Global Head of Data Engineering | Base Salary & uncapped Bonus | London | Permanent Industry: Trading / Commodities Location: London – Hybrid (4 days in office) Job Type: Permanent Our client is seeking a Global Head of Data Engineering to oversee the development and optimisation of their enterprise data platform in a front office trading environment. You’ll lead a distributed team of data engineers, ensuring the seamless ingestion, management, and delivery of high-quality market, economic, and commercial data to power trading, research, and operational decision-making. What You’ll Do: Lead and manage a global team of data engineers, providing mentorship and direction. Oversee the design, build, and ongoing enhancement of an enterprise data platform on AWS. Develop and scale robust ETL/ELT pipelines for the ingestion of financial market, commodity, and commercial datasets. Deliver new data products and services for traders, analysts, and operational teams. Implement and maintain data quality frameworks and best practices. Collaborate with front office users, including traders and research analysts, to understand data requirements. Partner with senior data scientists, data engineers, and application teams across the business to deliver high-impact solutions. Drive innovation and continuous improvement across data engineering practices. Skills & Experience: Experience in data engineering roles, with proven leadership in global teams. Strong expertise in financial market data ingestion, ETL/ELT pipelines, data modelling, and provisioning. Advanced proficiency in Python and SQL. Hands-on experience with AWS data services (e.g. Glue, Redshift, S3, Lambda). Background in data quality management and scalable architecture. Experience engaging directly with front office users and traders. Exposure to energy and metals commodities, power generation, shipping, or weather-related data is desirable. Strong communication and stakeholder management skills, with the ability to bridge technical and business teams. To find out more, please apply directly or connect with me on LinkedIn.