120 Data Platform Engineer jobs in London

Lyst is a global fashion shopping platform founded in London in 2010 and catering to over 160M shoppers per year. We offer our customers the largest assortment of premium & luxury fashion products in one place, curating pieces from 27,000 of the world's leading brands and stores. In 2025, Lyst joined Zozo, operators of Zozotown, the leading fashion e-commerce platform in Japan. This partnership marks a bold new era for Lyst, as we accelerate our vision and work together to transform the future of fashion shopping through AI and technology. 

At Lyst, we obsess over the customer, providing a search & discovery experience which offers inspiration, fulfilment, and personalisation. We believe that fashion is amazing but shopping for fashion often isn't, and use our technology, data and creativity to bring more joy, greater choice and fewer fails. Our mission is to help fashion shoppers make better choices and help fashion partners find better audiences as the category-leading destination for every fashion shopper.

The Role

Lyst is looking for a Software Engineer to join their Data Platform team. The engineer will help build upon and improve our customer facing analytics ingestion pipelines that power our business intelligence and decision making.

You will work in a fast-paced environment with a high level of autonomy. While your work will be peer reviewed and subject to approvals, it is important that you are able to liaise with both team members and wider partners in the organisation to gather requirements and lead on appropriate solutions.

You will be maintaining and improving a system that handles a high volume of traffic so experience with cloud and data warehouse infrastructure will help you in this role (we use AWS, Cloudflare and snowflake). Familiarity with infrastructure as code will also help when updating our cloud architecture (we use terraform).

We place a large focus on data quality so you'll be expected to review the small picture (data contracts via versioned schemas) and the wider picture (data integrity and data completeness across tables and databases). We also value the ability for team members to think of ways we can improve data quality and drive those initiatives across the business.

Within the first three months, you will be able to:

• Contribute to every part of our system, ranging from code and tests to infrastructure changes.
• Ensure the stability of our system by implementing and improving monitoring and observability tools.
• Write resilient code that is well tested.
• Be curious — not just the code, but the architecture of our platforms and everything that enables the business to thrive.
• Gain expertise over our tools and services: Python, Docker, Github Actions, Snowflake, AWS
• Participate in all team ceremonies and have direct input in the team's ways of working.

This is a high-trust, supportive, and collaborative environment where you will have plenty of opportunities to make an impact on your team and the wider company. We value attitude as much as we do direct experience—we want to hire people to grow into the role and beyond.

About the team:

• Python is our bread and butter.
• The wider data platform team uses dbt, Snowflake, and Looker to model, transform, and expose data for analytics and reporting across the business.
• We use Docker and Kubernetes to manage our production services.
• We use Github Actions for continuous integration and deployment. Lyst deploys new changes to production more than 500 times a month.
• The Data Platform team is one of Lyst's fundamental teams, and the data we manage is critical for the business. We have a strong relationship across the rest of the organisation, and almost all of Lyst engineering engages with us on a regular basis.
• We care about robustness and integrity in our pipelines and use observability tools to monitor.

Requirements

• Experience in developing robust and secure software solutions and data pipelines. 
• Effective communication skills, comfortable working with technical and non-technical individuals and teams.
• Proficiency in developing with Python.
• Experience with delivering software solutions and data pipelines within public cloud technologies and architecture (perferably AWS exp).
• Experience with containers (Docker) and container orchastration.
• Experience with Infrastructure as Code (we use Terraform).
• Experience utilising monitoring, observability and logging tools.
• Experience with git, gitOps, github actions.
• Exposure or experience with cloud data warehouse/data platforms (we use Snowflake). 

Things that matter to us:

• You have a passion for utilising your software engineering skills in data engineering.
• You enjoy building sustainable, robust software that scales and automate and drive efficiencies at every chance.
• You are excited to learn and equally share your knowledge with peers.
• You enjoy problem solving as an individual but also solving problems within a team or with wider colaboration across teams.
• You take pride in code ownership and maintaining responsibilities to a high level with good documentation and test coverage.
• You understand the importance of good Data management practices and broader Data Governance principles and their impact on things like Data Quality. 
• You effectively support and maintain production data pipelines, ensuring monitoring and observability is in place and respond to sustain service levels and data consistency within Data platforms.

Benefits

• Our Ways of Working: We all come into the office on Tuesdays and Thursdays , with the option to work remotely or come into the office on the other days. We believe that in person collaboration and community spirit is super important, which is why we spend some of our time in the office and some of our time at home.
• Time Off: In addition to the 8 statutory

About BMLL

We are the leading independent provider of harmonized Level 3 historical data and analytics to the world’s most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 order book data and advanced analytics, enabling them to accelerate research, optimize trading strategies and generate alpha at unparalleled speed and scale.

Our culture is inclusive and highly collaborative, with a flat management structure that empowers our employees to get involved in decision making as we continue to grow and scale.  We give all our employees share options so they participate in the growth and development of the business.

We offer a combination of remote and office (London based) working, weekly team lunches and plenty of office snacks!

For more information, please visit our website, or visit our Twitter, @bmlltech or LinkedIn, @BMLL.

About the Role

At BMLL, we process terabytes of historical market data every day, for which we have a powerful data processing platform built on AWS to provide best-in-class capacity, scalability and reliability.

We are looking for a Data Platform Engineer to join BMLL's Core Engineering team, where you'll architect the core platform in which BMLL's development teams execute highly complex data pipelines. You'll design and build solutions that scale compute to millions of concurrent job executions, optimised to meet performance, efficiency and cost-effectiveness requirements, while ensuring high availability.

Data Platform Engineers bridge the gap between software and infrastructure, and are essential to the success of BMLL's technology strategy.

Responsibilities

• Design and build software solutions to scale AWS compute resources to meet application performance requirements.
• Ensure 24/7 system reliability by implementing company and industry best practices in replication, redundancy and monitoring.
• Implement workflow management software, to automate operational tasks and optimise the utilisation of infrastructure and applications.
• Design and implement CI/CD workflows to maintain software quality via continuous and automated deployment and testing.
• Work with development and operations teams to design solutions to complex problems, involving large data pipelines that process terabytes of historical market data, in the most efficient and cost-effective manner.
• Regularly review and assess new tools that become available in the industry and assess how they could be integrated into the platform to continuously improve.

Requirements

Essential

• Industry experience with cloud computing tools and services in complex systems, preferably in AWS.
• Strong Python programming skills.
• Industry experience with software development lifecycle processes and tools.
• Experience working in a Linux environment.
• Experience with Docker.
• Experience with SQL and relational databases.
• Avid learner, problem solver and detail-orientated.
• Excellent teamwork and the ability to communicate and work in multidisciplinary teams in a collaborative manner.
• Computer science or other STEM degree.
• At least two years of industry experience.

Desirable

• Familiarity with distributed systems concepts and tools, such as Spark, Ray, RabbitMQ, Kafka, AWS Batch.
• Familiarity with DevOps practices and tools, such as Terraform.
• Familiarity with job execution and orchestration tools, such as Celery and Airflow.

Benefits

• Competitive salary

• 25 days holiday plus

About Us  

YouLend is the preferred global embedded financing platform for many of the world’s leading e-commerce sites, tech companies and

Lyst is a global Fashion Tech company and premium shopping app, founded in London in 2010 and catering to over 200M shoppers per year. We offer our customers the largest assortment of premium & luxury fashion items & products in one place, via an assortment of 8.5M+ items from over 17,000 of the world’s leading brands. We are a scale-up business with a current team size of c. 160 people in London, combining an agile mentality with a proven business model and over a decade of experience. This provides a balance between foundations and structure, and autonomy and pace.

At Lyst we obsess over the customer, providing a search & discovery experience which offers inspiration, fulfilment, and personalisation. We believe that fashion is amazing but shopping for fashion often isn’t, and use our technology, data and creativity to bring more joy, greater choice and fewer fails. Our mission is to help fashion shoppers make better decisions and help fashion partners find better audiences as the category-leading destination for every fashion shopper. Lyst has raised over $160m from leading investors including Accel, Balderton, Molten Ventures, Fidelity International, and LVMH.

We’re looking for a Lead Data Platform Engineer to join our central Analytics Engineering team, and help drive the Data Engineering discipline within the Data Platform chapter. This is a great opportunity for someone who wants to have impact from day one and make their mark as an expert in a high performing, collaborative team.

We record nearly 100 million lines of data daily, and we are looking for a senior engineer to support and maintain a data platform that is scalable, reliable and enables data-led decision making business-wide.

As a data engineer within the central data platform function, you will maintain the data ingestion infrastructure in AWS for data owners across Lyst to leverage and to ensure the data created is of high quality. You will identify, design and implement improvements to these processes, including data contracts and testing. This role will work closely with our engineers, analytics engineers and analysts to help us successfully deliver our data platform and data strategy.

Key responsibilities:

• Maintain our data ingestion infrastructure, and liaise with Engineering data owners on the infrastructure and standards
• Identify, design and implement process improvements for data ingestion and testing
• Create documentation and guidelines on building reliable, scalable data pipelines
• Own our data contract capabilities, and develop guidelines for data owners
• Advocate data quality across the organisation
• Support data owners on data ingestion, for new and existing data pipelines
• Work closely with Analytics Engineering to bridge the gap between data creation and transformation
• Support in delivering our data strategy
• We work mainly in Python and SQL, running on a range of AWS technologies such as S3, EKS, SQS, Firehose, Kinesis & Lambda and non-AWS tools such as Snowflake, dbt, Looker, CircleCI, Docker, Terraform & GitHub.

Requirements

• Experience with Python, AWS data tooling, and software fundamentals (SQL, Git)
• Experience with data processing & testing in the cloud, with a large amount of data
• Excellent Python knowledge and experience and up to date on best Python practices, as well as experience writing efficient SQL
• Experience working on full data engineering projects, from design to implementation
• Experience iterating & refactoring existing code as well as writing new code
• Communication: You are able to communicate clearly and be humble when sharing ideas and solutions. You can communicate with both technical and non-technical stakeholders
• You strive to write clear, well documented, tested code, and look to improve existing code and ways of working. When you find an opportunity, you’re are excited to go for it
• (Bonus) Experience with data contract implementation

Things that matter to us:

• You are curious at heart and like to take ownership of something to make it better
• You are detail oriented
• You are a team player and communicate with your peers and other stakeholders in the company on a day to day basis
• Being confronted with a difficult or strange problem makes you feel like a detective that wants to crack the mystery
• You have a sense of ownership over products, features and services the team looks after

Benefits

• Our Ways of Working: We come into the office between 2-4 days a week and we're always in on Tuesdays and Thursdays . We strongly believe that in-person collaboration and time spent together as a team allows us to deliver high impact work, but the flexibility to also work remotely supports our diverse team.
• Time Off : In addition to the 8 statutory