213 Data Engineer jobs in London

Data Engineer - London / Nationwide (Hybrid) - SC Eligible - 60,000

A leading digital consultancy is looking to hire a Data Engineer to support the expansion of its Data & AI team. This is an excellent opportunity for someone with up to 3 years of experience (or a strong academic background) to gain hands-on exposure to cloud technologies and grow in a collaborative, fast-paced environment.

What You'll Be Doing:

• Building and maintaining scalable data pipelines across Azure and GCP
• Working with tools such as Azure Data Factory, Snowflake, BigQuery, and Cloud Functions
• Supporting data warehousing and integration across diverse industry projects
• Collaborating with data professionals and contributing to cross-functional delivery teams
• Assisting in reporting and data visualisation (Power BI / Looker - nice to have)

What We're Looking For:

• 0-3 years of experience in a data engineering or similar role (graduates welcome)
• Proficiency in SQL and Python
• Exposure to any of the following:
• Azure Data Factory
• GCP BigQuery
• Snowflake
• Cloud Functions
• Strong communication and problem-solving skills
• Must be eligible for SC (Security Check) clearance (UK residency required)

What's On Offer:

• 60,000 base salary
• Hybrid working (London office base)
• Clear progression plan and technical mentorship
• Involvement in real-world data and digital transformation programmes
• Supportive, forward-thinking team culture

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.

• Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
• Develop scalable ETL processes using PySpark and Python
• Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
• Ensure data quality, governance, and performance throughout the migration lifecycle
• Document technical processes and support knowledge transfer to internal teams

• Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
• Proven track record in delivering data migration projects within Azure environments
• Ability to work independently and communicate effectively with technical and non-technical stakeholders
• Previous experience in consultancy or client-facing roles is advantageous

Job Description:

Our tech stack

• AWS is a significant growth area for us with a diverse and growing capability and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement.
• AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB.

Essential requirements

• You thrive in problem-solving and analytical thinking
• You enjoy collaborating with multiple stakeholders in a fast-paced environment
• Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL.
• Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc.
• Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming

• We are seeking a skilled Data Engineer to design and develop robust data pipelines that support a cloud-based Data Analytics platform. This role plays a key part in transforming the data landscape and enhancing the Data Warehouse Engineering function.
• The successful candidate will contribute to a range of initiatives focused on improving data quality, accessibility, and performance.

• Design and maintain data pipelines, including error-handling, automation, and performance optimisation.
• Resolve data queries by tracing issues to source systems.
• Define and deliver cloud-based data analytics platform requirements using modern EDW tools and practices.
• Maintain clear and accurate team and technical documentation.
• Monitor and improve data quality, consistency, and compliance with standards.
• Apply operational procedures, security protocols, and support frameworks to meet service levels.
• Recommend development tools to improve delivery efficiency and value.
• Document systems, solutions, and processes for database and data engineering deliveries.
• Contribute to IT strategy and architecture development.
• Ensure solution designs comply with relevant policies, standards, and governance.
• Maintain strategic oversight across data engineering components.
• Identify and manage risks and issues proactively.
• Conduct technical quality checks with leads to ensure standards are met.
• Promote lean practices by challenging inefficiencies.
• Support the strategic direction of the IT function with a proactive and positive approach.

Data Engineer

I am working with a fast-growing, technology driven organisation that is redefining how data is used to drive decision making across regulated industries. Through advanced data engineering, cloud technologies and a strong focus on compliance they are enabling smarter, faster and more secure business operations.

As part of their continued growth, they are looking to bring on a Data Engineer to join their Data team. This is a high-impact, delivery focused role where you will work across business units to build scalable data solutions and support enterprise-wide transformation.

You will be part of a collaborative, forward thinking team that values innovation, quality, and continuous improvement.

In this role, you will be responsible for:

• Designing and delivering data solutions using Microsoft technologies
• Building and maintaining ETL pipelines across complex data environments
• Collaborating with Architects, Engineers, and cross-functional teams to develop solutions that meet business needs
• Participating in Agile ceremonies and contributing to code reviews
• Creating documentation and supporting the development lifecycle

To be successful in this role, you will have:

• Experience working on the Microsoft Platform e.g. SQL Server, SSIS, SSRS
• Strong data warehousing and data modelling experience
• Experience creating ETL pipelines (primarily using SSIS)
• Experience working in regulated environments
• Power BI experience for reporting would be beneficial

Some of the package details include:

• Salary of up to 60,000
• Fully remote working
• 25 days annual leave plus bank holiday
• Discretionary bonus scheme
• Supportive, inclusive culture with a focus on professional development

This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss it further.

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.

• Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
• Develop scalable ETL processes using PySpark and Python
• Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
• Ensure data quality, governance, and performance throughout the migration lifecycle
• Document technical processes and support knowledge transfer to internal teams

• Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
• Proven track record in delivering data migration projects within Azure environments
• Ability to work independently and communicate effectively with technical and non-technical stakeholders
• Previous experience in consultancy or client-facing roles is advantageous

Data Engineer

We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business.

What you’ll be doing:

-Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform.

-Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge.

-Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery.

-Modernise legacy batch processes into stream-first architectures.

-Build and integrate APIs to enable smooth publishing and consumption of events across systems.

-Collaborate with engineers on greenfield and existing projects, balancing speed with resilience.

-Take ownership of key pipelines and services, ensuring reliability, performance, and scalability.

-Share best practices and mentor others in event-driven data engineering.

What we’re looking for:

-Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event-driven services.

-Event-Driven Knowledge: Understanding of DLQs, retries, buffering, idempotency, and resilient design patterns.

-Cloud & CI/CD Experience: Familiarity with Terraform, Git-based workflows, and cloud-native deployments.

-Database Skills: Experience with SQL and NoSQL databases such as PostgreSQL, DynamoDB, or OpenSearch.

-Problem-Solver: Comfortable working in Linux environments and confident debugging logs, scripts, and production issues.

-Additional Skills: Exposure to Kafka, Spark, or dbt Core, with an interest in domain-driven data contracts.

Meet Citywire 

We cover - and connect - all sides of the $100 trillion global asset management industry - through our news, events and insights. 

At Citywire, we uphold a culture rooted in honesty, integrity , and fairness , where every voice is valued and heard. Our culture promotes constructive dialogue and collaboration on a global scale. 

Join the team at the Heart of Wealth.

Our perks:

-Generous holiday entitlement: Start with 25 days per annum, increasing to 28 days after three years' service, and 30 days after five years' service, in addition to bank holidays.

-Flexible working options.

-£480 annual allowance for well-being activities or gym memberships, with assistance available for monthly or annual costs.

-Eye-test and glasses allowance.

-Competitive private pension scheme.

-Critical illness cover and group life assurance from day one of employment.

-Well-being support: Access to an independent Employee Assistance Programme, available 24/7.

-Cycle to work scheme and annual travel card loans.

-Techscheme: Purchase the latest tech through our employer scheme, spreading the cost over 12 months with National Insurance savings.

-After two years of continuous service, access group income protection, private medical, and dental insurance.

Citywire is an equal opportunities employer.

Data Engineer

Location: Hammersmith - Hybrid after probation

Salary: 38,000 -45,000

Join Our Team as a Data Engineer!

About Us : Join a forward-thinking organisation dedicated to revolutionising retail through innovative solutions and operations. We leverage physical spaces to test new concepts and pilot initiatives, helping brands and retailers thrive in a dynamic marketplace.

What You'll Do :

As our Data Engineer, you will play a pivotal role in the day-to-day management and maintenance of our data infrastructure, driving our large-scale programmes in the USA. Your primary responsibilities will include :

• Design & Development: Create, develop, and maintain scalable data pipelines and ETL processes across various systems.
• Data Integration: Build and manage seamless data integrations from diverse sources, including POS systems, e-commerce platforms, RFID sensors, IoT devices, and CRM systems.
• Data optimisation: Develop and optimise data models to support reporting, analytics, and machine learning initiatives.
• Data Quality Assurance: Ensure data accuracy, consistency, security, and compliance with U.S. data privacy standards (CCPA, HIPAA).
• Monitoring & Troubleshooting: Monitor, troubleshoot, and enhance data pipelines to maximise reliability and performance.
• Collaboration: Work closely with teams to deliver datasets that empower insight and decision-making.
• Strategic Contribution: Contribute to our data strategy by evaluating and implementing modern data tools and practises.
• Documentation: Document data flows, schemas, and processes to support knowledge sharing and scalability.

About You :

To thrive in this role, you will need :

• Strong knowledge of Python and APIs for effective data integration.
• Familiarity with cloud platforms, preferably Azure (AWS, GCP experience is also valuable).
• Experience managing large and complex datasets, with a strong command of SQL for cloud-based environments (Fabric, Snowflake, BigQuery, Redshift, etc.).
• A solid understanding of data modelling techniques (star schema, data vault, dimensional modelling).
• Proficiency in Excel-based data workflows for various Agile Retail projects.
• Hands-on experience with data pipeline orchestration tools (Airflow, dbt, Prefect, or similar).

Benefits:

• Unlimited holiday
• Annual Wellbeing Allowance
• Flexible work culture
• Monthly socials and events
• Complimentary snack bar
• Employer pension contribution

If you're a data enthusiast ready to innovate and drive impactful solutions in retail, we want to hear from you!

Office Angels is an employment agency and business. We are an equal-opportunities employer who puts expertise, energy and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, abilities and more. By showcasing talents, skills and unique experiences in an inclusive environment, we help individuals thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

Office Angels acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. Office Angels UK is an Equal Opportunities Employer.

By applying for this role your details will be submitted to Office Angels. Our Candidate Privacy Information Statement explaining how we will use your information is available on our website.

Data Engineer
12 months
Remote
470 per day inside IR35 - Umbrella only
Active SC clearance and eligible candidates will be considered

Project description
Our client playing a crucial role in the ESN project in 2025, which aims to modernize and enhance communication for frontline emergency services in the UK. This initiative will greatly enhance the capabilities of emergency services, allowing them to share vital data and information quickly and securely, improving response times and overall public safety.
Required Skills

• Data Stage, RedShift, QuickSight, S3
• data migration/ ETL both batch and real time
• data warehouse development
• DevSecOps
• Java
• SQL
• relational databases
• GitHub/lab experience

Nice to have:

• Data quality
• xml
• AWS Data Specialty certification

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!