545 Data Engineer jobs in the United Kingdom

Data Engineer

We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business.

What you’ll be doing:

-Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform.

-Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge.

-Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery.

-Modernise legacy batch processes into stream-first architectures.

-Build and integrate APIs to enable smooth publishing and consumption of events across systems.

-Collaborate with engineers on greenfield and existing projects, balancing speed with resilience.

-Take ownership of key pipelines and services, ensuring reliability, performance, and scalability.

-Share best practices and mentor others in event-driven data engineering.

What we’re looking for:

-Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event-driven services.

-Event-Driven Knowledge: Understanding of DLQs, retries, buffering, idempotency, and resilient design patterns.

-Cloud & CI/CD Experience: Familiarity with Terraform, Git-based workflows, and cloud-native deployments.

-Database Skills: Experience with SQL and NoSQL databases such as PostgreSQL, DynamoDB, or OpenSearch.

-Problem-Solver: Comfortable working in Linux environments and confident debugging logs, scripts, and production issues.

-Additional Skills: Exposure to Kafka, Spark, or dbt Core, with an interest in domain-driven data contracts.

Meet Citywire 

We cover - and connect - all sides of the $100 trillion global asset management industry - through our news, events and insights. 

At Citywire, we uphold a culture rooted in honesty, integrity , and fairness , where every voice is valued and heard. Our culture promotes constructive dialogue and collaboration on a global scale. 

Join the team at the Heart of Wealth.

Our perks:

-Generous holiday entitlement: Start with 25 days per annum, increasing to 28 days after three years' service, and 30 days after five years' service, in addition to bank holidays.

-Flexible working options.

-£480 annual allowance for well-being activities or gym memberships, with assistance available for monthly or annual costs.

-Eye-test and glasses allowance.

-Competitive private pension scheme.

-Critical illness cover and group life assurance from day one of employment.

-Well-being support: Access to an independent Employee Assistance Programme, available 24/7.

-Cycle to work scheme and annual travel card loans.

-Techscheme: Purchase the latest tech through our employer scheme, spreading the cost over 12 months with National Insurance savings.

-After two years of continuous service, access group income protection, private medical, and dental insurance.

Citywire is an equal opportunities employer.

The Data Engineer/BI Developer will play a pivotal role in designing, developing, and maintaining data pipelines and systems to support analytics needs within the industrial and manufacturing sector. You will also create a number of bespoke reports using Power BI.

Client Details

The client is a small to medium manufacturer based in Manchester.

Description

• Design, build, and optimise scalable data pipelines to support analytics operations.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Maintain and improve existing data systems and infrastructure.
• Ensure data quality, consistency, and security across the organisation.
• Implement ETL processes to integrate data from multiple sources.
• Develop and maintain documentation for data engineering processes and workflows.
• Monitor system performance and troubleshoot issues as they arise.
• Provide technical support to the analytics team for data-related tasks.

Profile

A successful Data Engineer should have:

• A strong understanding of data engineering principles and best practices.
• Strong Power BI skills
• Proficiency in programming languages such as Python, SQL, or equivalent.
• Experience with cloud platforms and data storage solutions.
• Knowledge of ETL tools and processes.
• Familiarity with data visualisation and analytics tools.
• A problem-solving mindset and attention to detail.
• The ability to work collaboratively in a team environment.

Job Offer

• Day rate of (Apply online only), outside IR35
• Hybrid working - 2/3 days in Manchester office
• Initial 6 month contract

Data Engineer

I am working with a rapidly growing, category-defining technology company that is transforming how industrial organisations operate and compete through deep data integration, generative AI, and tailored enterprise workflows.

As part of their continued expansion, they are looking to bring on a Data Engineer to lead client delivery and embed their platform into global operations. This is a strategic, high-impact role where you will work directly with senior stakeholders to solve complex business challenges and drive measurable outcomes through data and AI.

You will join a collaborative, mission-driven team of elite technologists and business leaders, working at the intersection of cutting-edge technology and real-world impact.

As part of this role, you will be responsible for:

• Executing complex data integration projects using PySpark and distributed technologies
• Designing and implementing scalable generative AI workflows using modern AI infrastructure
• Collaborating with cross-functional teams to ensure successful delivery and adoption
• Driving continuous improvement and innovation across client engagements

To be successful in this role, you will have:

• Experience working in data engineering or data integration
• Strong technical skills in Python or PySpark
• Exposure to generative AI platforms or interest in building AI-powered workflows
• Ability to work closely with clients and lead delivery in fast-paced environments
• Exposure to Airflow, Databricks or DBT would be beneficial

Some of the package details include:

• Salary up to 75,000 per year
• Bonus and share options
• Vibrant central London office, working closely with the wider tech function (3 days in office, 2 from home)

This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss further.

Data Engineer

Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting.

With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential of the company's data and drive data-led decision-making.

As part of this role, you will be responsible for some of the following areas

• Architect and build a scalable data platform integrating diverse data sources
• Develop and maintain robust, efficient data pipelines
• Write clean, reliable code to transform and manipulate data
• Partner with senior technical leaders to shape modern data platform best practices
• Contribute to long-term data strategy with a strong focus on data integrity and GDPR compliance

To be successful in the role you will have

• Hands-on coding experience with Python or PySpark
• Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines
• Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse
• Strong command of SQL
• Excellent communication and collaboration skills

What's in It for You:

• Up to 60,000 salary depending on experience
• Hybrid working: 3 days in Bristol office, 2 days from home
• 24 days annual leave plus bank holidays (rising to 27 with service)
• Private healthcare and other wellness benefits
• Company pension scheme

This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will call you to discuss further. My client is looking to begin the interview process ASAP, so don't miss out, APPLY now! To do so please email me at (url removed) or call me on (phone number removed).

Data Engineer

• Data Integration, ETL pipelines, BigQuery
• Fareham, Hampshire. This role is to work in the office full time.
• Salary circa 60,000 plus benefits

In 2023, cybercrime cost UK businesses an estimated 21 billion. But don't think its the just the big corporates at risk, the average cybercrime value in the UK is just over 10,000 demonstrating that personal finance and small business cybercrime is rife.

Would you like to be part of the solution?

We are working with an award winning leader in the field of cyber security. They are on a mission to build a safer digital world for you and your future self! They have built a suite of innovative products designed to offer superior protection against a broad spectrum of online threats.

The role of Data Engineer is a new position in the team demonstrating the increasing demand for a robust cyber solution.

Working with a talented software team you will be helping to build and maintain my clients data infrastructure with a specific emphasis on BigQuery and Looker for business intelligence and reporting. You will be responsible for developing and managing ETL pipelines that seamlessly integrate data from various sources, transforming it into a clean, structured, and easily accessible format.

On top of a competitive salary (approx 60k) the company offer some fantastic financial and lifestyle benefits including; free access to local gym, onsite chef (free cooked breakfast & lunch!), childcare vouchers, cycle to work scheme, pension, BUPA healthcare, investment in training and personal development.

Key Responsibilities

• Data Integration and ETL
• Data Warehousing and Modelling
• Business Intelligence and Reporting
• Data Quality and Governance

Technical Skills:

• ETL
• Looker
• BigQuery
• Cloud technologies such as GCP or AWS
• SCSS / The company offers a competitive salary, exposure to new technology, career progression and a great working environment with a talented team.

Interviews are being held within the next couple of weeks so please get in touch via email or give me a call on the following (url removed) or call (phone number removed)

Spectrum IT Recruitment (South) Limited is acting as an Employment Agency in relation to this vacancy.

Data Engineer - Azure & Databricks

Location: Hebburn (Hybrid)

Contract Length: 6 months (with potential to extend)
(outside IR35 - to be confirmed)

A leading organisation is seeking an experienced Data Engineer with strong expertise in the Azure Data Stack and Databricks to support a key data transformation initiative. This is a hands-on delivery role, ideal for someone who thrives in a fast-paced environment and can work closely with stakeholders to build scalable, cloud-native data solutions.

Key Details:
* Onsite presence required at the Hebburn office - frequency to be confirmed with the client
* Initial 6-month contract with strong potential for extension
Required Skills:
* Proven experience with the Azure Data Stack (Azure Data Factory, Azure Synapse, Azure SQL, ADLS Gen2)
* Strong hands-on expertise with Databricks (Spark, Delta Lake, notebooks, orchestration)
* Experience building and optimising data pipelines for analytics and reporting
* Ability to work collaboratively with cross-functional teams and stakeholders
* Strong communication and problem-solving skills

Please send CV's over to (url removed)

Data Engineer

Location: Hammersmith - Hybrid after probation

Salary: 38,000 -45,000

Join Our Team as a Data Engineer!

About Us : Join a forward-thinking organisation dedicated to revolutionising retail through innovative solutions and operations. We leverage physical spaces to test new concepts and pilot initiatives, helping brands and retailers thrive in a dynamic marketplace.

What You'll Do :

As our Data Engineer, you will play a pivotal role in the day-to-day management and maintenance of our data infrastructure, driving our large-scale programmes in the USA. Your primary responsibilities will include :

• Design & Development: Create, develop, and maintain scalable data pipelines and ETL processes across various systems.
• Data Integration: Build and manage seamless data integrations from diverse sources, including POS systems, e-commerce platforms, RFID sensors, IoT devices, and CRM systems.
• Data optimisation: Develop and optimise data models to support reporting, analytics, and machine learning initiatives.
• Data Quality Assurance: Ensure data accuracy, consistency, security, and compliance with U.S. data privacy standards (CCPA, HIPAA).
• Monitoring & Troubleshooting: Monitor, troubleshoot, and enhance data pipelines to maximise reliability and performance.
• Collaboration: Work closely with teams to deliver datasets that empower insight and decision-making.
• Strategic Contribution: Contribute to our data strategy by evaluating and implementing modern data tools and practises.
• Documentation: Document data flows, schemas, and processes to support knowledge sharing and scalability.

About You :

To thrive in this role, you will need :

• Strong knowledge of Python and APIs for effective data integration.
• Familiarity with cloud platforms, preferably Azure (AWS, GCP experience is also valuable).
• Experience managing large and complex datasets, with a strong command of SQL for cloud-based environments (Fabric, Snowflake, BigQuery, Redshift, etc.).
• A solid understanding of data modelling techniques (star schema, data vault, dimensional modelling).
• Proficiency in Excel-based data workflows for various Agile Retail projects.
• Hands-on experience with data pipeline orchestration tools (Airflow, dbt, Prefect, or similar).

Benefits:

• Unlimited holiday
• Annual Wellbeing Allowance
• Flexible work culture
• Monthly socials and events
• Complimentary snack bar
• Employer pension contribution

If you're a data enthusiast ready to innovate and drive impactful solutions in retail, we want to hear from you!

Office Angels is an employment agency and business. We are an equal-opportunities employer who puts expertise, energy and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, abilities and more. By showcasing talents, skills and unique experiences in an inclusive environment, we help individuals thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

Office Angels acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. Office Angels UK is an Equal Opportunities Employer.

By applying for this role your details will be submitted to Office Angels. Our Candidate Privacy Information Statement explaining how we will use your information is available on our website.

Data Engineer - Portsmouth - 60,000

A rapidly growing software company in Portsmouth is looking for a Data Engineer to lead the build of their first-ever data platform. This is a greenfield opportunity to architect and implement scalable data infrastructure from scratch, with the potential to grow into a team lead role.

With over 100 employees and continued expansion, they're now investing in data to support smarter decision-making across their subscription-based business. This is a hands-on role with strategic impact. You'll have the autonomy to choose the right tools and shape the data architecture. If successful, you'll have the opportunity to grow the data function and step into a leadership role.

The Role:

• Designing and building robust ETL pipelines using tools like dbt or Apache Airflow
• Integrating data from APIs, databases, and SaaS platforms into BigQuery
• Structuring clean, queryable data models to support analytics and reporting
• Collaborating with analysts to deliver insightful dashboards via Looker
• Establishing data governance and quality processes

Requirements:

• GCP (BigQuery), but open to other cloud backgrounds
• ETL: dbt, Apache Airflow, or similar
• BI: Looker (preferred), or other BI tools
• Languages: SQL, Python, Java

• Experienced data engineer, with strong ETL and cloud data warehouse experience
• Proficiency in SQL and data modelling best practices
• Experience with BI tools and dashboard creation
• Self-starter attitude with minimal supervision required

Package:

• Competitive salary up to 70,000 + discretionary bonus (performance reviewed twice a year)
• Discounts, perks, and 20 days holiday

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Contact me: (url removed)