545 Data Engineer jobs in the United Kingdom

Data Engineer

London, London £400 - £450 Daily Tenth Revolution Group

Posted today

Job Viewed

Tap Again To Close

Job Description

contract

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy



Overview

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.



Responsibilities

  • Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
  • Develop scalable ETL processes using PySpark and Python
  • Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
  • Ensure data quality, governance, and performance throughout the migration lifecycle
  • Document technical processes and support knowledge transfer to internal teams


Required Skills

  • Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
  • Proven track record in delivering data migration projects within Azure environments
  • Ability to work independently and communicate effectively with technical and non-technical stakeholders
  • Previous experience in consultancy or client-facing roles is advantageous
This advertiser has chosen not to accept applicants from your region.

Data Engineer

Greater London, London Citywire

Posted 3 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer

We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business.

What you’ll be doing:

-Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform.

-Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge.

-Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery.

-Modernise legacy batch processes into stream-first architectures.

-Build and integrate APIs to enable smooth publishing and consumption of events across systems.

-Collaborate with engineers on greenfield and existing projects, balancing speed with resilience.

-Take ownership of key pipelines and services, ensuring reliability, performance, and scalability.

-Share best practices and mentor others in event-driven data engineering.

What we’re looking for:

-Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event-driven services.

-Event-Driven Knowledge: Understanding of DLQs, retries, buffering, idempotency, and resilient design patterns.

-Cloud & CI/CD Experience: Familiarity with Terraform, Git-based workflows, and cloud-native deployments.

-Database Skills: Experience with SQL and NoSQL databases such as PostgreSQL, DynamoDB, or OpenSearch.

-Problem-Solver: Comfortable working in Linux environments and confident debugging logs, scripts, and production issues.

-Additional Skills: Exposure to Kafka, Spark, or dbt Core, with an interest in domain-driven data contracts.

Meet Citywire 

We cover - and connect - all sides of the $100 trillion global asset management industry - through our news, events and insights. 

At Citywire, we uphold a culture rooted in honesty, integrity , and fairness , where every voice is valued and heard. Our culture promotes constructive dialogue and collaboration on a global scale. 

Join the team at the Heart of Wealth.

Our perks:

-Generous holiday entitlement: Start with 25 days per annum, increasing to 28 days after three years' service, and 30 days after five years' service, in addition to bank holidays.

-Flexible working options.

-£480 annual allowance for well-being activities or gym memberships, with assistance available for monthly or annual costs.

-Eye-test and glasses allowance.

-Competitive private pension scheme.

-Critical illness cover and group life assurance from day one of employment.

-Well-being support: Access to an independent Employee Assistance Programme, available 24/7.

-Cycle to work scheme and annual travel card loans.

-Techscheme: Purchase the latest tech through our employer scheme, spreading the cost over 12 months with National Insurance savings.

-After two years of continuous service, access group income protection, private medical, and dental insurance.

Citywire is an equal opportunities employer.

This advertiser has chosen not to accept applicants from your region.

Data Engineer

Greater Manchester, North West Michael Page

Posted 4 days ago

Job Viewed

Tap Again To Close

Job Description

contract

The Data Engineer/BI Developer will play a pivotal role in designing, developing, and maintaining data pipelines and systems to support analytics needs within the industrial and manufacturing sector. You will also create a number of bespoke reports using Power BI.

Client Details

The client is a small to medium manufacturer based in Manchester.

Description

  • Design, build, and optimise scalable data pipelines to support analytics operations.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Maintain and improve existing data systems and infrastructure.
  • Ensure data quality, consistency, and security across the organisation.
  • Implement ETL processes to integrate data from multiple sources.
  • Develop and maintain documentation for data engineering processes and workflows.
  • Monitor system performance and troubleshoot issues as they arise.
  • Provide technical support to the analytics team for data-related tasks.

Profile

A successful Data Engineer should have:

  • A strong understanding of data engineering principles and best practices.
  • Strong Power BI skills
  • Proficiency in programming languages such as Python, SQL, or equivalent.
  • Experience with cloud platforms and data storage solutions.
  • Knowledge of ETL tools and processes.
  • Familiarity with data visualisation and analytics tools.
  • A problem-solving mindset and attention to detail.
  • The ability to work collaboratively in a team environment.

Job Offer

  • Day rate of (Apply online only), outside IR35
  • Hybrid working - 2/3 days in Manchester office
  • Initial 6 month contract

This advertiser has chosen not to accept applicants from your region.

Data Engineer

London, London £60000 - £75000 Annually Tenth Revolution Group

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer

I am working with a rapidly growing, category-defining technology company that is transforming how industrial organisations operate and compete through deep data integration, generative AI, and tailored enterprise workflows.

As part of their continued expansion, they are looking to bring on a Data Engineer to lead client delivery and embed their platform into global operations. This is a strategic, high-impact role where you will work directly with senior stakeholders to solve complex business challenges and drive measurable outcomes through data and AI.

You will join a collaborative, mission-driven team of elite technologists and business leaders, working at the intersection of cutting-edge technology and real-world impact.

As part of this role, you will be responsible for:

  • Executing complex data integration projects using PySpark and distributed technologies
  • Designing and implementing scalable generative AI workflows using modern AI infrastructure
  • Collaborating with cross-functional teams to ensure successful delivery and adoption
  • Driving continuous improvement and innovation across client engagements

To be successful in this role, you will have:

  • Experience working in data engineering or data integration
  • Strong technical skills in Python or PySpark
  • Exposure to generative AI platforms or interest in building AI-powered workflows
  • Ability to work closely with clients and lead delivery in fast-paced environments
  • Exposure to Airflow, Databricks or DBT would be beneficial

Some of the package details include:

  • Salary up to 75,000 per year
  • Bonus and share options
  • Vibrant central London office, working closely with the wider tech function (3 days in office, 2 from home)

This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss further.

This advertiser has chosen not to accept applicants from your region.

Data Engineer

Cardiff, Wales £55000 - £62000 Annually CPS Group (UK) Limited

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

permanent
Role: Data Engineer
Location: Cardiff (Hybrid - 3 days WFH)
Salary: Up to 62,000 + 10% Bonus + Excellent Benefits

The Role

CPS Group are partnering with a leading organisation to hire an experienced Data Engineer. You'll design, build, and optimise data pipelines and integrations, supporting ERP migration projects and shaping a centralised enterprise data platform. This is a key role ensuring reliable, high-quality data for business intelligence and decision-making.

Key Responsibilities:

* Build and maintain scalable data pipelines (SQL / Azure).
* Support ERP migration and system integrations.
* Ensure data quality, validation, and performance.
* Collaborate with BI and Data teams to deliver business insights.
* Apply DataOps best practices (version control, CI/CD, documentation).

Skills & Experience:

* Strong SQL development and optimisation skills.
* Experience with MS SQL Server, Azure SQL, Azure Data Factory.
* Proven track record in data engineering, ETL/ELT, and system migrations.
* Knowledge of data modelling, governance, and quality assurance.
* Excellent communication and problem-solving abilities.

Benefits:

* Up to 62,000 + 10% Bonus
* Private Healthcare
* 6% Employer Contribution Pension
* 25 days holiday + bank holidays
* Flexible hybrid working
* Free Parking
* Life Assurance (3x Salary)

If interested in finding out more details, please email a copy of your CV and time to arrange a call.

By applying to this advert you are giving CPS Group (UK) Ltd authority to hold and process your data for this specific role and any other roles we may deem suitable to you over time. We will not pass your data to any third party without your verbal or written permission to do so. All incoming and outgoing calls are recorded for training and compliance purposes. CPS Group (UK) Ltd is acting as an Employment Agency in relation to this vacancy. Our new privacy policy can be found here (url removed)>
This advertiser has chosen not to accept applicants from your region.

Data Engineer

Bristol, South West £50000 - £60000 Annually Tenth Revolution Group

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer

Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting.

With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential of the company's data and drive data-led decision-making.

As part of this role, you will be responsible for some of the following areas

  • Architect and build a scalable data platform integrating diverse data sources
  • Develop and maintain robust, efficient data pipelines
  • Write clean, reliable code to transform and manipulate data
  • Partner with senior technical leaders to shape modern data platform best practices
  • Contribute to long-term data strategy with a strong focus on data integrity and GDPR compliance

To be successful in the role you will have

  • Hands-on coding experience with Python or PySpark
  • Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines
  • Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse
  • Strong command of SQL
  • Excellent communication and collaboration skills

What's in It for You:

  • Up to 60,000 salary depending on experience
  • Hybrid working: 3 days in Bristol office, 2 days from home
  • 24 days annual leave plus bank holidays (rising to 27 with service)
  • Private healthcare and other wellness benefits
  • Company pension scheme

This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will call you to discuss further. My client is looking to begin the interview process ASAP, so don't miss out, APPLY now! To do so please email me at (url removed) or call me on (phone number removed).

This advertiser has chosen not to accept applicants from your region.

Data Engineer

Hampshire, South East £40000 - £60000 Annually Spectrum IT Recruitment

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer

  • Data Integration, ETL pipelines, BigQuery
  • Fareham, Hampshire. This role is to work in the office full time.
  • Salary circa 60,000 plus benefits

In 2023, cybercrime cost UK businesses an estimated 21 billion. But don't think its the just the big corporates at risk, the average cybercrime value in the UK is just over 10,000 demonstrating that personal finance and small business cybercrime is rife.

Would you like to be part of the solution?

We are working with an award winning leader in the field of cyber security. They are on a mission to build a safer digital world for you and your future self! They have built a suite of innovative products designed to offer superior protection against a broad spectrum of online threats.

The role of Data Engineer is a new position in the team demonstrating the increasing demand for a robust cyber solution.

Working with a talented software team you will be helping to build and maintain my clients data infrastructure with a specific emphasis on BigQuery and Looker for business intelligence and reporting. You will be responsible for developing and managing ETL pipelines that seamlessly integrate data from various sources, transforming it into a clean, structured, and easily accessible format.

On top of a competitive salary (approx 60k) the company offer some fantastic financial and lifestyle benefits including; free access to local gym, onsite chef (free cooked breakfast & lunch!), childcare vouchers, cycle to work scheme, pension, BUPA healthcare, investment in training and personal development.

Key Responsibilities

  • Data Integration and ETL
  • Data Warehousing and Modelling
  • Business Intelligence and Reporting
  • Data Quality and Governance

Technical Skills:

  • ETL
  • Looker
  • BigQuery
  • Cloud technologies such as GCP or AWS
  • SCSS / The company offers a competitive salary, exposure to new technology, career progression and a great working environment with a talented team.

Interviews are being held within the next couple of weeks so please get in touch via email or give me a call on the following (url removed) or call (phone number removed)

Spectrum IT Recruitment (South) Limited is acting as an Employment Agency in relation to this vacancy.

This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Data engineer Jobs in United Kingdom !

Data Engineer

Tyne and Wear, North East £350 - £400 Daily Tenth Revolution Group

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

contract

Data Engineer - Azure & Databricks


Location: Hebburn (Hybrid)


Contract Length: 6 months (with potential to extend)
(outside IR35 - to be confirmed)


A leading organisation is seeking an experienced Data Engineer with strong expertise in the Azure Data Stack and Databricks to support a key data transformation initiative. This is a hands-on delivery role, ideal for someone who thrives in a fast-paced environment and can work closely with stakeholders to build scalable, cloud-native data solutions.


Key Details:
* Onsite presence required at the Hebburn office - frequency to be confirmed with the client
* Initial 6-month contract with strong potential for extension
Required Skills:
* Proven experience with the Azure Data Stack (Azure Data Factory, Azure Synapse, Azure SQL, ADLS Gen2)
* Strong hands-on expertise with Databricks (Spark, Delta Lake, notebooks, orchestration)
* Experience building and optimising data pipelines for analytics and reporting
* Ability to work collaboratively with cross-functional teams and stakeholders
* Strong communication and problem-solving skills


Please send CV's over to (url removed)

This advertiser has chosen not to accept applicants from your region.

Data Engineer

London, London £38000 - £45000 Annually Office Angels

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer

Location: Hammersmith - Hybrid after probation

Salary: 38,000 -45,000

Join Our Team as a Data Engineer!

About Us : Join a forward-thinking organisation dedicated to revolutionising retail through innovative solutions and operations. We leverage physical spaces to test new concepts and pilot initiatives, helping brands and retailers thrive in a dynamic marketplace.

What You'll Do :

As our Data Engineer, you will play a pivotal role in the day-to-day management and maintenance of our data infrastructure, driving our large-scale programmes in the USA. Your primary responsibilities will include :

  • Design & Development: Create, develop, and maintain scalable data pipelines and ETL processes across various systems.
  • Data Integration: Build and manage seamless data integrations from diverse sources, including POS systems, e-commerce platforms, RFID sensors, IoT devices, and CRM systems.
  • Data optimisation: Develop and optimise data models to support reporting, analytics, and machine learning initiatives.
  • Data Quality Assurance: Ensure data accuracy, consistency, security, and compliance with U.S. data privacy standards (CCPA, HIPAA).
  • Monitoring & Troubleshooting: Monitor, troubleshoot, and enhance data pipelines to maximise reliability and performance.
  • Collaboration: Work closely with teams to deliver datasets that empower insight and decision-making.
  • Strategic Contribution: Contribute to our data strategy by evaluating and implementing modern data tools and practises.
  • Documentation: Document data flows, schemas, and processes to support knowledge sharing and scalability.

About You :

To thrive in this role, you will need :

  • Strong knowledge of Python and APIs for effective data integration.
  • Familiarity with cloud platforms, preferably Azure (AWS, GCP experience is also valuable).
  • Experience managing large and complex datasets, with a strong command of SQL for cloud-based environments (Fabric, Snowflake, BigQuery, Redshift, etc.).
  • A solid understanding of data modelling techniques (star schema, data vault, dimensional modelling).
  • Proficiency in Excel-based data workflows for various Agile Retail projects.
  • Hands-on experience with data pipeline orchestration tools (Airflow, dbt, Prefect, or similar).

Benefits:

  • Unlimited holiday
  • Annual Wellbeing Allowance
  • Flexible work culture
  • Monthly socials and events
  • Complimentary snack bar
  • Employer pension contribution

If you're a data enthusiast ready to innovate and drive impactful solutions in retail, we want to hear from you!

Office Angels is an employment agency and business. We are an equal-opportunities employer who puts expertise, energy and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, abilities and more. By showcasing talents, skills and unique experiences in an inclusive environment, we help individuals thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.


Office Angels acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. Office Angels UK is an Equal Opportunities Employer.

By applying for this role your details will be submitted to Office Angels. Our Candidate Privacy Information Statement explaining how we will use your information is available on our website.

This advertiser has chosen not to accept applicants from your region.

Data Engineer

Hampshire, South East £60000 - £70000 Annually Tenth Revolution Group

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer - Portsmouth - 60,000

A rapidly growing software company in Portsmouth is looking for a Data Engineer to lead the build of their first-ever data platform. This is a greenfield opportunity to architect and implement scalable data infrastructure from scratch, with the potential to grow into a team lead role.

With over 100 employees and continued expansion, they're now investing in data to support smarter decision-making across their subscription-based business. This is a hands-on role with strategic impact. You'll have the autonomy to choose the right tools and shape the data architecture. If successful, you'll have the opportunity to grow the data function and step into a leadership role.

The Role:

  • Designing and building robust ETL pipelines using tools like dbt or Apache Airflow
  • Integrating data from APIs, databases, and SaaS platforms into BigQuery
  • Structuring clean, queryable data models to support analytics and reporting
  • Collaborating with analysts to deliver insightful dashboards via Looker
  • Establishing data governance and quality processes

Requirements:

  • GCP (BigQuery), but open to other cloud backgrounds
  • ETL: dbt, Apache Airflow, or similar
  • BI: Looker (preferred), or other BI tools
  • Languages: SQL, Python, Java
  • Experienced data engineer, with strong ETL and cloud data warehouse experience
  • Proficiency in SQL and data modelling best practices
  • Experience with BI tools and dashboard creation
  • Self-starter attitude with minimal supervision required

Package:

  • Competitive salary up to 70,000 + discretionary bonus (performance reviewed twice a year)
  • Discounts, perks, and 20 days holiday

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Contact me: (url removed)

This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Data Engineer Jobs