545 Data Engineer jobs in the United Kingdom
Data Engineer
Posted today
Job Viewed
Job Description
Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy
Overview
We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.
Responsibilities
- Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
- Develop scalable ETL processes using PySpark and Python
- Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
- Ensure data quality, governance, and performance throughout the migration lifecycle
- Document technical processes and support knowledge transfer to internal teams
Required Skills
- Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
- Proven track record in delivering data migration projects within Azure environments
- Ability to work independently and communicate effectively with technical and non-technical stakeholders
- Previous experience in consultancy or client-facing roles is advantageous
Data Engineer
Posted 3 days ago
Job Viewed
Job Description
Data Engineer
We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business.
What you’ll be doing:
-Build and maintain event-driven data pipelines that power Citywire’s Catalyst platform.
-Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge.
-Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery.
-Modernise legacy batch processes into stream-first architectures.
-Build and integrate APIs to enable smooth publishing and consumption of events across systems.
-Collaborate with engineers on greenfield and existing projects, balancing speed with resilience.
-Take ownership of key pipelines and services, ensuring reliability, performance, and scalability.
-Share best practices and mentor others in event-driven data engineering.
What we’re looking for:
-Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event-driven services.
-Event-Driven Knowledge: Understanding of DLQs, retries, buffering, idempotency, and resilient design patterns.
-Cloud & CI/CD Experience: Familiarity with Terraform, Git-based workflows, and cloud-native deployments.
-Database Skills: Experience with SQL and NoSQL databases such as PostgreSQL, DynamoDB, or OpenSearch.
-Problem-Solver: Comfortable working in Linux environments and confident debugging logs, scripts, and production issues.
-Additional Skills: Exposure to Kafka, Spark, or dbt Core, with an interest in domain-driven data contracts.
Meet Citywire
We cover - and connect - all sides of the $100 trillion global asset management industry - through our news, events and insights.
At Citywire, we uphold a culture rooted in honesty, integrity , and fairness , where every voice is valued and heard. Our culture promotes constructive dialogue and collaboration on a global scale.
Join the team at the Heart of Wealth.
Our perks:
-Generous holiday entitlement: Start with 25 days per annum, increasing to 28 days after three years' service, and 30 days after five years' service, in addition to bank holidays.
-Flexible working options.
-£480 annual allowance for well-being activities or gym memberships, with assistance available for monthly or annual costs.
-Eye-test and glasses allowance.
-Competitive private pension scheme.
-Critical illness cover and group life assurance from day one of employment.
-Well-being support: Access to an independent Employee Assistance Programme, available 24/7.
-Cycle to work scheme and annual travel card loans.
-Techscheme: Purchase the latest tech through our employer scheme, spreading the cost over 12 months with National Insurance savings.
-After two years of continuous service, access group income protection, private medical, and dental insurance.
Citywire is an equal opportunities employer.
Data Engineer
Posted 4 days ago
Job Viewed
Job Description
The Data Engineer/BI Developer will play a pivotal role in designing, developing, and maintaining data pipelines and systems to support analytics needs within the industrial and manufacturing sector. You will also create a number of bespoke reports using Power BI.
Client Details
The client is a small to medium manufacturer based in Manchester.
Description
- Design, build, and optimise scalable data pipelines to support analytics operations.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Maintain and improve existing data systems and infrastructure.
- Ensure data quality, consistency, and security across the organisation.
- Implement ETL processes to integrate data from multiple sources.
- Develop and maintain documentation for data engineering processes and workflows.
- Monitor system performance and troubleshoot issues as they arise.
- Provide technical support to the analytics team for data-related tasks.
Profile
A successful Data Engineer should have:
- A strong understanding of data engineering principles and best practices.
- Strong Power BI skills
- Proficiency in programming languages such as Python, SQL, or equivalent.
- Experience with cloud platforms and data storage solutions.
- Knowledge of ETL tools and processes.
- Familiarity with data visualisation and analytics tools.
- A problem-solving mindset and attention to detail.
- The ability to work collaboratively in a team environment.
Job Offer
- Day rate of (Apply online only), outside IR35
- Hybrid working - 2/3 days in Manchester office
- Initial 6 month contract
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Data Engineer
I am working with a rapidly growing, category-defining technology company that is transforming how industrial organisations operate and compete through deep data integration, generative AI, and tailored enterprise workflows.
As part of their continued expansion, they are looking to bring on a Data Engineer to lead client delivery and embed their platform into global operations. This is a strategic, high-impact role where you will work directly with senior stakeholders to solve complex business challenges and drive measurable outcomes through data and AI.
You will join a collaborative, mission-driven team of elite technologists and business leaders, working at the intersection of cutting-edge technology and real-world impact.
As part of this role, you will be responsible for:
- Executing complex data integration projects using PySpark and distributed technologies
- Designing and implementing scalable generative AI workflows using modern AI infrastructure
- Collaborating with cross-functional teams to ensure successful delivery and adoption
- Driving continuous improvement and innovation across client engagements
To be successful in this role, you will have:
- Experience working in data engineering or data integration
- Strong technical skills in Python or PySpark
- Exposure to generative AI platforms or interest in building AI-powered workflows
- Ability to work closely with clients and lead delivery in fast-paced environments
- Exposure to Airflow, Databricks or DBT would be beneficial
Some of the package details include:
- Salary up to 75,000 per year
- Bonus and share options
- Vibrant central London office, working closely with the wider tech function (3 days in office, 2 from home)
This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss further.
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Location: Cardiff (Hybrid - 3 days WFH)
Salary: Up to 62,000 + 10% Bonus + Excellent Benefits
The Role
CPS Group are partnering with a leading organisation to hire an experienced Data Engineer. You'll design, build, and optimise data pipelines and integrations, supporting ERP migration projects and shaping a centralised enterprise data platform. This is a key role ensuring reliable, high-quality data for business intelligence and decision-making.
Key Responsibilities:
* Build and maintain scalable data pipelines (SQL / Azure).
* Support ERP migration and system integrations.
* Ensure data quality, validation, and performance.
* Collaborate with BI and Data teams to deliver business insights.
* Apply DataOps best practices (version control, CI/CD, documentation).
Skills & Experience:
* Strong SQL development and optimisation skills.
* Experience with MS SQL Server, Azure SQL, Azure Data Factory.
* Proven track record in data engineering, ETL/ELT, and system migrations.
* Knowledge of data modelling, governance, and quality assurance.
* Excellent communication and problem-solving abilities.
Benefits:
* Up to 62,000 + 10% Bonus
* Private Healthcare
* 6% Employer Contribution Pension
* 25 days holiday + bank holidays
* Flexible hybrid working
* Free Parking
* Life Assurance (3x Salary)
If interested in finding out more details, please email a copy of your CV and time to arrange a call.
By applying to this advert you are giving CPS Group (UK) Ltd authority to hold and process your data for this specific role and any other roles we may deem suitable to you over time. We will not pass your data to any third party without your verbal or written permission to do so. All incoming and outgoing calls are recorded for training and compliance purposes. CPS Group (UK) Ltd is acting as an Employment Agency in relation to this vacancy. Our new privacy policy can be found here (url removed)>
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Data Engineer
Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting.
With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential of the company's data and drive data-led decision-making.
As part of this role, you will be responsible for some of the following areas
- Architect and build a scalable data platform integrating diverse data sources
- Develop and maintain robust, efficient data pipelines
- Write clean, reliable code to transform and manipulate data
- Partner with senior technical leaders to shape modern data platform best practices
- Contribute to long-term data strategy with a strong focus on data integrity and GDPR compliance
To be successful in the role you will have
- Hands-on coding experience with Python or PySpark
- Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines
- Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse
- Strong command of SQL
- Excellent communication and collaboration skills
What's in It for You:
- Up to 60,000 salary depending on experience
- Hybrid working: 3 days in Bristol office, 2 days from home
- 24 days annual leave plus bank holidays (rising to 27 with service)
- Private healthcare and other wellness benefits
- Company pension scheme
This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will call you to discuss further. My client is looking to begin the interview process ASAP, so don't miss out, APPLY now! To do so please email me at (url removed) or call me on (phone number removed).
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Data Engineer
- Data Integration, ETL pipelines, BigQuery
- Fareham, Hampshire. This role is to work in the office full time.
- Salary circa 60,000 plus benefits
In 2023, cybercrime cost UK businesses an estimated 21 billion. But don't think its the just the big corporates at risk, the average cybercrime value in the UK is just over 10,000 demonstrating that personal finance and small business cybercrime is rife.
Would you like to be part of the solution?
We are working with an award winning leader in the field of cyber security. They are on a mission to build a safer digital world for you and your future self! They have built a suite of innovative products designed to offer superior protection against a broad spectrum of online threats.
The role of Data Engineer is a new position in the team demonstrating the increasing demand for a robust cyber solution.
Working with a talented software team you will be helping to build and maintain my clients data infrastructure with a specific emphasis on BigQuery and Looker for business intelligence and reporting. You will be responsible for developing and managing ETL pipelines that seamlessly integrate data from various sources, transforming it into a clean, structured, and easily accessible format.
On top of a competitive salary (approx 60k) the company offer some fantastic financial and lifestyle benefits including; free access to local gym, onsite chef (free cooked breakfast & lunch!), childcare vouchers, cycle to work scheme, pension, BUPA healthcare, investment in training and personal development.
Key Responsibilities
- Data Integration and ETL
- Data Warehousing and Modelling
- Business Intelligence and Reporting
- Data Quality and Governance
Technical Skills:
- ETL
- Looker
- BigQuery
- Cloud technologies such as GCP or AWS
- SCSS / The company offers a competitive salary, exposure to new technology, career progression and a great working environment with a talented team.
Interviews are being held within the next couple of weeks so please get in touch via email or give me a call on the following (url removed) or call (phone number removed)
Spectrum IT Recruitment (South) Limited is acting as an Employment Agency in relation to this vacancy.
Be The First To Know
About the latest Data engineer Jobs in United Kingdom !
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Data Engineer - Azure & Databricks
Location: Hebburn (Hybrid)
Contract Length: 6 months (with potential to extend)
(outside IR35 - to be confirmed)
A leading organisation is seeking an experienced Data Engineer with strong expertise in the Azure Data Stack and Databricks to support a key data transformation initiative. This is a hands-on delivery role, ideal for someone who thrives in a fast-paced environment and can work closely with stakeholders to build scalable, cloud-native data solutions.
Key Details:
* Onsite presence required at the Hebburn office - frequency to be confirmed with the client
* Initial 6-month contract with strong potential for extension
Required Skills:
* Proven experience with the Azure Data Stack (Azure Data Factory, Azure Synapse, Azure SQL, ADLS Gen2)
* Strong hands-on expertise with Databricks (Spark, Delta Lake, notebooks, orchestration)
* Experience building and optimising data pipelines for analytics and reporting
* Ability to work collaboratively with cross-functional teams and stakeholders
* Strong communication and problem-solving skills
Please send CV's over to (url removed)
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Data Engineer
Location: Hammersmith - Hybrid after probation
Salary: 38,000 -45,000
Join Our Team as a Data Engineer!
About Us : Join a forward-thinking organisation dedicated to revolutionising retail through innovative solutions and operations. We leverage physical spaces to test new concepts and pilot initiatives, helping brands and retailers thrive in a dynamic marketplace.
What You'll Do :
As our Data Engineer, you will play a pivotal role in the day-to-day management and maintenance of our data infrastructure, driving our large-scale programmes in the USA. Your primary responsibilities will include :
- Design & Development: Create, develop, and maintain scalable data pipelines and ETL processes across various systems.
- Data Integration: Build and manage seamless data integrations from diverse sources, including POS systems, e-commerce platforms, RFID sensors, IoT devices, and CRM systems.
- Data optimisation: Develop and optimise data models to support reporting, analytics, and machine learning initiatives.
- Data Quality Assurance: Ensure data accuracy, consistency, security, and compliance with U.S. data privacy standards (CCPA, HIPAA).
- Monitoring & Troubleshooting: Monitor, troubleshoot, and enhance data pipelines to maximise reliability and performance.
- Collaboration: Work closely with teams to deliver datasets that empower insight and decision-making.
- Strategic Contribution: Contribute to our data strategy by evaluating and implementing modern data tools and practises.
- Documentation: Document data flows, schemas, and processes to support knowledge sharing and scalability.
About You :
To thrive in this role, you will need :
- Strong knowledge of Python and APIs for effective data integration.
- Familiarity with cloud platforms, preferably Azure (AWS, GCP experience is also valuable).
- Experience managing large and complex datasets, with a strong command of SQL for cloud-based environments (Fabric, Snowflake, BigQuery, Redshift, etc.).
- A solid understanding of data modelling techniques (star schema, data vault, dimensional modelling).
- Proficiency in Excel-based data workflows for various Agile Retail projects.
- Hands-on experience with data pipeline orchestration tools (Airflow, dbt, Prefect, or similar).
Benefits:
- Unlimited holiday
- Annual Wellbeing Allowance
- Flexible work culture
- Monthly socials and events
- Complimentary snack bar
- Employer pension contribution
If you're a data enthusiast ready to innovate and drive impactful solutions in retail, we want to hear from you!
Office Angels is an employment agency and business. We are an equal-opportunities employer who puts expertise, energy and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, abilities and more. By showcasing talents, skills and unique experiences in an inclusive environment, we help individuals thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.
Office Angels acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers. Office Angels UK is an Equal Opportunities Employer.
By applying for this role your details will be submitted to Office Angels. Our Candidate Privacy Information Statement explaining how we will use your information is available on our website.
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Data Engineer - Portsmouth - 60,000
A rapidly growing software company in Portsmouth is looking for a Data Engineer to lead the build of their first-ever data platform. This is a greenfield opportunity to architect and implement scalable data infrastructure from scratch, with the potential to grow into a team lead role.
With over 100 employees and continued expansion, they're now investing in data to support smarter decision-making across their subscription-based business. This is a hands-on role with strategic impact. You'll have the autonomy to choose the right tools and shape the data architecture. If successful, you'll have the opportunity to grow the data function and step into a leadership role.
The Role:
- Designing and building robust ETL pipelines using tools like dbt or Apache Airflow
- Integrating data from APIs, databases, and SaaS platforms into BigQuery
- Structuring clean, queryable data models to support analytics and reporting
- Collaborating with analysts to deliver insightful dashboards via Looker
- Establishing data governance and quality processes
Requirements:
- GCP (BigQuery), but open to other cloud backgrounds
- ETL: dbt, Apache Airflow, or similar
- BI: Looker (preferred), or other BI tools
- Languages: SQL, Python, Java
- Experienced data engineer, with strong ETL and cloud data warehouse experience
- Proficiency in SQL and data modelling best practices
- Experience with BI tools and dashboard creation
- Self-starter attitude with minimal supervision required
Package:
- Competitive salary up to 70,000 + discretionary bonus (performance reviewed twice a year)
- Discounts, perks, and 20 days holiday
Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.
Contact me: (url removed)