520 Etl Developer jobs in the United Kingdom
Jr Data Engineer
Posted 14 days ago
Job Viewed
Job Description
Our client is a dynamic and ambitious insurance company based in the heart of Manchester, and they're on the lookout for a talented Junior Data Engineer to help them drive data-led decisions as they scale. If you're passionate about transforming raw data into actionable insights and thrive in a collaborative, small-team environment - they'd love to meet you.
5 days on site | £30,000 per year
What You'll Be Doing
- Assist our Data Engineer in developing Python scripts to extract, transform, and validate data against our MySQL database. li>Upload and structure data for our platform to support efficient reporting and analysis.
- Collaborate with stakeholders and our BI Analyst to understand data requirements and deliver actionable insights.
- Participate in code reviews and contribute to continuous improvement of data engineering practices.
- Document code functionality, workflows, and changes clearly and consistently.
- Follow agile development principles and contribute to sprint planning and tracking.
- Participate in planning, designing and developing our future migration of automated ETL processing of our data on a chosen cloud platform.
What We're Looking For
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
- Strong grasp of Python fundamentals including:
- Functional programming
- Object-oriented programming (OOP)
- Data types and structures
- Unit testing using pytest
- Proficiency in SQL (we use MySQL, but experience with other SQL platforms is welcome).
- Experience with data manipulation and transformation using Pandas .
- Familiarity with ETL/ELT processes and data warehousing concepts.
- Understanding of cloud platforms (AWS or Azure).
- Basic knowledge of Git and GitHub for version control and collaboration.
- Awareness of best practices for managing credentials and sensitive data (e.g., using .gitignore).
- Experience managing Python virtual environments and packages.
- Strong problem-solving skills, adaptability, and eagerness to learn.
If you're interested, please apply below!
INDMANJ
49567NB
Lead Database Developer
Posted 4 days ago
Job Viewed
Job Description
- Are you empathetic to client needs and inspired by transformation and impacting the lives of millions of people every day?
- Are you looking to join a dynamic, inclusive team environment with a culture of collaboration and belonging?
Well, this may be the role for you. Ready to design what's next?
In this role, you will work with multiple scrum teams alongside other SQL Server experts to help them bring the ideas to life for new or improved web applications. This work will support a mix of internal and external clients, and you will be working on projects currently in production.
To thrive in this career, you'll need to be an expert in TSQL / SQL Server on highly transactional enterprise systems. Your role will be key to reviewing and reducing database contention risks and implementing strategies for managing and enabling performance and scalability across the application.
Like our best developers, you are an enthusiastic creator eager to learn and take on stretch assignments. You strive to learn emerging technologies and find ways to incorporate what you learn into building your products. As part of our team, you will find exciting challenges, get opportunities to grow your career, and develop solid friendships as we design what's next for ADP and the industry. Pace should not scare you. We still find time for a healthy dose of fun.
**WHAT YOU'LL DO:**
Here's what you can expect on a typical day:
● **Agile.** You'll start each day with a scrum, working in a team to understand responsibilities, identify issues, and communicate coding priorities while choosing user stories to complete. You will also participate in other agile ceremonies, including scheduled sprint demos, where you will present your work to up to 90 stakeholders.
● **Development.** Working in two week sprints you will review and optimize data access across the application, analyze and identify performance and scalability concerns and implement solutions to enhance the resilience of an enterprise grade OLTP system.
● **Continuous Learning** . You will attend "lunch and learn" sessions to actively collaborate with other developers to share ideas or show what you've learned. An eagerness to learn will help you keep up with ever-changing technologies and maintain the ability to create the best tools for our clients.
● **Support.** You're working on products currently in use. You will act as a point of contact for one day/week, supporting your clients for any urgent issues that require resolution. You'll start those days with your regular work activity but will have to switch gears to a support role as needed throughout your assigned support day.
● **Experience.** You have 10+ years of experience using back and end Database technologies with solid TSQL experience including writing stored procedures, functions and views.
**TO SUCCEED IN THIS ROLE:**
● You'll have a Bachelor's degree OR equivalent.
● You'll be an expert in TSQL / SQL Server and have a firm grasp on OLTP Systems with experience of reporting BI and OLAP.
● You'll be comfortable working with software development teams ensuring adherence to SQL best practice and helping them to optimize existing and new data access.
● You'll have expert knowledge of distributed transactions, transaction structure, isolation levels, nested transactions, latching and locking.
**YOU'LL LOVE WORKING HERE BECAUSE YOU CAN:**
● **Have courageous team collaboration.** Courage comes from how associates are willing to have difficult conversations, speak up, be an owner, and challenge one another's ideas to find the best solution.
● **Deliver at epic scale.** We deliver real user outcomes using strong judgment and good instincts. We're obsessed with the art of achieving simplicity with a focus on client happiness and productivity.
● **Be surrounded by curious learners.** We align ourselves with other smart people in an environment where we grow and elevate one another to the next level. We encourage our associates to listen, stay agile, and learn from mistakes.
● **Act like an owner & doer.** Mission-driven and committed to leading change, you will be encouraged to take on any challenge and solve complex problems. No tasks are beneath or too great for us. We are hands-on and willing to master our craft.
● **Give back to others.** Always do the right thing for our clients and our community and humbly give back to the community where we live and work. Support our associates in times of need through ADP's Philanthropic Foundation.
● **Join a company committed to equality and equity.** Our goal is to impact lasting change through our actions.
**A little about ADP:** We are a comprehensive global provider of cloud-based human capital management (HCM) solutions that unite HR, payroll, talent, time, tax and benefits administration and a leader in business outsourcing services, analytics, and compliance expertise. We believe our people make all the difference in cultivating a down-to-earth culture that embraces our core values, welcomes ideas, encourages innovation, and values belonging. We've received recognition for our work by many esteemed organizations, learn more at ADP Awards and Recognition ( .
**Diversity, Equity, Inclusion & Equal Employment Opportunity at ADP:** ADP is committed to an inclusive, diverse and equitable workplace, and is further committed to providing equal employment opportunities regardless of any protected characteristic including: race, color, genetic information, creed, national origin, religion, sex, affectional or sexual orientation, gender identity or expression, lawful alien status, ancestry, age, marital status, protected veteran status or disability. Hiring decisions are based upon ADP's operating needs, and applicant merit including, but not limited to, qualifications, experience, ability, availability, cooperation, and job performance.
**Ethics at ADP:** ADP has a long, proud history of conducting business with the highest ethical standards and full compliance with all applicable laws. We also expect our people to uphold our values with the highest level of integrity and behave in a manner that fosters an honest and respectful workplace. Click to learn more about ADP's culture and our full set of values.
Database Developer Analyst
Posted 24 days ago
Job Viewed
Job Description
By Joining Citi, you will become part of a global organisation whose mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress.
**Responsibilities:**
+ Problem solving and understanding key objectives
+ Perform coding tasks and refactor code Use of Copilot
+ Participate daily stand-up meetings
+ Review and prioritize tasks
+ Ensure code is produces following Citi Engineering standards
+ Perform data quality and checks
+ Collaborate on design
+ Expand knowledge and understanding of SDLC process and protocols.
+ Work with Global Teams and Citi Teams
**Qualifications:**
+ Relevant experience in the Financial Service industry
+ Intermediate level experience in Applications Development role
+ In depth knowledge of Java, react for front end, spring boot, Kafka, Distributed Cache/Systems
+ Hands on experience on relational databases like Oracle with ability to write and evaluate SQLs
+ Fair understanding of the branching strategy in git repositories
+ Good to have knowledge of working in Agile methodology
+ Consistently demonstrates clear and concise written and verbal communication
+ Demonstrated problem-solving and decision-making skills
+ Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy
Overview
We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.
Responsibilities
- Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
- Develop scalable ETL processes using PySpark and Python
- Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
- Ensure data quality, governance, and performance throughout the migration lifecycle
- Document technical processes and support knowledge transfer to internal teams
Required Skills
- Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
- Proven track record in delivering data migration projects within Azure environments
- Ability to work independently and communicate effectively with technical and non-technical stakeholders
- Previous experience in consultancy or client-facing roles is advantageous
Data Engineer
Posted 6 days ago
Job Viewed
Job Description
Our top telecoms client is looking for a Data Engineer to join their team on a staff or contract basis
Our Client has a requirement for a Data Engineer, who will be required to work on a staff or contract basis in Irlam (Manchester).
Role Purpose:
-
The BI Data Engineer will be responsible for leading and developing and reporting views to ensure data-driven insights are underpinned by a validated dataset, aligning to the data definitions set out by the business.
In addition, this role will focus on data engineering, building and managing the infrastructure that allows Freedom Fibre to collect, store, and analyse data. The role will involve designing, building, and maintaining databases to ensure data is readily available, reliable, and efficient for various purposes, including data science and business intelligence. This will also include developing and maintaining API integrations with systems to extract and load data into the database.
The role will also be responsible for designing, developing, and maintaining interactive Power BI dashboards using advanced SQL and Python to extract, transform, and model data for optimal performance and usability.
Job Role Responsibilities:
-
- Create, maintain, and optimise reports and interactive Power BI dashboards to meet internal and external customer needs, using advanced SQL queries and Python scripts for data extraction, transformation, and modelling.
- Design, build, and maintain scalable database solutions that ensure high availability, security, and performance.
- Build and maintain ETL (Extract, Transform, Load) pipelines to automate the movement and transformation of data from multiple sources into a central database.
- Develop and maintain API integrations with business systems to ensure seamless, reliable, and timely data ingestion.
- Analyse, mine, and process internal data using datasets from business systems to deliver validated outputs.
- Ensure all data architecture and infrastructure supports both operational and analytical needs, enabling effective data science and BI activities.
- Work closely and collaboratively with internal FFL departments to ensure the BI Team meets all reporting requirements and deadlines.
- Drive continuous improvement of processes, highlight data discrepancies, and create operational procedures to address data quality.
- Input into new system selection and upgrades to ensure data for reporting is correctly generated and stored.
- Regularly conduct data integrity checks and use automation to enhance efficiency and insight generation.
- Define and monitor key performance indicators, ensuring alignment with business objectives.
- Research and implement ways to better utilise company data and automation to deliver results faster and with greater accuracy.
Experience / Skills / Knowledge / Qualifications:
-
- Proficiency with Microsoft applications, e.g. Excel formulas, pivots, charts, and Power BI dashboards.
- Strong knowledge of data management platforms and database design.
- Hands-on experience with SQL for database querying, optimisation, and Power BI data modelling.
- Proficiency in Python for data manipulation, automation, and advanced analytics.
- Experience designing and implementing ETL processes and data pipelines.
- Experience with API development and integration for data ingestion.
- Ability to analyse, model, and interpret data, including identifying trends and patterns in complex datasets.
- Familiarity with programming principles to support automation and data processing tasks.
- Previous experience within Telecoms, specifically Fibre-related products and understanding of network topologies (POP / XGS-PON) preferred.
- Strong analytical skills with the ability to collect, organise, analyse, and disseminate large volumes of data accurately.
Qualifications
- Ideally qualified to degree level in a relevant subject, or experience equivalent to this
- Power BI and/or relevant technical certifications (e.g. SQL, Python, Data Engineering, API Development) desirable.
Benefits:
- Staff or contract
- Negotiable rate
- Hybrid working
Company information
At First Recruitment Group we understand just how important it is to secure the right people. That is why our Recruitment Consultants always take the time to understand requirements in detail and offer sound advice to both clients and candidates. We actively recruit at all levels and this is a superb opportunity for a Data Engineer looking for new employment.
As part of putting people first, we strive to be an equal opportunities employer and we are always looking to increase the diversity of our workforce, working closely with our clients to ensure everyone is included.
Data Engineer
Posted 7 days ago
Job Viewed
Job Description
Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy
Overview
We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.
Responsibilities
- Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
- Develop scalable ETL processes using PySpark and Python
- Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
- Ensure data quality, governance, and performance throughout the migration lifecycle
- Document technical processes and support knowledge transfer to internal teams
Required Skills
- Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
- Proven track record in delivering data migration projects within Azure environments
- Ability to work independently and communicate effectively with technical and non-technical stakeholders
- Previous experience in consultancy or client-facing roles is advantageous
Data Engineer
Posted 7 days ago
Job Viewed
Job Description
Data Engineer
I am working with a leading, AI driven organisation that supports its clients' marketing campaigns, expanding its data engineering capabilities and looking for a Data Engineer to join their team. This is a fantastic opportunity to join an award-winning tech business where you will have the opportunity to work at the forefront of data architecture, building distributed systems and leveraging Gen AI tools to accelerate development and improve quality.
You will be encouraged to explore new ways to utilise modern technologies and will be positioned to help mentor other members of the technical team whilst leading innovative technical projects.
As part of this role, you will be responsible for some of the following areas:
- Design and build distributed data pipelines using languages such as Spark, Scala, and Java
- Collaborate with cross-functional teams to deliver user-centric solutions
- Lead on the design and development of relational and non-relational databases
- Apply Gen AI tools to boost development speed and code quality
- Maintain and optimise large-scale data collection processes
- Support the deployment of machine learning models into production
To be successful in the role you will have:
- Creating scalable ETL jobs using Scala and Spark
- Strong understanding of data structures, algorithms, and distributed systems
- Experience working with orchestration tools such as Airflow
- Familiarity with cloud technologies (AWS or GCP)
- Hands-on experience with Gen AI tools for coding and debugging
This is a remote-first role with flexibility to work from anywhere in the UK. Some of the benefits included with the role are listed below:
- Salary of up to 140,000
- Unlimited holiday allowance
- Fully covered private medical care
- Enhanced parental leave policies
- Bespoke training and career development plans
- Regular socials, volunteer days, and a birthday day off
This is just a brief overview of the role. For the full information, simply apply with your CV and I'll be in touch to discuss further. Interviews are already underway, so don't miss out - APPLY now! To do so, please email me at (url removed) or call directly on (phone number removed).
Be The First To Know
About the latest Etl developer Jobs in United Kingdom !
Data Engineer
Posted 8 days ago
Job Viewed
Job Description
Data Engineer - UK - Remote
A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech company.
About the role:
- Build and maintain distributed data systems processing millions of data points daily.
- Design complex Spark jobs, asynchronous APIs, and scalable data pipelines.
- Collaborate with Data Science and Web teams to deliver user-centric solutions.
- Use Gen AI tools to accelerate development and improve quality.
Requirements:
- Strong experience with Scala, Java, and distributed systems (Spark).
- Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms.
- Familiarity with Gen AI tools for coding and debugging.
- Solid understanding of data structures, algorithms, and database technologies.
- A collaborative mindset and a passion for solving complex problems.
Benefits:
- Trust-Based Vacation Policy - take time off when you need it
- Private Medical Healthcare
- Generous Parental Leave & Pension Scheme
- Monthly Hackdays & Career Development Plans
- Remote first
- And more
Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.
Contact me: (url removed)
Data Engineer
Posted 8 days ago
Job Viewed
Job Description
Location: Central London (Hybrid - 3 days in office)
Salary: Up to 62,000 per annum
Contract Type: Fixed Term (18 months)
Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking for a hands-on Data Engineer to help build the foundations of their future data estate.
This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets.
You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation.
What You'll Be Doing:
- Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks.
- Integrate data from enterprise systems (e.g. Dynamics, iTrent, Unit4) into a unified data platform.
- Cleanse, transform, and model data to support BI tools (e.g., Power BI) and AI/ML use cases.
- Implement data validation, lineage tracking, and metadata tagging for observability and trust.
- Collaborate with stakeholders to standardise KPIs and support cross-functional reporting.
- Ensure secure handling of sensitive data in line with GDPR and internal policies.
What We're Looking For:
- Solid experience in data engineering or backend data development.
- Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt.
- Proficiency in SQL and Python, with a solid understanding of data modelling and transformation.
- Experience integrating data from enterprise systems (CRM, ERP, HRIS).
- Familiarity with DevOps practices (CI/CD, version control, monitoring) in a data context.
What's On Offer:
- A salary of up to 62,000 depending on experience
- 29 days annual leave plus bank holidays
- A generous pension scheme
This is more than just a technical role-it's a chance to help shape the data future of a globally respected institution. If you're passionate about building high-quality data pipelines and enabling insight through clean, trusted data, we'd love to hear from you.
Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.
Tenth Revolution Group / Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed)