504 Jr Data Engineer jobs in the United Kingdom

Jr Data Engineer

Greater Manchester, North West £25000 - £30000 Annually The Portfolio Group

Posted 14 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Our client is a dynamic and ambitious insurance company based in the heart of Manchester, and they're on the lookout for a talented Junior Data Engineer to help them drive data-led decisions as they scale. If you're passionate about transforming raw data into actionable insights and thrive in a collaborative, small-team environment - they'd love to meet you.

5 days on site | £30,000 per year

What You'll Be Doing

  • Assist our Data Engineer in developing Python scripts to extract, transform, and validate data against our MySQL database.
  • li>Upload and structure data for our platform to support efficient reporting and analysis.
  • Collaborate with stakeholders and our BI Analyst to understand data requirements and deliver actionable insights.
  • Participate in code reviews and contribute to continuous improvement of data engineering practices.
  • Document code functionality, workflows, and changes clearly and consistently.
  • Follow agile development principles and contribute to sprint planning and tracking.
  • Participate in planning, designing and developing our future migration of automated ETL processing of our data on a chosen cloud platform.

What We're Looking For

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • Strong grasp of Python fundamentals including:
    • Functional programming
    • Object-oriented programming (OOP)
    • Data types and structures
    • Unit testing using pytest
  • Proficiency in SQL (we use MySQL, but experience with other SQL platforms is welcome).
  • Experience with data manipulation and transformation using Pandas .
  • Familiarity with ETL/ELT processes and data warehousing concepts.
  • Understanding of cloud platforms (AWS or Azure).
  • Basic knowledge of Git and GitHub for version control and collaboration.
  • Awareness of best practices for managing credentials and sensitive data (e.g., using .gitignore).
  • Experience managing Python virtual environments and packages.
  • Strong problem-solving skills, adaptability, and eagerness to learn.


If you're interested, please apply below!

INDMANJ

49567NB

This advertiser has chosen not to accept applicants from your region.

Data Engineer

London, London £400 - £450 Daily Tenth Revolution Group

Posted 5 days ago

Job Viewed

Tap Again To Close

Job Description

contract

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy



Overview

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.



Responsibilities

  • Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
  • Develop scalable ETL processes using PySpark and Python
  • Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
  • Ensure data quality, governance, and performance throughout the migration lifecycle
  • Document technical processes and support knowledge transfer to internal teams


Required Skills

  • Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
  • Proven track record in delivering data migration projects within Azure environments
  • Ability to work independently and communicate effectively with technical and non-technical stakeholders
  • Previous experience in consultancy or client-facing roles is advantageous
This advertiser has chosen not to accept applicants from your region.

Data Engineer

Irlam, North West First Recruitment Group

Posted 6 days ago

Job Viewed

Tap Again To Close

Job Description

contract

Our top telecoms client is looking for a Data Engineer to join their team on a staff or contract basis

Our Client has a requirement for a Data Engineer, who will be required to work on a staff or contract basis in Irlam (Manchester).

Role Purpose:

  • The BI Data Engineer will be responsible for leading and developing and reporting views to ensure data-driven insights are underpinned by a validated dataset, aligning to the data definitions set out by the business.

    In addition, this role will focus on data engineering, building and managing the infrastructure that allows Freedom Fibre to collect, store, and analyse data. The role will involve designing, building, and maintaining databases to ensure data is readily available, reliable, and efficient for various purposes, including data science and business intelligence. This will also include developing and maintaining API integrations with systems to extract and load data into the database.

    The role will also be responsible for designing, developing, and maintaining interactive Power BI dashboards using advanced SQL and Python to extract, transform, and model data for optimal performance and usability.

Job Role Responsibilities:

    • Create, maintain, and optimise reports and interactive Power BI dashboards to meet internal and external customer needs, using advanced SQL queries and Python scripts for data extraction, transformation, and modelling.
    • Design, build, and maintain scalable database solutions that ensure high availability, security, and performance.
    • Build and maintain ETL (Extract, Transform, Load) pipelines to automate the movement and transformation of data from multiple sources into a central database.
    • Develop and maintain API integrations with business systems to ensure seamless, reliable, and timely data ingestion.
    • Analyse, mine, and process internal data using datasets from business systems to deliver validated outputs.
    • Ensure all data architecture and infrastructure supports both operational and analytical needs, enabling effective data science and BI activities.
    • Work closely and collaboratively with internal FFL departments to ensure the BI Team meets all reporting requirements and deadlines.
    • Drive continuous improvement of processes, highlight data discrepancies, and create operational procedures to address data quality.
    • Input into new system selection and upgrades to ensure data for reporting is correctly generated and stored.
    • Regularly conduct data integrity checks and use automation to enhance efficiency and insight generation.
    • Define and monitor key performance indicators, ensuring alignment with business objectives.
    • Research and implement ways to better utilise company data and automation to deliver results faster and with greater accuracy.

Experience / Skills / Knowledge / Qualifications:

    • Proficiency with Microsoft applications, e.g. Excel formulas, pivots, charts, and Power BI dashboards.
    • Strong knowledge of data management platforms and database design.
    • Hands-on experience with SQL for database querying, optimisation, and Power BI data modelling.
    • Proficiency in Python for data manipulation, automation, and advanced analytics.
    • Experience designing and implementing ETL processes and data pipelines.
    • Experience with API development and integration for data ingestion.
    • Ability to analyse, model, and interpret data, including identifying trends and patterns in complex datasets.
    • Familiarity with programming principles to support automation and data processing tasks.
    • Previous experience within Telecoms, specifically Fibre-related products and understanding of network topologies (POP / XGS-PON) preferred.
    • Strong analytical skills with the ability to collect, organise, analyse, and disseminate large volumes of data accurately.

    Qualifications

    • Ideally qualified to degree level in a relevant subject, or experience equivalent to this
    • Power BI and/or relevant technical certifications (e.g. SQL, Python, Data Engineering, API Development) desirable.

Benefits:

  • Staff or contract
  • Negotiable rate
  • Hybrid working

Company information

At First Recruitment Group we understand just how important it is to secure the right people. That is why our Recruitment Consultants always take the time to understand requirements in detail and offer sound advice to both clients and candidates.  We actively recruit at all levels and this is a superb opportunity for a  Data Engineer looking for new employment.

As part of putting people first, we strive to be an equal opportunities employer and we are always looking to increase the diversity of our workforce, working closely with our clients to ensure everyone is included.

This advertiser has chosen not to accept applicants from your region.

Data Engineer

London, London £400 - £450 Daily Tenth Revolution Group

Posted 7 days ago

Job Viewed

Tap Again To Close

Job Description

contract

Contract Role: Data Engineer - Azure Migration Project
Location: Hybrid (2 days/week onsite in London)
Contract Length: 6 months
Day Rate: 450/day (Outside IR35)
Start Date: ASAP
Sector: Consultancy



Overview

We are recruiting on behalf of a consultancy client for an experienced Data Engineer to support a strategic data migration project . The role involves migrating legacy data systems to a modern Azure-based architecture, with a focus on performance, scalability, and reliability.



Responsibilities

  • Design and implement robust data migration pipelines using Azure Data Factory, Synapse Analytics, and Databricks
  • Develop scalable ETL processes using PySpark and Python
  • Collaborate with stakeholders to understand legacy data structures and ensure accurate mapping and transformation
  • Ensure data quality, governance, and performance throughout the migration lifecycle
  • Document technical processes and support knowledge transfer to internal teams


Required Skills

  • Strong hands-on experience with Azure Data Factory, Synapse, Databricks, PySpark, Python, and SQL
  • Proven track record in delivering data migration projects within Azure environments
  • Ability to work independently and communicate effectively with technical and non-technical stakeholders
  • Previous experience in consultancy or client-facing roles is advantageous
This advertiser has chosen not to accept applicants from your region.

Data Engineer

London, London £125000 - £140000 Annually Tenth Revolution Group

Posted 7 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer

I am working with a leading, AI driven organisation that supports its clients' marketing campaigns, expanding its data engineering capabilities and looking for a Data Engineer to join their team. This is a fantastic opportunity to join an award-winning tech business where you will have the opportunity to work at the forefront of data architecture, building distributed systems and leveraging Gen AI tools to accelerate development and improve quality.

You will be encouraged to explore new ways to utilise modern technologies and will be positioned to help mentor other members of the technical team whilst leading innovative technical projects.

As part of this role, you will be responsible for some of the following areas:

  • Design and build distributed data pipelines using languages such as Spark, Scala, and Java
  • Collaborate with cross-functional teams to deliver user-centric solutions
  • Lead on the design and development of relational and non-relational databases
  • Apply Gen AI tools to boost development speed and code quality
  • Maintain and optimise large-scale data collection processes
  • Support the deployment of machine learning models into production

To be successful in the role you will have:

  • Creating scalable ETL jobs using Scala and Spark
  • Strong understanding of data structures, algorithms, and distributed systems
  • Experience working with orchestration tools such as Airflow
  • Familiarity with cloud technologies (AWS or GCP)
  • Hands-on experience with Gen AI tools for coding and debugging

This is a remote-first role with flexibility to work from anywhere in the UK. Some of the benefits included with the role are listed below:

  • Salary of up to 140,000
  • Unlimited holiday allowance
  • Fully covered private medical care
  • Enhanced parental leave policies
  • Bespoke training and career development plans
  • Regular socials, volunteer days, and a birthday day off

This is just a brief overview of the role. For the full information, simply apply with your CV and I'll be in touch to discuss further. Interviews are already underway, so don't miss out - APPLY now! To do so, please email me at (url removed) or call directly on (phone number removed).

This advertiser has chosen not to accept applicants from your region.

Data Engineer

Edinburgh, Scotland £100000 - £140000 Annually Tenth Revolution Group

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer - UK - Remote

A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech company.

About the role:

  • Build and maintain distributed data systems processing millions of data points daily.
  • Design complex Spark jobs, asynchronous APIs, and scalable data pipelines.
  • Collaborate with Data Science and Web teams to deliver user-centric solutions.
  • Use Gen AI tools to accelerate development and improve quality.

Requirements:

  • Strong experience with Scala, Java, and distributed systems (Spark).
  • Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms.
  • Familiarity with Gen AI tools for coding and debugging.
  • Solid understanding of data structures, algorithms, and database technologies.
  • A collaborative mindset and a passion for solving complex problems.

Benefits:

  • Trust-Based Vacation Policy - take time off when you need it
  • Private Medical Healthcare
  • Generous Parental Leave & Pension Scheme
  • Monthly Hackdays & Career Development Plans
  • Remote first
  • And more

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Contact me: (url removed)

This advertiser has chosen not to accept applicants from your region.

Data Engineer

London, London £50000 - £62000 Annually Tenth Revolution Group

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Location: Central London (Hybrid - 3 days in office)
Salary: Up to 62,000 per annum
Contract Type: Fixed Term (18 months)

Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking for a hands-on Data Engineer to help build the foundations of their future data estate.

This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets.

You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation.

What You'll Be Doing:

  • Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks.
  • Integrate data from enterprise systems (e.g. Dynamics, iTrent, Unit4) into a unified data platform.
  • Cleanse, transform, and model data to support BI tools (e.g., Power BI) and AI/ML use cases.
  • Implement data validation, lineage tracking, and metadata tagging for observability and trust.
  • Collaborate with stakeholders to standardise KPIs and support cross-functional reporting.
  • Ensure secure handling of sensitive data in line with GDPR and internal policies.

What We're Looking For:

  • Solid experience in data engineering or backend data development.
  • Strong experience with Azure data services (e.g., Data Factory, Dake Lake, Synapse, Databricks) and tools like dbt.
  • Proficiency in SQL and Python, with a solid understanding of data modelling and transformation.
  • Experience integrating data from enterprise systems (CRM, ERP, HRIS).
  • Familiarity with DevOps practices (CI/CD, version control, monitoring) in a data context.

What's On Offer:

  • A salary of up to 62,000 depending on experience
  • 29 days annual leave plus bank holidays
  • A generous pension scheme

This is more than just a technical role-it's a chance to help shape the data future of a globally respected institution. If you're passionate about building high-quality data pipelines and enabling insight through clean, trusted data, we'd love to hear from you.

Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.

Tenth Revolution Group / Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed)

This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Jr data engineer Jobs in United Kingdom !

Data Engineer

Derby, East Midlands £40000 - £52500 Annually Morson Talent

Posted 8 days ago

Job Viewed

Tap Again To Close

Job Description

permanent

Data Engineer
Location: Derby (Hybrid)
Salary: Up To £52,500 + 12.5% Bonus
Key Skills: Azure, SQL, Python, Power BI, Data Visualization

Are you passionate about building data platforms that power innovation, insight, and advanced analytics? We are looking for a Data Engineer to help shape the future of clean energy by enabling smarter decisions with data.
As part of the growing Digital & Data team, you’ll play a pivotal role in designing and delivering scalable data pipelines, building robust data infrastructure, and creating visualisations that bring insights to life for stakeholders across the business. With exponential growth expected over the next few years, this is a unique opportunity to help shape the foundations of our data strategy at a transformative stage.

What You’ll Be Doing
• Building Data Foundations – Design, build, and optimise secure and scalable data pipelines and infrastructure to support analytics, reporting, and digital applications.
• Engaging with Stakeholders – Partner with business teams to understand data needs, present insights through compelling visualisations, and influence decision-making.
• Data Modelling & Integration – Develop models and integration frameworks that make data accessible, consistent, and reusable across platforms.
• Driving Data Quality – Implement robust validation, cleansing, and monitoring processes to ensure data integrity and compliance.
• Innovation & Future Focus – Explore and experiment with new technologies, including AI and machine learning, to unlock value from complex and unique datasets.
What We’re Looking For
We know there’s no such thing as the _perfect_ candidate. If you meet around 75% of the criteria, we’d still love to hear from you.
• Strong experience with data engineering tools and platforms (e.g. Azure Data Factory, Databricks, SQL, Python).
• Proven ability to engage stakeholders and present insights through data visualisation tools and storytelling.
• Experience with data modelling, warehousing, and integration.
• Interest in and awareness of AI and emerging technologies.
• Ability to thrive in an agile, fast-growing environment, managing both highly complex data and scalable solutions.
Beneficial (but not essential):
• Degree in engineering, science, or IT discipline.
• Microsoft Azure certifications or BCS Data Management qualifications.
• Experience embedding data modelling practices into delivery workflows.

Why Join Us?
• Be at the forefront of a transformational energy programme.
• Work on unique, complex datasets with high-impact outcomes.
• Shape data foundations during a period of rapid organisational growth.
• Flexible and inclusive working environment, with support for work-life balance.
• A culture that values diversity, innovation, and continuous learning.

Data Engineer
Location: Derby (Hybrid)
Salary: Up To £52,500 + 12.5% Bonus
Key Skills: Azure, SQL, Python, Power BI, Data Visualization

This advertiser has chosen not to accept applicants from your region.

Data Engineer

Stevenage, Eastern £50000 - £55000 Annually Electus Recruitment Solutions

Posted 9 days ago

Job Viewed

Tap Again To Close

Job Description

permanent
Data Engineer (Generative AI) - Defence & Technology - British Citizens only
Are you a Data Engineer ready to build and secure the next generation of data pipelines for cutting-edge Generative AI projects?
We're working with a highly respected, multinational defence and technology company looking for a skilled Data Engineer to join a new, international team. This is a unique opportunity to directly shape the technology roadmap and deliver critical, high-impact solutions.
In this role, you will be responsible for evaluating, designing, and maintaining resilient data sets, collaborating with internal customers to optimise their data for security and performance. A key part of your work will involve staying ahead of new technology trends to ensure the company remains at the forefront of Generative AI.

What we're looking for:

  • Expertise in SQL and noSQL technologies (e.g., MS SQL, Oracle, MongoDB).
  • Experience with data processing and exchange (ETL, ESB, API).
  • Strong development skills, particularly with Python.
  • Big data experience/knowledge (hadoop etc)
  • Advantageous to have knowledge of Generative AI, Natural Language Processing, Object Character Recognition, and containerisation (Docker).
This is a hybrid role, with a need for 2-3 days on-site. Candidates must be British Citizens to meet security clearance requirements.

Why this role stands out:

  • Meaningful Work: Contribute to mission-critical projects that protect the nation.
  • Career Growth: Join a developing structure with significant opportunities to influence strategy.
  • Excellent Benefits: Enjoy a competitive package including a pension contribution of up to 14%, a company bonus, and paid overtime.
If you are a talented Data Engineer who wants to use their skills to make a tangible impact in a secure and innovative environment, please get in touch for a confidential discussion.
This advertiser has chosen not to accept applicants from your region.

Data Engineer

London, London £650 - £745 Daily JAM Recruitment Ltd

Posted 9 days ago

Job Viewed

Tap Again To Close

Job Description

contract

eSC Cleared Data Engineer

Bristol or London (Mostly working from home)

Up to 745 per day (Umbrella, Inside IR35)

Must hold live and transferrable Enhanced SC Security Clearance

About the Role

We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll be instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems.

If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact.

Key Responsibilities

  • Design & Optimise Pipelines - Build and refine ETL/ELT workflows using Apache Airflow for orchestration.
  • Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services.
  • Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift).
  • Data Quality & Governance - Implement automated validation, testing, and monitoring for data integrity.
  • Performance & Troubleshooting - Monitor workflows, enhance logging/alerting, and fine-tune performance.
  • Data Modelling - Handle schema evolution, partitioning strategies, and efficient data structures.
  • CI/CD for Data - Work with DevOps teams to integrate pipelines into robust CI/CD processes, managing version control for DAGs and configurations.
  • Security & Compliance - Apply encryption, access control (IAM), and GDPR-aligned data practices.

Technical Skills & Experience

  • Proficient in Python and SQL for data processing.
  • Solid experience with Apache Airflow - writing and configuring DAGs.
  • Strong AWS skills (S3, Redshift, etc.).
  • Big data experience with Apache Spark.
  • Knowledge of data modelling, schema design, and partitioning.
  • Understanding of batch and streaming data architectures (e.g., Kafka).
  • Experience with Docker and/or Kubernetes.
  • Familiarity with Microsoft SQL Server Stack (SQL Server, SSIS, C#, T-SQL), Elastic/OpenSearch.

Interested?

If you're ready to bring your data engineering expertise to a technically challenging and rewarding programme, apply now with your CV.

This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Jr Data Engineer Jobs