41 Data Engineer jobs in Farnborough

The primary purpose of this role is to lead the Thames Water Data Acquisition team. The Data Acquisition team is the gateway between Thames Water application sources and the central Enterprise Data platform. The team are expected to follow the standard acquisition processes to create connections to various data sources and acquire the data and bring it to the TW data lake.

The duties include design.

WHJS1_UKTJ

Forseven, a revolutionary company looking to transform the EV industry through cutting-edge technology and innovative engineering practices, is seeking an exceptional Data Engineer to join our highly skilled and dynamic team. This pivotal role will operate in a hybrid capacity out of one of our offices near Leamington Spa or Shalford (Near Guildford).

As our Data Engineer you will deliver data products supporting a wide range of business demands. Working with the Data Architect, the Data Engineer will be responsible for the implementation and management of data solutions on our cloud infrastructure. The engineer will create and maintain data pipelines, manage storage solutions, undertake data processing, data modelling and enabling data to support effective decision making

We would like you to:

• Work with the data architect to deliver data solutions in line with the overall strategy
• Ensure the success of enterprise-level application data architecture for a wide range of business areas e.g. CRM, PLM, ERP, Aftersales/Dealer Management, Finance & HRIS
• Management of data acquisition and integration for Azured Data Lake covering Azure Data Bricks, ADF and any required 3rd party tools
• Develop and implement key components as needed to create testing criteria to guarantee the fidelity and performance of data architecture
• Collaborate with project managers and business unit leaders for all projects involving enterprise data

Requirements

We would like you to have:

• Experience managing and delivering SQL Server solutions including Azure SQL with strong understanding of relational data structures, theories, principles, and practices
• A few years' experience implementing and delivering Azure solutions for ETL/ELT, Lambda and Kappa architectures
• Experience with establishing changed data capture (CDC) solutions where source systems do not support this
• Working technical knowledge of applications and platforms, including Azure, AWS, SAP & Salesforce
• Demonstrated expertise with repository creation, and data and information system life cycle methodologies
• Experience designing and delivering analytical solutions e.g. DWH, Business Analytics, Statistics and Machine Learning

Benefits

Our Process:

What you can expect from our team:

We will endeavor to review your application and revert back to you within 7 working days.

• Phone Screen with one of our TA team
• Teams Interview with our Data and Analytics Manager
• Teams Interview with a member of our Executive team

About us and our culture…
At Forseven, we are more than just a team of professionals; we are dynamic innovators, visionary collaborators and trailblazers who believe in making a difference. Our passion lies in revolutionising the electric vehicle industry through our cutting-edge advancements and sustainable solutions that aim to transform the way transportation is perceived.

Currently operating under stealth mode, our focus is entirely directed towards achieving excellence as pioneers in creating sustainable mobility solutions which will help shape the future of transportation.

We're looking for enlightened individuals who possess an unwavering passion, relentless drive, and insatiable curiosity to question conventional norms and push beyond perceived limitations.

Ready to join a team that\'s leading the way in reshaping the future of insurance? Here at esure Group, we are on a mission to revolutionise insurance for good!

We’ve been providing Home and Motor Insurance since 2000, with over 2 million customers trusting us to keep them covered through our esure and Sheilas’ Wheels brands. With a bold commitment for digital innovation, we\'re transforming the way the industry operates and putting customers at the heart of everything we do.

Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future.

We are currently recruiting for a Data Engineer to join our wider data community! You will work in a team of Data & AI Engineers, Data Scientists, Developers, Analysts and Architects and work on the design and build out of cutting-edge machine learning and AI services, supporting analytics and product iteration across our business.  
 

What you’ll do: 

• Build and support esure’s data products within their industry leading platform.
• Work with product managers, data & AI engineers to deliver technical solutions for our most pressing data problems including GenAI applications 
• Design, build, and maintain the data and analytics platform’s components to enable seamless data consumption and usage, including orchestration, monitoring, and performance optimization. 
• Integrate data from a variety of sources, assuring that they adhere to data quality and technical standards 
• Creating frameworks and processes for data pipelines across the data and analytics platform 
• Establish and uphold coding and data process standards across the platform, actively promoting and enforcing best practices. 
• Improve data engineering processes and roll these out across our team and wider data community 
• Work with architects on best design for data products, evaluating and experimenting with new data tools & supporting ML & AI infrastructure and workflows.

What we’d love you to bring:

• A passion for designing and building a robust data platform
• Great interpersonal skills and collaborative mindset
• Strong hands-on experience with modern cloud data warehouses such as Databricks/Snowflake, ideally on AWS
• Strong Python experience, including deep knowledge of the Python data ecosystem, with hands-on expertise in Spark and Airflow
• Hands-on experience in all phases of data modelling from conceptualization to database optimization supported by advanced SQL skills
• Hands-on Experience with implementing CICD, using Git, Jenkins or similar technologies.
• Solid hands-on experience implementing batch and real-time data integration frameworks including assessing performance, debugging, and fine-tuning those systems
• Demonstrated ability to perform the engineering necessary to acquire, ingest, cleanse, integrate, and structure massive volumes of data from multiple sources
• Experience with Terraform or similar Infrastructure as Code (IaC) tools is a plus
• Experience with Docker and Kubernetes for containerization and orchestration of data workflows is a plus
• Exposure to Generative AI in production is a plus.

The Interview Process (subject to change):

• You’ll start with an introductory call with one of our Talent Partners. This is a ‘get to know you session’ and for you to explore the position in more detail.
• 1st stage interview: 30-minute interview with our Data Engineering Technical Lead or Lead Data Scientist
• 2nd stage: 2-hour technical interview to showcase your Data Engineering experience. This stage will include presenting your technical data task (which we will share with you 1 week before interview to complete). During this interview you will also get the chance to meet with multiple individuals in our Data team.

What’s in it for you?:

• Competitive salary that reflects your skills, experience and potential.
• Discretionary bonus scheme that recognises your hard work and contributions to esure’s success.
• 25 days annual leave, plus 8 flexible days and the ability to buy and sell further holiday.
• Our flexible benefits platform is loaded with perks to choose from, so you can build a personal toolkit to support your health, wellbeing, lifestyle, and finances.
• Company funded private medical insurance for qualifying colleagues.
• Fantastic discounts on our insurance products! 50% off for yourself and spouse/partner and 10% off for direct family members.
• We’ll elevate your career with hands-on training, mentoring, access to our exclusive academies, regular career conversations, and expert partner resources.
• Driving good in the world couldn’t be more important to us. Our colleagues can use 2 volunteering days per year to support their local communities.
• Join our internal networks and communities to connect, learn, and share ideas with likeminded colleagues.
• We’re a proud supporter of the ABI’s ‘Make Flexible Work’ campaign and welcome you to ask about the flexibility you need. Our hybrid working approach also puts you in the driving seat of how and where you do your best work.
• And much more; See a full overview of our benefits here Reward and benefits | Esure Group PLC
   

We are committed to creating an inclusive and diverse workplace where everyone feels valued, respected, and empowered. We celebrate individuality and create spaces where unique backgrounds and experiences can come together. We believe that diverse perspectives drive innovation, in turn enabling us to better serve our customers, community and build a stronger organisation. Our commitment to inclusion extends to every part of our business, from hiring practices to professional growth opportunities, ensuring equal access and support for all.

We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK.

The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity.

In this role you will be involved in determining the future direction and impact of data engineering within the business.

This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions.

Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions.

This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions.

In this role, you will have the following: -

• Technical Leadership
• Team Management
• Leading by Example (100% hands-on)
• Data Strategy & Solutions
• Cloud (Azure or AWS)
• Championing Technical Excellence
• Leverage Big Data Technologies
• Collaboration
• Developing Large, Complex Data Sets
• Building Advanced Data Solutions
• Ensuring Cost Efficiency - Cost Models and Budgets.

About You

You will be a passionate leader with extensive, in-depth and hands-on experience within Data Engineering - you will have the ability to inspire, mentor and motivate a talented team of Data Engineers.

The ideal candidate will be/have: -

• Seasoned hands-on experience in data engineering, with extensive experience in a leadership or mentoring role. Demonstrated track record of leading complex data engineering initiatives at scale. Extensive experience in designing, implementing, and optimising data solutions, supported by a history of successfully managing technical teams and projects.
• Exceptional coding skills.
• Degree in Computer Science, Software Engineering, or similar (applied to Data/Data Specialisation).
• Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments.
• Expert knowledge in data technologies, data transformation tools, data governance techniques.
• Strong analytical and problem-solving abilities.
• Good understanding of Quality and Information Security principles.
• Effective communication, ability to explain technical concepts to a range of audiences.
• Able to provide coaching and training to less experienced members of the team.

Essential Skills:

• Programming Languages such as Spark, Java, Python, PySpark, Scala or similar (minimum of 2).
• Extensive Big Data hands-on experience across coding/configuration/automation/monitoring/security is necessary.
• Significant AWS or Azure hands-on experience.
• ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones.
• Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse.
• Certifications: AWS, Azure, or Cloudera certifications are a plus.

The role comes with an extensive benefits package including a good pension, good holiday allowance, healthcare, bonus and more!

Please note, to be considered for this opportunity you MUST have the Right to Work in the UK long-term as our client is NOT offering sponsorship for this role.

KEYWORDS

Lead Data Engineer, Senior Lead Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake.

Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this position.

No terminology in this advert is intended to discriminate against any of the protected characteristics that fall under the Equality Act 2010.

Bowerford Associates Ltd is acting as an Employment Agency in relation to this vacancy.

Senior Data Engineer

Location: RG7 4PR , located between Reading and Basingstoke, with free onsite parking .

Package: 50,060 - 70,000 (depending on your suitability, qualifications, and level of experience)

Working pattern: AWE operates a 9-day working fortnight.

Clearance Level: You will need to obtain and maintain DV security clearance for the role. This will be funded by AWE. The nature of our work does mean you need to be a British Citizen who has been resident in the UK for the past 10 years in order to apply for DV clearance.

Due to the classified nature of the work involved, there are limited opportunities to work from home in this role. It is anticipated that the successful candidate will spend the majority of their time working on site at AWE Aldermaston.

Let us introduce the role

AWE is currently recruiting for a Senior Data Engineer for the IS Modernisation group. In this role you will be accountable for the development of digital twin platform products in line with relevant company policies, processes or external regulations, standards, codes of practice, and best practice. You will lead on analysis and programming support to the business in line with the business plan to protect, develop, and deliver the AWE mission.

Utilising your problem-solving abilities, creativity, and technical skills to design and implement data-driven solutions that drive real impact in the world. As a Senior Data Engineer, you will be responsible for end-to-end execution of high-stakes projects, collaborating in small teams and taking ownership of project outcomes from inception to delivery. Your work may involve discussions on architecture, data wrangling, coding web applications, engaging with internal customers, and establishing team strategies.

AWE is seeking to have an enduring internal capability to conduct strategic modelling and operational planning. You will take a key role in shaping and leading this fast-paced and newly formed team.

Responsibilities:

• Work closely with internal and external customers to understand their greatest problems and design and implement data-driven solutions.
• Take ownership of high-stakes projects, leading end-to-end execution with small teams.
• Engage in and contribute to architectural discussions with fellow engineers and wider stakeholders to drive effective solutions.
• Analyse/Interrogate massive-scale data, ensuring its quality and usability.

• Develop custom applications to provide user-friendly interfaces for data access and analysis.
• Collaborate efficiently with both technical and non-technical individuals in a dynamic environment with evolving objectives and user iteration.
• Identify, investigate, evaluate, and implement improved ways of working.
• To make decisions and solve complex business problems.
• Champion data governance and data quality policies, implementing best practices to guarantee data accuracy and consistency across the organisation.
• Provide expert technical guidance and mentorship to the wider team and community, creating a healthy culture of growth and innovation.

What We Value:

• A highly analytical approach and a keen desire to solve technical problems using data structures, storage systems, cloud infrastructure, front-end frameworks, and other technical tools.
• Experience or curiosity about working with and utilising large-scale data to tackle valuable business problems.
• Strong problem-solving abilities, creativity for innovative solutions, and a view on long-term strategy
• Ability to collaborate effectively in teams with individuals from both technical and non-technical backgrounds.
• Comfortable working in a dynamic environment with evolving objectives and a focus on iteration with users.
• Focus on customers, partners, and ability to build and sustain strong relationships

Who are we looking for?

We do need you to have the following:

• Strong Engineering background, preferably in fields such as Computer Science, Mathematics, Software Engineering, Physics, or Data Science.
• Proficiency in programming languages such as Python, Java, C++, TypeScript/JavaScript, or similar.
• Excellent communication, presentation, and organisation skills
• Demonstrable stakeholder engagement and management experience and the ability to engage with stakeholders at various levels

Whilst not to be considered a tick list, we'd like you to have experience in some of the following:

• Leadership and team management skills
• Hands-on experience with Foundry

You'll need to have the ability to work calmly and constructively in a priority changing environment and be able to manage your own workload. You will also have initiative, enthusiasm, a flexible approach, and ability to work to tight deadlines.

Some reasons we think you'll love it here:

AWE has wide range of benefits to suit you. These include:

• 9-day working fortnight - meaning you get every other Friday off work, in addition to 270 hours of annual leave.
• Market leading contributory pension scheme (we will pay between 9% and 13% of your pensionable pay depending on your contributions).
• Family friendly policies: Maternity Leave - 39 Weeks Full Pay and Paternity Leave - 4 Weeks Full Pay.
• Opportunities for Professional Career Development including funding for annual membership of a relevant professional body.
• Employee Assistance Programme and Occupational Health Services.
• Life Assurance (4 x annual salary).
• Discounts - access to savings on a wide range of everyday spending.
• Special Leave Policy including paid time off for volunteering, public service (including reserve forces) and caring.
• Policy including paid time off for volunteering, public service (including reserve forces) and caring.

The 'Working at AWE' page on our website is where you can find full details in the 'AWE Benefits Guide'.

Our ambition is to create workplaces where we recognise and celebrate differences, encourage diverse contributions and our employees feel able to be themselves at work. We strive to create a genuine culture of openness and inclusion and encourage diverse applicants. Any inclusion information you provide will be stored in accordance with GDPR and kept separate from your application form and CV, and the information will not be shared with anyone involved in interviewing or making hiring decisions.

Next steps:

Everyone who works at AWE brings unique skills and perspectives to the table. We recognise that great people don't always 'tick every box'. That's why we focus on your potential, your fit with our values, your transferable skills as well as your experience. Even if you don't meet every point above, but you feel that this role and AWE are a great fit for you, please go ahead and apply, we'd love to receive your application.

Important things you need to know:

• We encourage you to apply promptly to avoid disappointment if applications are high and the role therefore closes.
• We want you to feel comfortable and able to shine during our recruitment process. Please let us know on your application form if you need any adjustments/accommodations during the process.
• Our interviews typically take place over Teams and for most roles are a 1 stage process.

#LI-AT

Senior Data Engineer – ML, Azure

Salary £70 - £80k + Benefits + Hybrid working

We are looking for an experienced Data Engineer to join a growing SaaS business investing in Data decision making as they expand their product offering. Their products provide a positive social impact to a massive customer base, so applications from candidates who value a genuine connection to the products they develop are welcomed.

The Senior Data engineer will play a key role in the development and implementation of data and machine learning algorithms to facilitate new product design and shape relevant decision making across the business.

This company offer flexible hybrid working with 1-2 days per week in their offices, which are commutable from Woking, Farnborough, Crawley areas.

Required skills and technologies

• 5+ years’ experience in a Data Engineering, Machine Learning, or similar role using Python
• Microsoft environments and the Azure platform – Azure Data pipelines, Azure Machine Learning, Azure Data Factory, Data Bricks, etc
• Full cycle, end to end Data model / Predictive model development, working with software engineers and product managers
• Communicate effectively across multiple teams, senior management, and non-tech stakeholders

Desirable experience:

• Experience of leading projects
• Commercial experience working with external data partners

Candidates must be based locally and be eligible to work in the UK without sponsorship.

Please apply to this advert or contact me via LinkedIn messenger to discuss the details

Senior Data Engineer

X2 days a month in office (Surrey)

Xcede are delighted to be working with an incredibly data-rich organisation with over 3 million customers in the UK using their products. The company have a very established Data division headed up by well-regarded CDO who comes from a ‘hands on’ Data Science background. The Data Unit is filled with experienced Data Scientists, Analyst, Machine Learning Engineers, LLM specialists, and Data Engineers.

We’re now actively recruiting for another Senior Data Engineer to join their team. The perfect Senior Data Engineer will love building great Software as much as they do exploring & managing data. The company adhere to Software Engineering best practices and will expect any new joiners to do the same.

Alongside the huge swathe of batch data that they work with, the team also have a clear business opportunity to work on real-time / streaming projects.

Responsibilities

• Manage ETL, build pipelines, and scale data infrastructure to support data science and analytics initiatives.

• Design, implement and improve tools and services for orchestration, observability, data governance and data quality to high engineering standards

• Deploy and manage products using CI/CD best practices

• Work in partnership with Analytical stakeholders from a huge variety of business projects and help to diagnose issues.

Requirements

• Ideally a strong degree in computer science or a relevant area.
• Excellent coding skills specifically in Python.
• Very desirable commercial technical experience with tools such as Spark, Databricks, Airflow, Docker etc
• Commercial Containerisation & Infrastructure as code experience
• Previous work in a CI/CD environment
• AWS is the preferred cloud platform - Azure and/or GCP will be considered.

If this role interests you and you would like to find out more, please apply here or contact us via (feel free to include a CV for review).

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry

Lead Data Engineer

Salary: £70-90k

Location: Reading – Hybrid

Benefits: Competitive

Role Overview:

As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. You will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis.

Key Responsibilities:

• Lead and manage a team of data engineers.

• Design, build, and maintain data infrastructure and systems.

• Ensure effective use of Microsoft Fabric and Synapse analytics platform.

• Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers.

Experience required

• Dynamic and hands-on leader who excels in managing and coaching a team.

• Thrives in a collaborative environment and adapts to changing priorities with ease.

• Excellent communication and presentation skills, capable of conveying complex ideas to both technical and non-technical stakeholders.

• Deep understanding of DataLake, Lakehouse, and Warehouse paradigms.

• Extensive experience in developing and maintaining data pipelines for ELT/ETL from various data sources, including databases, APIs, text files, and Parquet.

• Expert knowledge of the Microsoft Fabric Analytics Platform (Azure SQL, Synapse, PowerBI).

• Proficient in Python for data engineering tasks, including data ingestion from APIs, creation and management of Parquet files, and execution of ML models.

• Strong SQL skills, enabling support for Data Analysts with efficient and performant queries.

• Skilled in optimizing data ingestion and query performance for MSSQL or other RDBMS.

• Familiar with data processing frameworks such as Apache Spark.

• Highly analytical and tenacious in solving complex problems.