Explore numerous data engineer positions that involve designing, building, and maintaining data systems. These roles require expertise in data warehousing solutions, ETL processes, and big data technologies. Data engineers are responsible for ensuring data quality, reliability, and accessibility for various business needs. 494 Data Engineer jobs in the United Kingdom
Big Data Engineer
Posted 26 days ago
Job Viewed
Job Description
RELOCATION ASSISTANCE: Relocation assistance may be available
CLEARANCE TYPE: UK-Highest Level of Government Clearance
TRAVEL: Yes, 10% of the Time
**Salary: £77,400 - £116,000**
**Define Possible at Northrop Grumman UK**
At Northrop Grumman UK, our mission is to solve the most complex challenges by shaping the technology and solutions of tomorrow. We call it Defining Possible.
This mind-set goes beyond our customer solutions; it's the foundation for your career development and the impact we have within the community. So, what's your possible?
**Opportunity:**
This is more than just a job; it's a mission.
As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.
Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.
If you are looking for a career with meaning where you can make a difference to the nation's security and support critical missions, then look no further.
_"My purpose; to lead a team of engineers with the brightest minds, to push the boundaries and define possible together."_
**Role responsibilities:**
+ Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.
+ Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.
+ Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.
+ Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.
+ Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.
+ Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.
+ Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy
+ Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively
+ Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.
+ Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing
+ BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.
**We are looking for:**
+ Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.
+ Experience with integration testing and ensuring seamless tool integration.
+ In-depth knowledge of Linux internals and system administration.
+ Understanding of TCP/IP and OSI models.
+ Hands-on experience with data pipeline tools like NiFi and Airflow.
+ Proven ability to design scalable big data systems with a focus on security and GDPR compliance.
+ Hybrid cloud experience, specifically with on-premise and AWS cloud environments.
+ Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.
+ Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.
+ Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.
+ Excellent communication and collaboration skills.
Preferred Qualifications:
+ Certification in AWS or other cloud platforms.
+ Experience with additional data orchestration tools.
+ Familiarity with other big data tools and technologies.
+ Previous experience in a similar role within a dynamic and fast-paced environment.
Experience in Cloudera, Hadoop, Cloudera Data Science Workbench (CDSW), Cloudera Machine Learning (CML) would be highly desirable.
**Work Environment:**
+ Full time on-site presence required
**If you don't meet every single requirement, we still encourage you to apply.**
Sometimes, people hesitate to apply because they can't tick every box. We encourage you to apply if you believe the role will suit you well, even if you don't meet all the criteria. You might be exactly who we are looking for, either for this position or for our opportunities at Northrop Grumman UK. We are on an exciting growth trajectory and growing our teams across the UK.
**Security clearance:**
You must hold the highest level of UK Government security clearance. Our requirement team is on hand to answer any questions and we will guide you through the process: .
**Benefits:**
We can offer you a range of flexible working options to suit you, including optional compressed working schedule with every other Friday off. Our benefits including private health care, cash health plan, holiday buy and sell, career development opportunities and performance bonuses. For a comprehensive list of benefits, speak to our recruitment team.
**Why join us?**
+ **A mission to believe in** **-** Every day we contribute to building a more secure and connected world, expanding our reach from land, sea, and air to space and cyberspace. From engineering data and intelligence solutions, to developing maritime navigation and control systems and innovating command and control systems for the UK and NATO, what we do together matters.
+ **A place to belong and thrive** **-** Every voice matters at our table meaning you can bring your authentic self to work. From our Employee Resource Groups backed by thousands of employees to our partnerships with the Association For Black and Minority Ethnic Engineers, Forces Transition Group, Mind, and Women in Defence - we are passionate about growing and supporting our inclusive community where everyone can belong.
+ **Your career, your way** - Shape your career journey with diverse roles, mentorship, and development opportunities that fuel your curiosity, channel your expertise, and nurture your passion. Looking for flexibility? Balance your professional career with your personal life through our health and wellbeing benefits, discount schemes, and investment in your future development. Speak to our team to find the balance that's right for you.
**Ready to apply?**
**Yes** - Submit your application online. Your application will be reviewed by our team and we will be in touch.
**Possibly, I'd like to find out more** **about this role** - Reach out to our team for more information and support: .
**No, I don't think this role is right for me** - Our extensive UK growth means we have exciting, new opportunities opening all the time. Speak to our team to discuss your career goals.
Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.
Lead Data Engineer - Big Data Platforms
Posted 7 days ago
Job Viewed
Job Description
The ideal candidate will possess a Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field, with a minimum of 7 years of professional experience in data engineering. Extensive hands-on experience with distributed big data technologies such as Apache Spark, Hadoop, Kafka, and cloud-based data services (e.g., AWS EMR, Azure Databricks, Google Cloud Dataflow) is essential. Proficiency in SQL and NoSQL databases, as well as strong programming skills in Python or Scala, are required. You should have a deep understanding of data warehousing concepts, data modeling, and ETL/ELT best practices. Experience in designing and implementing robust data governance and data quality frameworks is highly desirable. Strong leadership qualities, with the ability to mentor junior engineers, guide technical strategy, and collaborate effectively with cross-functional teams (data scientists, analysts, business stakeholders), are paramount.
This role offers a unique opportunity to shape the future of data architecture within a dynamic and growing company. You will be instrumental in architecting solutions that handle vast amounts of data, unlock new insights, and drive business value. The position involves a hybrid working model, allowing for flexibility while fostering team collaboration. You will be based in our state-of-the-art offices in London, England, UK , working with cutting-edge technologies and solving complex data challenges. Join a team committed to excellence and innovation in the heart of the tech industry.
Key Responsibilities:
- Design, build, and maintain scalable big data pipelines and infrastructure.
- Develop and optimize ETL/ELT processes for data ingestion and transformation.
- Manage and enhance data lakes and data warehouses.
- Ensure data quality, integrity, and reliability.
- Implement data governance and security best practices.
- Lead and mentor a team of data engineers.
- Collaborate with data scientists and analysts to meet their data needs.
- Evaluate and adopt new data technologies and tools.
Senior Data Engineer - Big Data & Cloud
Posted 8 days ago
Job Viewed
Job Description
Responsibilities:
- Design, construct, install, and maintain scalable data pipelines and data warehousing solutions.
- Develop and implement ETL/ELT processes for ingesting, transforming, and loading data from various sources.
- Optimize data storage and processing for performance, reliability, and cost-efficiency on cloud platforms.
- Build and maintain data infrastructure using big data technologies such as Spark, Hadoop, and Kafka.
- Collaborate with data scientists, analysts, and other engineers to understand data needs and deliver solutions.
- Implement data governance, quality, and security best practices.
- Monitor data systems, troubleshoot issues, and implement solutions to ensure high availability.
- Develop and maintain robust data models for analytical purposes.
- Stay current with emerging technologies and trends in data engineering and big data.
- Mentor junior data engineers and contribute to the team's technical growth.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- 5+ years of experience in data engineering, with a focus on big data and cloud environments.
- Proficiency in at least one major cloud platform (AWS, Azure, or GCP) and its data services.
- Strong experience with programming languages like Python, Scala, or Java.
- Expertise in SQL and experience with distributed data processing frameworks (e.g., Apache Spark, Hadoop ecosystem).
- Solid understanding of data warehousing concepts, data modeling, and ETL/ELT design patterns.
- Experience with real-time data streaming technologies (e.g., Kafka, Kinesis) is a plus.
- Excellent problem-solving, analytical, and communication skills.
- Ability to work independently and collaboratively in a remote, fast-paced environment.
- This is a fully remote role, ideal for a skilled Data Engineer located near **Manchester, Greater Manchester, UK**, or elsewhere.
Senior Data Engineer - Big Data & Cloud
Posted 11 days ago
Job Viewed
Job Description
Responsibilities:
- Design, develop, and optimize robust and scalable ETL/ELT data pipelines using cloud-based technologies.
- Implement and manage data warehousing solutions and data lake architectures on platforms like AWS, Azure, or GCP.
- Ensure data quality, integrity, and reliability across all data systems.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver effective solutions.
- Develop and maintain data models that support business needs and analytical capabilities.
- Automate data processes and implement monitoring solutions to ensure system performance and reliability.
- Optimize data storage and retrieval processes for performance and cost-efficiency.
- Contribute to the development and enforcement of data governance policies and best practices.
- Troubleshoot and resolve complex data-related issues.
- Mentor junior data engineers and contribute to team knowledge sharing.
- Stay current with emerging technologies and trends in big data and data engineering.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- Proven experience (5+ years) in data engineering, with a strong focus on building and managing large-scale data pipelines.
- Expertise in at least one major cloud platform (AWS, Azure, GCP) and their data services (e.g., S3, Redshift, BigQuery, Snowflake, Databricks).
- Proficiency in programming languages such as Python, SQL, or Scala.
- Experience with big data technologies like Spark, Hadoop, Kafka, etc.
- Strong understanding of data warehousing concepts, data modeling, and database design.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes) is a plus.
- Excellent problem-solving skills and ability to work with complex datasets.
- Strong communication and collaboration skills, with the ability to translate technical concepts to non-technical stakeholders.
- Ability to work effectively in a hybrid work environment.
Data Engineer
Posted today
Job Viewed
Job Description
The role of Data Engineer in the industrial and manufacturing industry involves designing, building, and maintaining robust data pipelines and systems to support analytics. This temporary position in Manchester requires technical expertise and a focus on delivering data solutions.
Client Details
They are a leading manufacturing company based in Greater Manchester.
Description
- Develop and maintain scalable data pipelines and systems to support analytics requirements.
- Collaborate with analytics teams to understand data needs and provide tailored solutions.
- Ensure data quality, integrity, and security across all systems and processes.
- Optimise database performance and troubleshoot issues as they arise.
- Integrate data from various sources to create unified datasets for analysis.
- Document data workflows, systems, and processes clearly and comprehensively.
- Stay up-to-date with emerging technologies and recommend improvements to existing systems.
- Support ad-hoc data requests and provide technical expertise to stakeholders.
Profile
A successful Data Engineer should have:
- Proven experience with data engineering tools and technologies.
- Strong knowledge of database systems, ETL processes, and data modelling.
- Proficiency in programming languages such as Python, SQL, or similar.
- Experience with cloud-based data platforms and services.
- Ability to work collaboratively in a team environment
Job Offer
- (Apply online only) per day - outside IR35
- Hybrid role - 2 days based in Greater Manchester office
- 3 month contract, with potential extension
Data Engineer
Posted today
Job Viewed
Job Description
Data Engineer
I am working with a fast-growing, technology driven organisation that is redefining how data is used to drive decision making across regulated industries. Through advanced data engineering, cloud technologies and a strong focus on compliance they are enabling smarter, faster and more secure business operations.
As part of their continued growth, they are looking to bring on a Data Engineer to join their Data team. This is a high-impact, delivery focused role where you will work across business units to build scalable data solutions and support enterprise-wide transformation.
You will be part of a collaborative, forward thinking team that values innovation, quality, and continuous improvement.
In this role, you will be responsible for:
- Designing and delivering data solutions using Microsoft technologies
- Building and maintaining ETL pipelines across complex data environments
- Collaborating with Architects, Engineers, and cross-functional teams to develop solutions that meet business needs
- Participating in Agile ceremonies and contributing to code reviews
- Creating documentation and supporting the development lifecycle
To be successful in this role, you will have:
- Experience working on the Microsoft Platform e.g. SQL Server, SSIS, SSRS
- Strong data warehousing and data modelling experience
- Experience creating ETL pipelines (primarily using SSIS)
- Experience working in regulated environments
- Power BI experience for reporting would be beneficial
Some of the package details include:
- Salary of up to 60,000
- Fully remote working
- 25 days annual leave plus bank holiday
- Discretionary bonus scheme
- Supportive, inclusive culture with a focus on professional development
This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss it further.
Data Engineer
Posted today
Job Viewed
Job Description
Data Engineer
I am working with a fast-growing, technology driven organisation that is redefining how data is used to drive decision making across regulated industries. Through advanced data engineering, cloud technologies and a strong focus on compliance they are enabling smarter, faster and more secure business operations.
As part of their continued growth, they are looking to bring on a Data Engineer to join their Data team. This is a high-impact, delivery focused role where you will work across business units to build scalable data solutions and support enterprise-wide transformation.
You will be part of a collaborative, forward thinking team that values innovation, quality, and continuous improvement.
In this role, you will be responsible for:
- Designing and delivering data solutions using Microsoft technologies
- Building and maintaining ETL pipelines across complex data environments
- Collaborating with Architects, Engineers, and cross-functional teams to develop solutions that meet business needs
- Participating in Agile ceremonies and contributing to code reviews
- Creating documentation and supporting the development lifecycle
To be successful in this role, you will have:
- Experience working on the Microsoft Platform e.g. SQL Server, SSIS, SSRS
- Strong data warehousing and data modelling experience
- Experience creating ETL pipelines (primarily using SSIS)
- Experience working in regulated environments
- Power BI experience for reporting would be beneficial
Some of the package details include:
- Salary of up to 60,000
- Fully remote working
- 25 days annual leave plus bank holiday
- Discretionary bonus scheme
- Supportive, inclusive culture with a focus on professional development
This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss it further.
Be The First To Know
About the latest Data engineer Jobs in United Kingdom !
Data Engineer
Posted today
Job Viewed
Job Description
Data Engineer
I am working with a fast-growing, technology driven organisation that is redefining how data is used to drive decision making across regulated industries. Through advanced data engineering, cloud technologies and a strong focus on compliance they are enabling smarter, faster and more secure business operations.
As part of their continued growth, they are looking to bring on a Data Engineer to join their Data team. This is a high-impact, delivery focused role where you will work across business units to build scalable data solutions and support enterprise-wide transformation.
You will be part of a collaborative, forward thinking team that values innovation, quality, and continuous improvement.
In this role, you will be responsible for:
- Designing and delivering data solutions using Microsoft technologies
- Building and maintaining ETL pipelines across complex data environments
- Collaborating with Architects, Engineers, and cross-functional teams to develop solutions that meet business needs
- Participating in Agile ceremonies and contributing to code reviews
- Creating documentation and supporting the development lifecycle
To be successful in this role, you will have:
- Experience working on the Microsoft Platform e.g. SQL Server, SSIS, SSRS
- Strong data warehousing and data modelling experience
- Experience creating ETL pipelines (primarily using SSIS)
- Experience working in regulated environments
- Power BI experience for reporting would be beneficial
Some of the package details include:
- Salary of up to 60,000
- Fully remote working
- 25 days annual leave plus bank holiday
- Discretionary bonus scheme
- Supportive, inclusive culture with a focus on professional development
This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss it further.
Data Engineer
Posted today
Job Viewed
Job Description
Data Engineer
I am working with a fast-growing, technology driven organisation that is redefining how data is used to drive decision making across regulated industries. Through advanced data engineering, cloud technologies and a strong focus on compliance they are enabling smarter, faster and more secure business operations.
As part of their continued growth, they are looking to bring on a Data Engineer to join their Data team. This is a high-impact, delivery focused role where you will work across business units to build scalable data solutions and support enterprise-wide transformation.
You will be part of a collaborative, forward thinking team that values innovation, quality, and continuous improvement.
In this role, you will be responsible for:
- Designing and delivering data solutions using Microsoft technologies
- Building and maintaining ETL pipelines across complex data environments
- Collaborating with Architects, Engineers, and cross-functional teams to develop solutions that meet business needs
- Participating in Agile ceremonies and contributing to code reviews
- Creating documentation and supporting the development lifecycle
To be successful in this role, you will have:
- Experience working on the Microsoft Platform e.g. SQL Server, SSIS, SSRS
- Strong data warehousing and data modelling experience
- Experience creating ETL pipelines (primarily using SSIS)
- Experience working in regulated environments
- Power BI experience for reporting would be beneficial
Some of the package details include:
- Salary of up to 60,000
- Fully remote working
- 25 days annual leave plus bank holiday
- Discretionary bonus scheme
- Supportive, inclusive culture with a focus on professional development
This is just a brief overview of the role. For the full details, simply apply with your CV and I'll be in touch to discuss it further.