Didn't find the right job?

Get expert career advice to help you find the ideal role and improve your job search strategy.

99 Big Data jobs in the United Kingdom

Data Architect

London, London AgnesCole Consulting

Tap Again To Close

Job Description

We're Hiring: Lead Data Architect Are you ready to drive data strategy and shape scalable architectures across a dynamic, cloud-first organization? We're looking for a Lead Data Architect to guide our enterprise data vision, mentor teams, and design data solutions that truly move the needle. What you’ll do: Define and lead our data architecture strategy across multiple domains and platforms Build scalable, integrated data models from raw to harmonized layers Partner with business and analytics teams to turn data into real business value Drive cross-portfolio data alignment and resolve data dependencies Coach others and advocate for data architecture best practices Ensure data compliance with GDPR and internal policies What you bring: Senior-level experience in data or enterprise architecture Deep knowledge of data modeling (ERWIN preferred) and cloud-based platforms Strong communication and stakeholder engagement skills A passion for enabling teams and aligning tech with business goals Expertise in data governance, integration, and compliance Ready to lead at the intersection of data and strategy? Apply now or reach out to learn more!41bf1e1f-b16b-4260-a40a-17c77a06fd15

This advertiser has chosen not to accept applicants from your region.

Job No Longer Available

This position is no longer listed on WhatJobs. The employer may be reviewing applications, filled the role, or has removed the listing.

However, we have similar jobs available for you below.

Big Data Engineer

London, London Northrop Grumman

Posted 9 days ago

Tap Again To Close

Job Description

UK CITIZENSHIP REQUIRED FOR THIS POSITION: Yes
RELOCATION ASSISTANCE: Relocation assistance may be available
CLEARANCE TYPE: UK-Highest Level of Government Clearance
TRAVEL: Yes, 10% of the Time
**Salary: £77,400 - £116,000**
**Define Possible at Northrop Grumman UK**
At Northrop Grumman UK, our mission is to solve the most complex challenges by shaping the technology and solutions of tomorrow. We call it Defining Possible.
This mind-set goes beyond our customer solutions; it's the foundation for your career development and the impact we have within the community. So, what's your possible?
**Opportunity:**
This is more than just a job; it's a mission.
As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.
Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.
If you are looking for a career with meaning where you can make a difference to the nation's security and support critical missions, then look no further.
_"My purpose; to lead a team of engineers with the brightest minds, to push the boundaries and define possible together."_
**Role responsibilities:**
+ Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.
+ Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.
+ Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.
+ Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.
+ Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.
+ Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.
+ Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy
+ Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively
+ Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.
+ Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing
+ BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.
**We are looking for:**
+ Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.
+ Experience with integration testing and ensuring seamless tool integration.
+ In-depth knowledge of Linux internals and system administration.
+ Understanding of TCP/IP and OSI models.
+ Hands-on experience with data pipeline tools like NiFi and Airflow.
+ Proven ability to design scalable big data systems with a focus on security and GDPR compliance.
+ Hybrid cloud experience, specifically with on-premise and AWS cloud environments.
+ Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.
+ Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.
+ Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.
+ Excellent communication and collaboration skills.
Preferred Qualifications:
+ Certification in AWS or other cloud platforms.
+ Experience with additional data orchestration tools.
+ Familiarity with other big data tools and technologies.
+ Previous experience in a similar role within a dynamic and fast-paced environment.
Experience in Cloudera, Hadoop, Cloudera Data Science Workbench (CDSW), Cloudera Machine Learning (CML) would be highly desirable.
**Work Environment:**
+ Full time on-site presence required
**If you don't meet every single requirement, we still encourage you to apply.**
Sometimes, people hesitate to apply because they can't tick every box. We encourage you to apply if you believe the role will suit you well, even if you don't meet all the criteria. You might be exactly who we are looking for, either for this position or for our opportunities at Northrop Grumman UK. We are on an exciting growth trajectory and growing our teams across the UK.
**Security clearance:**
You must hold the highest level of UK Government security clearance. Our requirement team is on hand to answer any questions and we will guide you through the process: .
**Benefits:**
We can offer you a range of flexible working options to suit you, including optional compressed working schedule with every other Friday off. Our benefits including private health care, cash health plan, holiday buy and sell, career development opportunities and performance bonuses. For a comprehensive list of benefits, speak to our recruitment team.
**Why join us?**
+ **A mission to believe in** **-** Every day we contribute to building a more secure and connected world, expanding our reach from land, sea, and air to space and cyberspace. From engineering data and intelligence solutions, to developing maritime navigation and control systems and innovating command and control systems for the UK and NATO, what we do together matters.
+ **A place to belong and thrive** **-** Every voice matters at our table meaning you can bring your authentic self to work. From our Employee Resource Groups backed by thousands of employees to our partnerships with the Association For Black and Minority Ethnic Engineers, Forces Transition Group, Mind, and Women in Defence - we are passionate about growing and supporting our inclusive community where everyone can belong.
+ **Your career, your way** - Shape your career journey with diverse roles, mentorship, and development opportunities that fuel your curiosity, channel your expertise, and nurture your passion. Looking for flexibility? Balance your professional career with your personal life through our health and wellbeing benefits, discount schemes, and investment in your future development. Speak to our team to find the balance that's right for you.
**Ready to apply?**
**Yes** - Submit your application online. Your application will be reviewed by our team and we will be in touch.
**Possibly, I'd like to find out more** **about this role** - Reach out to our team for more information and support: .
**No, I don't think this role is right for me** - Our extensive UK growth means we have exciting, new opportunities opening all the time. Speak to our team to discuss your career goals.
Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.

This advertiser has chosen not to accept applicants from your region.

Big Data Java Developer

Cheltenham, South West IBM

Posted 9 days ago

Tap Again To Close

Job Description

**Introduction**
At IBM CIC, we deliver deep technical and industry expertise to a wide range of public and private sector clients in the UK.
A career in IBM CIC means you'll have the opportunity to work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM CIC. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions which impact a wide network of clients, whom may be at their site or one of our CIC or IBM locations. Our culture of evolution centres on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
We offer:
* A multitude of training opportunities from classroom to e-learning, mentoring and coaching programs as well as the chance to gain industry recognized certifications
* Regular and frequent promotion and progression opportunities to ensure you can drive and develop your career with us
* Feedback and checkpoints throughout the year
* Diversity & Inclusion as an essential and authentic component of our culture through our policies and process as well as our Employee Champion teams and support networks
* A culture where your ideas for growth and innovation are always welcome
* Internal recognition programs for peer-to-peer appreciation as well as from manager to employees
* Tools and policies to support your work-life balance from flexible working approaches, sabbatical programs, paid paternity leave, maternity leave and an innovative maternity returners scheme
* More traditional benefits, such as 25 days holiday (in addition to public holidays), online shopping discounts, an Employee Assistance Program, a group personal pension plan of an additional 5% of your base salary paid by us monthly to save for your future.
**Your role and responsibilities**
As a Big Data Engineer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys.
* You'll have the opportunity to work with the latest technologies, ensuring the applications delivered are high performing, highly available, responsive, and maintainable.
Your primary responsibilities include:
* Analyze, validate and propose improvements to existing failures, with the support of the architect and technical leader.
* Involvement in every step of the process, from design, development, testing release changes and troubleshoot where necessary, providing a great customer service.
* Drive key discussions with your stakeholders and analyze the current landscape for opportunities to operate and code creative solutions.
**Required technical and professional expertise**
* Experienced Java developer with experience of designing and building new applications.
* Excellent grasp of object oriented design and the experience to know when to apply common design patterns.
* Knowledge of and ability to apply SOLID principles.
* Experience of test driven development and related techniques such as mocking and dependency injection.
* Developing in a secure environment.
* Maven Git DevOps tooling experience
* Performance optimisation of Java application
* AWS (lambda S3 DynamoDB etc)
* Cloudformation
* javascript
As an equal opportunities' employer, we welcome applications from individuals of all backgrounds. However, for you to be eligible for this role, you must have the valid right to work in the UK. Unfortunately, we do not offer visa sponsorship and have no future plans to do so. You must be a resident in the UK and have been living continuously in the UK for the last 10 years. You must be able to hold or gain a UK government security clearance.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

This advertiser has chosen not to accept applicants from your region.

Big Data Java Developer

Cheltenham, South West IBM

Posted 9 days ago

Tap Again To Close

Job Description

**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world? Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM CIC is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly within a Java context, along with a passion for creating innovative solutions tailored to the unique demands of public sector projects.
As a Developer at IBM you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. You'll have the opportunity to work with the latest technologies, ensuring the applications delivered are high performing, highly available, responsive, and maintainable. Your primary responsibilities include: Analytical Problem-Solving and Solution Enhancement: Analyze, validate and propose improvements to existing failures, with the support of the architect and technical leader. Comprehensive Engagement Across Process Phases: Involvement in every step of the process, from design, development, testing release changes and troubleshoot where necessary, providing a great customer service. Strategic Stakeholder Engagement and Innovative Coding Solutions: Drive key discussions with your stakeholders and analyze the current landscape for opportunities to operate and code creative solutions.
**Required technical and professional expertise**
* Design, develop, and maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka.
* Collaborate with cross-functional teams to define, design, and ship data-intensive features and services.
* Optimize existing data processing pipelines for efficiency, scalability, and reliability.
* Develop and execute unit tests, ensuring the quality and robustness of the code.
* Implement best practices for software development, including version control, continuous integration, and automated testing.
* Provide technical guidance and mentorship to junior developers.
* Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development.
* Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems.
**Preferred technical and professional experience**
* Bachelor's or Master's degree in Computer Science, Information Technology, or a related field, or equivalent experience.
* Experience in Big Data Java development.
* In-depth knowledge of Big Data frameworks, such as Hadoop, Spark, and Kafka, with a strong emphasis on Java development.
* Proficiency in data modeling, ETL processes, and data warehousing concepts.
* Experience with data processing languages like Scala, Python, or SQL.
* Familiarity with containerization technologies (Docker) and orchestration tools (Kubernetes).
* Strong knowledge of software development principles, including object-oriented design, design patterns, and clean code practices.
* Excellent problem-solving skills and attention to detail.
* Strong communication and team collaboration skills.
* Ability to obtain necessary security clearances as required by public sector projects.
Preferred Qualifications:
* Experience working in the public sector or understanding of public sector operations.
* Knowledge of IBM Big Data and AI solutions.
* Experience with cloud platforms, preferably IBM Cloud.
* Contributions to open-source projects or personal projects demonstrating Big Data and Java development skills.
* Relevant certifications such as Cloudera Certified Associate (CCA) or Hortonworks Certified Developer (HCD) are considered a plus.
By joining IBM's Public Sector team as a Big Data Java Developer, you'll have the opportunity to make a significant impact on public services while growing your career with one of the world's leading technology companies. We offer a competitive benefits package, ongoing learning opportunities, and a dynamic, inclusive work environment where your skills and passions can reach their full potential.
As an equal opportunities' employer, we welcome applications from individuals of all backgrounds. However, for you to be eligible for this role, you must have the valid right to work in the UK. Unfortunately, we do not offer visa sponsorship and have no future plans to do so. You must be a resident in the UK and have been living continuously in the UK for the last 10 years. You must be able to hold or gain a UK government security clearance.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

This advertiser has chosen not to accept applicants from your region.

Big Data Scala Spark Developer

London, London HCLTech

Posted today

Tap Again To Close

Job Description

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered on digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of $13+ billion.

Spark - Must have

Scala - Must Have

Hive & SQL - Must Have

Recent hands-on experience with Scala coding is required.

Banking /Capital Markets Domain - Good to have

Interview includes coding test.

Job Description:

===

Scala/Spark

• Good Big Data resource with the below Skillset:

§ Spark

§ Scala

§ Hive/HDFS/HQL

• Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)

• Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage.

• Consistently demonstrates clear and concise written and verbal communication

• A history of delivering against agreed objectives

• Ability to multi-task and work under pressure

• Demonstrated problem solving and decision-making skills

• Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling,

This advertiser has chosen not to accept applicants from your region.

Big Data Scala Spark Developer

HCLTech

Posted today

Tap Again To Close

Job Description

Spark - Must have

Scala - Must Have

Hive & SQL - Must Have

Recent hands-on experience with Scala coding is required.

Banking /Capital Markets Domain - Good to have

Interview includes coding test.

Job Description:

===

Scala/Spark

• Good Big Data resource with the below Skillset:

§ Spark

§ Scala

§ Hive/HDFS/HQL

• Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)

• Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage.

• Consistently demonstrates clear and concise written and verbal communication

• A history of delivering against agreed objectives

• Ability to multi-task and work under pressure

• Demonstrated problem solving and decision-making skills

• Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling,

This advertiser has chosen not to accept applicants from your region.

Big Data Architect (Open source contributor)

London, London HCLTech

Posted 7 days ago

Tap Again To Close

Job Description

Location - London

Skill - Apache Hadoop

We are looking for open-source contributors to Apache projects, who have an in-depth understanding of the code behind the Apache ecosystem, should have experience in Cloudera or similar distribution and should possess in depth knowledge of bigdata tech stack.

Requirement:

Experience of platform engineering along with application engineering (hands-on)

Experience in design of an open source platform based on Apache framework for Hadoop.

Experience in integrating Infra-as-a-Code in their platform (Bespoke implementation from scratch)

Experience of design & architect work for the open source Apache platform in hybrid cloud environment

Ability to do debug & fix code in the open source Apache code and should be an individual contributor to open source projects.

Job description: The Apache Hadoop project requires up to 3 individuals with experience in designing and building platforms, and supporting applications both in cloud environments and on-premises.

These resources are expected to be open source contributors to Apache projects, have an in-depth understanding of the code behind the Apache ecosystem, and be capable of identifying and fixing complex issues during delivery.

3 individuals required to support all developers in migrating and debugging various RiskFinder critical applications.

They need to be "Developers" who are expert in designing and building Big Data platforms using Apache Hadoop and support Apache Hadoop implementations both in cloud environments and on-premises.