73 Big Data Developer jobs in the United Kingdom

**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM CIC is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly within a Java context, along with a passion for creating innovative solutions tailored to the unique demands of public sector projects.
As a Developer at IBM you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. You'll have the opportunity to work with the latest technologies, ensuring the applications delivered are high performing, highly available, responsive, and maintainable. Your primary responsibilities include: Analytical Problem-Solving and Solution Enhancement: Analyze, validate and propose improvements to existing failures, with the support of the architect and technical leader. Comprehensive Engagement Across Process Phases: Involvement in every step of the process, from design, development, testing release changes and troubleshoot where necessary, providing a great customer service. Strategic Stakeholder Engagement and Innovative Coding Solutions: Drive key discussions with your stakeholders and analyze the current landscape for opportunities to operate and code creative solutions.
**Required technical and professional expertise**
* Design, develop, and maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka.
* Collaborate with cross-functional teams to define, design, and ship data-intensive features and services.
* Optimize existing data processing pipelines for efficiency, scalability, and reliability.
* Develop and execute unit tests, ensuring the quality and robustness of the code.
* Implement best practices for software development, including version control, continuous integration, and automated testing.
* Provide technical guidance and mentorship to junior developers.
* Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development.
* Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems.
**Preferred technical and professional experience**
* Bachelor's or Master's degree in Computer Science, Information Technology, or a related field, or equivalent experience.
* Experience in Big Data Java development.
* In-depth knowledge of Big Data frameworks, such as Hadoop, Spark, and Kafka, with a strong emphasis on Java development.
* Proficiency in data modeling, ETL processes, and data warehousing concepts.
* Experience with data processing languages like Scala, Python, or SQL.
* Familiarity with containerization technologies (Docker) and orchestration tools (Kubernetes).
* Strong knowledge of software development principles, including object-oriented design, design patterns, and clean code practices.
* Excellent problem-solving skills and attention to detail.
* Strong communication and team collaboration skills.
* Ability to obtain necessary security clearances as required by public sector projects.
Preferred Qualifications:
* Experience working in the public sector or understanding of public sector operations.
* Knowledge of IBM Big Data and AI solutions.
* Experience with cloud platforms, preferably IBM Cloud.
* Contributions to open-source projects or personal projects demonstrating Big Data and Java development skills.
* Relevant certifications such as Cloudera Certified Associate (CCA) or Hortonworks Certified Developer (HCD) are considered a plus.
By joining IBM's Public Sector team as a Big Data Java Developer, you'll have the opportunity to make a significant impact on public services while growing your career with one of the world's leading technology companies. We offer a competitive benefits package, ongoing learning opportunities, and a dynamic, inclusive work environment where your skills and passions can reach their full potential.
As an equal opportunities' employer, we welcome applications from individuals of all backgrounds. However, for you to be eligible for this role, you must have the valid right to work in the UK. Unfortunately, we do not offer visa sponsorship and have no future plans to do so. You must be a resident in the UK and have been living continuously in the UK for the last 10 years. You must be able to hold or gain a UK government security clearance.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered on digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of $13+ billion.

Spark - Must have

Scala - Must Have

Hive & SQL - Must Have

Recent hands-on experience with Scala coding is required.

Banking /Capital Markets Domain - Good to have

Interview includes coding test.

Job Description:

===

Scala/Spark

• Good Big Data resource with the below Skillset:

§ Spark

§ Scala

§ Hive/HDFS/HQL

• Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)

• Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage.

• Consistently demonstrates clear and concise written and verbal communication

• A history of delivering against agreed objectives

• Ability to multi-task and work under pressure

• Demonstrated problem solving and decision-making skills

• Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling,

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered on digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of $13+ billion.

Spark - Must have

Scala - Must Have

Hive & SQL - Must Have

Recent hands-on experience with Scala coding is required.

Banking /Capital Markets Domain - Good to have

Interview includes coding test.

Job Description:

===

Scala/Spark

• Good Big Data resource with the below Skillset:

§ Spark

§ Scala

§ Hive/HDFS/HQL

• Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.)

• Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage.

• Consistently demonstrates clear and concise written and verbal communication

• A history of delivering against agreed objectives

• Ability to multi-task and work under pressure

• Demonstrated problem solving and decision-making skills

• Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling,

Our client is offering an exceptional Graduate Trainee opportunity in Data Analysis, based in our offices serving **Wolverhampton, West Midlands, UK**. This program is designed for ambitious and analytical graduates eager to launch their careers in a data-driven environment. You will be immersed in the world of data, learning to collect, clean, process, and analyze large datasets to extract meaningful insights. Under the guidance of experienced data scientists and analysts, you will contribute to critical business projects, developing reports, visualizations, and dashboards to communicate findings effectively. Key responsibilities include assisting with data quality checks, performing statistical analysis, contributing to the development of data models, and supporting the presentation of data-driven recommendations to stakeholders. The ideal candidate will possess a strong academic background in a quantitative field such as mathematics, statistics, computer science, economics, or a related discipline. A keen interest in data analysis, excellent problem-solving abilities, and proficiency in tools like Excel and SQL are essential. Familiarity with programming languages such as Python or R is a plus. You should be a quick learner, detail-oriented, and possess strong communication skills, both written and verbal. This internship provides invaluable hands-on experience and a clear pathway for career progression within a supportive and growing organization. You will gain exposure to various business functions and learn how data analytics drives strategic decision-making.

Our client is offering an exciting Graduate Trainee opportunity in Data Analysis. This fully remote internship provides a unique chance for recent graduates to launch their careers by gaining hands-on experience in a data-driven environment. You will work closely with experienced analysts, learning to collect, clean, interpret, and present data to support business decisions. Key responsibilities include: assisting in the collection and processing of data from various sources; performing data cleaning and validation to ensure accuracy and completeness; conducting basic statistical analysis and generating reports using tools like Excel, SQL, and Python/R; visualising data through charts and graphs to identify trends and patterns; supporting senior analysts in interpreting findings and preparing presentations; learning about data warehousing, database management, and data governance principles; contributing to projects that aim to improve data quality and accessibility; and participating in team meetings and training sessions to develop your analytical skills. The ideal candidate will have recently graduated with a Bachelor's or Master's degree in a quantitative field such as Statistics, Mathematics, Computer Science, Economics, or a related discipline. While no prior professional experience is required, a strong academic background in quantitative subjects is essential. Familiarity with data analysis concepts and tools, even from academic projects, is a plus. Excellent attention to detail, problem-solving skills, and a proactive attitude are crucial. Strong written and verbal communication skills are needed to convey data insights effectively in this remote setting. This program is designed to provide comprehensive training and mentorship, supporting career growth within the data analytics field, relevant to our client's operations in the Liverpool, Merseyside, UK area.

Our client is offering an exciting Graduate Trainee opportunity in Data Analysis, based remotely. This program is designed for ambitious individuals who have recently graduated and are keen to build a career in the data science field. As a Graduate Trainee, you will gain hands-on experience in collecting, cleaning, analyzing, and interpreting large datasets to identify trends and insights. You will work closely with experienced data analysts and scientists, contributing to real-world projects that drive business decisions. Responsibilities include developing data models, creating visualizations, and presenting findings to stakeholders. The ideal candidate will possess a strong analytical mindset, excellent problem-solving abilities, and a foundational understanding of statistical concepts. Proficiency in at least one programming language commonly used in data analysis (e.g., Python, R) and familiarity with SQL are highly desirable. Experience with data visualization tools (e.g., Tableau, Power BI) would be a significant advantage. You should be eager to learn, adaptable, and capable of working effectively in a remote team environment. A Bachelor's or Master's degree in a quantitative field such as Statistics, Mathematics, Computer Science, Economics, or a related discipline is required. This is a fantastic opportunity to kickstart your career in a rapidly growing industry.
Key Responsibilities:

• Assist in data collection, cleaning, and preprocessing.
• Perform data analysis to identify trends and patterns.
• Develop data visualizations and reports.
• Support senior analysts in deriving insights from data.
• Collaborate with team members on data-driven projects.
• Learn and apply new data analysis techniques and tools.

A forward-thinking technology company is offering an exciting Graduate Trainee position focused on Data Analysis, based in the Brighton, East Sussex, UK area, with a fully remote working arrangement. This internship provides a unique opportunity for recent graduates to gain hands-on experience in data analytics, machine learning, and business intelligence within a dynamic and supportive environment. The Graduate Trainee will work closely with senior data scientists and analysts to collect, clean, and analyze large datasets, identify trends, and develop insights to inform business decisions. Responsibilities include assisting in the development of data models, creating reports and dashboards using visualization tools, and contributing to the implementation of data-driven strategies. You will have the opportunity to learn and apply various analytical techniques and tools, such as SQL, Python, R, and Tableau. The ideal candidate will be a recent graduate with a degree in a quantitative field such as Computer Science, Statistics, Mathematics, Economics, or a related discipline. Strong analytical and problem-solving skills are essential, along with a keen attention to detail. Familiarity with programming languages like Python or R is highly desirable. Excellent communication skills and the ability to work collaboratively in a remote team setting are crucial. Enthusiasm for data and a willingness to learn are key attributes we are looking for. This role is designed to provide a comprehensive learning experience and a potential pathway to a full-time career in data science. You will gain valuable practical experience and mentorship to build a strong foundation in the field. This is a fully remote role, allowing you to contribute effectively from your preferred location.

Our client is offering an exceptional Graduate Trainee position focused on Data Analysis, based in **Sunderland, Tyne and Wear**. This is an excellent opportunity for a recent graduate eager to build a career in data science and analytics. You will receive comprehensive training and mentorship, working alongside experienced professionals on real-world projects. The role involves learning to collect, clean, analyze, and interpret complex datasets to provide actionable insights. You will gain hands-on experience with various data analysis tools and techniques, contributing to key business decisions. This role is primarily office-based, fostering direct collaboration and learning within the team.

Key Responsibilities:

• Assist in the collection, cleaning, and organization of data from various sources.
• Perform data analysis using statistical methods and software.
• Develop reports and visualizations to communicate findings effectively.
• Support senior analysts in identifying trends and patterns within datasets.
• Learn and apply data modeling techniques.
• Participate in team meetings and contribute to project discussions.
• Maintain data integrity and accuracy.
• Develop skills in programming languages commonly used in data analysis (e.g., Python, R, SQL).

Qualifications:

• A recent graduate with a degree in Mathematics, Statistics, Computer Science, Economics, or a related quantitative field.
• Strong analytical and problem-solving skills.
• Proficiency in Microsoft Excel; experience with other data analysis tools is a plus.
• Eagerness to learn and develop skills in data analysis and programming.
• Good communication and teamwork abilities.
• Attention to detail and commitment to accuracy.
• Must be eligible to work in the UK.

This entry-level position provides a structured pathway for career advancement within a supportive and growth-oriented environment. Join our client and kick-start your career in the exciting field of data analysis.

CK Group are recruiting for a Data Analysis and Validation Associate to join a global animal health company on a contract basis for 12 months.



Salary:

147.90 per day PAYE



Data Analysis and Validation Associate role:

• Responsible for data analysis, entry and Validation related activities across the Pirbright manufacturing facility, to enable the large scale production of FMD and BTV antigen and finished product in a timely and cost effective manner.
• Analyse production data to identify trends, deviations, and performance metrics.
• Assist in the execution of cleaning validation protocols in line with GMP requirements.
• Bring in SQL / Power BI approaches to improve the site approach to data.
• Support sampling, documentation, and coordination of validation activities.

Your Background :

• GMP experience is essential
• Have a scientific or engineering discipline degree (e.g., Biochemistry, Biotechnology, Chemical Engineering, Pharmaceutical Sciences).
• Understanding of cleaning validation principles and documentation practices.
• Experience with data handling and analytics
• Knowledge of HSE, bio-safety standards, GMP regulations as well as main tools and principles of operational excellence

Company:

Our client is a leading manufacturer of vaccines, parasiticides and pharmaceuticals to protect animals. They are also one of the fastest growing animal health companies in the UK.



Location:

This role is based at our clients site near Pirbright.



Apply:

For more information, or to apply for this Data Analysis and Validation Associate role, please contact the Key Accounts Team on (phone number removed) or email (url removed). Please quote reference (Apply online only).



It is essential that applicants hold entitlement to work in the UK



Please note: This role may be subject to a satisfactory basic Disclosure and Barring Service (DBS) check.



INDKA