76 Data Streaming jobs in the United Kingdom
Big Data Engineer

Posted 16 days ago
Job Viewed
Job Description
RELOCATION ASSISTANCE: Relocation assistance may be available
CLEARANCE TYPE: UK-Highest Level of Government Clearance
TRAVEL: Yes, 10% of the Time
**Salary: £77,400 - £116,000**
**Define Possible at Northrop Grumman UK**
At Northrop Grumman UK, our mission is to solve the most complex challenges by shaping the technology and solutions of tomorrow. We call it Defining Possible.
This mind-set goes beyond our customer solutions; it's the foundation for your career development and the impact we have within the community. So, what's your possible?
**Opportunity:**
This is more than just a job; it's a mission.
As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.
Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.
If you are looking for a career with meaning where you can make a difference to the nation's security and support critical missions, then look no further.
_"My purpose; to lead a team of engineers with the brightest minds, to push the boundaries and define possible together."_
**Role responsibilities:**
+ Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.
+ Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.
+ Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.
+ Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.
+ Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.
+ Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.
+ Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy
+ Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively
+ Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.
+ Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing
+ BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.
**We are looking for:**
+ Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.
+ Experience with integration testing and ensuring seamless tool integration.
+ In-depth knowledge of Linux internals and system administration.
+ Understanding of TCP/IP and OSI models.
+ Hands-on experience with data pipeline tools like NiFi and Airflow.
+ Proven ability to design scalable big data systems with a focus on security and GDPR compliance.
+ Hybrid cloud experience, specifically with on-premise and AWS cloud environments.
+ Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.
+ Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.
+ Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.
+ Excellent communication and collaboration skills.
Preferred Qualifications:
+ Certification in AWS or other cloud platforms.
+ Experience with additional data orchestration tools.
+ Familiarity with other big data tools and technologies.
+ Previous experience in a similar role within a dynamic and fast-paced environment.
Experience in Cloudera, Hadoop, Cloudera Data Science Workbench (CDSW), Cloudera Machine Learning (CML) would be highly desirable.
**Work Environment:**
+ Full time on-site presence required
**If you don't meet every single requirement, we still encourage you to apply.**
Sometimes, people hesitate to apply because they can't tick every box. We encourage you to apply if you believe the role will suit you well, even if you don't meet all the criteria. You might be exactly who we are looking for, either for this position or for our opportunities at Northrop Grumman UK. We are on an exciting growth trajectory and growing our teams across the UK.
**Security clearance:**
You must hold the highest level of UK Government security clearance. Our requirement team is on hand to answer any questions and we will guide you through the process: .
**Benefits:**
We can offer you a range of flexible working options to suit you, including optional compressed working schedule with every other Friday off. Our benefits including private health care, cash health plan, holiday buy and sell, career development opportunities and performance bonuses. For a comprehensive list of benefits, speak to our recruitment team.
**Why join us?**
+ **A mission to believe in** **-** Every day we contribute to building a more secure and connected world, expanding our reach from land, sea, and air to space and cyberspace. From engineering data and intelligence solutions, to developing maritime navigation and control systems and innovating command and control systems for the UK and NATO, what we do together matters.
+ **A place to belong and thrive** **-** Every voice matters at our table meaning you can bring your authentic self to work. From our Employee Resource Groups backed by thousands of employees to our partnerships with the Association For Black and Minority Ethnic Engineers, Forces Transition Group, Mind, and Women in Defence - we are passionate about growing and supporting our inclusive community where everyone can belong.
+ **Your career, your way** - Shape your career journey with diverse roles, mentorship, and development opportunities that fuel your curiosity, channel your expertise, and nurture your passion. Looking for flexibility? Balance your professional career with your personal life through our health and wellbeing benefits, discount schemes, and investment in your future development. Speak to our team to find the balance that's right for you.
**Ready to apply?**
**Yes** - Submit your application online. Your application will be reviewed by our team and we will be in touch.
**Possibly, I'd like to find out more** **about this role** - Reach out to our team for more information and support: .
**No, I don't think this role is right for me** - Our extensive UK growth means we have exciting, new opportunities opening all the time. Speak to our team to discuss your career goals.
Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.
Big Data Java Developer
Posted 15 days ago
Job Viewed
Job Description
At IBM CIC, we deliver deep technical and industry expertise to a wide range of public and private sector clients in the UK.
A career in IBM CIC means you'll have the opportunity to work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM CIC. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions which impact a wide network of clients, whom may be at their site or one of our CIC or IBM locations. Our culture of evolution centres on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
We offer:
* A multitude of training opportunities from classroom to e-learning, mentoring and coaching programs as well as the chance to gain industry recognized certifications
* Regular and frequent promotion and progression opportunities to ensure you can drive and develop your career with us
* Feedback and checkpoints throughout the year
* Diversity & Inclusion as an essential and authentic component of our culture through our policies and process as well as our Employee Champion teams and support networks
* A culture where your ideas for growth and innovation are always welcome
* Internal recognition programs for peer-to-peer appreciation as well as from manager to employees
* Tools and policies to support your work-life balance from flexible working approaches, sabbatical programs, paid paternity leave, maternity leave and an innovative maternity returners scheme
* More traditional benefits, such as 25 days holiday (in addition to public holidays), online shopping discounts, an Employee Assistance Program, a group personal pension plan of an additional 5% of your base salary paid by us monthly to save for your future.
**Your role and responsibilities**
As a Big Data Engineer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys.
* You'll have the opportunity to work with the latest technologies, ensuring the applications delivered are high performing, highly available, responsive, and maintainable.
Your primary responsibilities include:
* Analyze, validate and propose improvements to existing failures, with the support of the architect and technical leader.
* Involvement in every step of the process, from design, development, testing release changes and troubleshoot where necessary, providing a great customer service.
* Drive key discussions with your stakeholders and analyze the current landscape for opportunities to operate and code creative solutions.
**Required technical and professional expertise**
* Experienced Java developer with experience of designing and building new applications.
* Excellent grasp of object oriented design and the experience to know when to apply common design patterns.
* Knowledge of and ability to apply SOLID principles.
* Experience of test driven development and related techniques such as mocking and dependency injection.
* Developing in a secure environment.
* Maven Git DevOps tooling experience
* Performance optimisation of Java application
* AWS (lambda S3 DynamoDB etc)
* Cloudformation
* javascript
As an equal opportunities' employer, we welcome applications from individuals of all backgrounds. However, for you to be eligible for this role, you must have the valid right to work in the UK. Unfortunately, we do not offer visa sponsorship and have no future plans to do so. You must be a resident in the UK and have been living continuously in the UK for the last 10 years. You must be able to hold or gain a UK government security clearance.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Big Data Java Developer

Posted 25 days ago
Job Viewed
Job Description
In this role, you'll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM CIC is rooted by long-term relationships and close collaboration with clients across the globe.
You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground breaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.
**Your role and responsibilities**
IBM is currently seeking a seasoned Big Data Java Developer to join our Public Sector team for a significant project. The ideal candidate will possess a deep understanding of Big Data technologies, particularly within a Java context, along with a passion for creating innovative solutions tailored to the unique demands of public sector projects.
As a Developer at IBM you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys. You'll have the opportunity to work with the latest technologies, ensuring the applications delivered are high performing, highly available, responsive, and maintainable. Your primary responsibilities include: Analytical Problem-Solving and Solution Enhancement: Analyze, validate and propose improvements to existing failures, with the support of the architect and technical leader. Comprehensive Engagement Across Process Phases: Involvement in every step of the process, from design, development, testing release changes and troubleshoot where necessary, providing a great customer service. Strategic Stakeholder Engagement and Innovative Coding Solutions: Drive key discussions with your stakeholders and analyze the current landscape for opportunities to operate and code creative solutions.
**Required technical and professional expertise**
* Design, develop, and maintain Java-based applications for processing and analyzing large datasets, utilizing frameworks such as Apache Hadoop, Spark, and Kafka.
* Collaborate with cross-functional teams to define, design, and ship data-intensive features and services.
* Optimize existing data processing pipelines for efficiency, scalability, and reliability.
* Develop and execute unit tests, ensuring the quality and robustness of the code.
* Implement best practices for software development, including version control, continuous integration, and automated testing.
* Provide technical guidance and mentorship to junior developers.
* Stay abreast of the latest trends, best practices, and emerging technologies in Big Data and Java development.
* Contribute to the design and implementation of highly scalable, secure, and resilient data processing systems.
**Preferred technical and professional experience**
* Bachelor's or Master's degree in Computer Science, Information Technology, or a related field, or equivalent experience.
* Experience in Big Data Java development.
* In-depth knowledge of Big Data frameworks, such as Hadoop, Spark, and Kafka, with a strong emphasis on Java development.
* Proficiency in data modeling, ETL processes, and data warehousing concepts.
* Experience with data processing languages like Scala, Python, or SQL.
* Familiarity with containerization technologies (Docker) and orchestration tools (Kubernetes).
* Strong knowledge of software development principles, including object-oriented design, design patterns, and clean code practices.
* Excellent problem-solving skills and attention to detail.
* Strong communication and team collaboration skills.
* Ability to obtain necessary security clearances as required by public sector projects.
Preferred Qualifications:
* Experience working in the public sector or understanding of public sector operations.
* Knowledge of IBM Big Data and AI solutions.
* Experience with cloud platforms, preferably IBM Cloud.
* Contributions to open-source projects or personal projects demonstrating Big Data and Java development skills.
* Relevant certifications such as Cloudera Certified Associate (CCA) or Hortonworks Certified Developer (HCD) are considered a plus.
By joining IBM's Public Sector team as a Big Data Java Developer, you'll have the opportunity to make a significant impact on public services while growing your career with one of the world's leading technology companies. We offer a competitive benefits package, ongoing learning opportunities, and a dynamic, inclusive work environment where your skills and passions can reach their full potential.
As an equal opportunities' employer, we welcome applications from individuals of all backgrounds. However, for you to be eligible for this role, you must have the valid right to work in the UK. Unfortunately, we do not offer visa sponsorship and have no future plans to do so. You must be a resident in the UK and have been living continuously in the UK for the last 10 years. You must be able to hold or gain a UK government security clearance.
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Databricks Architect (Modern Big Data)

Posted 2 days ago
Job Viewed
Job Description
We are seeking a highly experienced and visionary Data Solutions Architect (Modern Big Data) to join our Data & AI practice. The successful candidate will bring extensive expertise in architecting and delivering modern big data platforms that are scalable, reliable, and business-aligned. This role is pivotal in enabling clients to harness the power of streaming data, data lakes, lakehouses, and advanced analytics platforms, while guiding them on their data modernisation journeys.
As a trusted advisor, you will collaborate with executives, stakeholders, and technical teams to define modern big data strategies, design cloud-native architectures, and implement industry-leading best practices. You will thrive in a fast-paced, evolving technology environment, continuously expanding your knowledge to ensure NTT DATA and our clients remain leaders in data-driven innovation.
**What you'll be doing:**
**Primary Responsibilities:**
+ Client Engagement & Delivery
+ Solution Design & Implementation
+ Modernisation & Transformation
+ Thought Leadership & Knowledge Sharing
+ Collaboration & Leadership
**Business Relationships:**
+ Client Partners
+ Practice Leaders and Members
+ Peer-level relationships within client organisations up to Head of Data Engineering, Chief Data Architect, CIO, and CDO level
**What experience you'll bring:**
**Must-Have Competencies:**
+ 8+ years data architecture experience - Enterprise-scale solutions across multiple sectors with proven delivery track record
+ Technical leadership at scale - Leading 15+ person cross-functional teams and serving as technical escalation point for C-level stakeholders
+ Full data lifecycle mastery - End-to-end expertise from ingestion to consumption, including governance, security, and both batch/real-time processing
+ Business-technology translation - Ability to align data strategy with business objectives and communicate across all stakeholder levels
+ Databricks platform expertise - Deep hands-on experience with Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and multi-cloud implementations
**Must be eligible for SC clearance**
**Nice to Have:**
+ Cloud-native architecture expertise - Hands-on experience with AWS/Azure/GCP, data lakes, real-time streaming, and infrastructure-as-code
+ Presales & business development experience - Track record supporting opportunity qualification, bid reviews, proposal development, and client-facing sales activities
+ Data governance & compliance - Strong background in security frameworks, regulatory compliance (GDPR), data lineage, and quality management
+ AI/ML integration capabilities - Experience with MLOps, analytics platforms, and integrating AI/ML into data architectures
+ Agile delivery & thought leadership - Proven agile/hybrid delivery experience with contribution to practice growth through proposition development and knowledge sharing
**Experience, Qualifications:**
+ Experience: Minimum 8-12 years in data architecture, engineering, or consulting, with at least 4+ years in modern big data solution architecture.
+ Education: University degree required.
+ Preferred: BSc/MSc in Computer Science, Data Engineering, or related field.
+ Relevant certifications in Databricks, Kafka, or cloud platforms highly desirable.
**Who we are:**
We're a business with a global reach that empowers local teams, and we undertake hugely exciting work that is genuinely changing the world. Our advanced portfolio of consulting, applications, business process, cloud, and infrastructure services will allow you to achieve great things by working with brilliant colleagues, and clients, on exciting projects.
Our inclusive work environment prioritises mutual respect, accountability, and continuous learning for all our people. This approach fosters collaboration, well-being, growth, and agility, leading to a more diverse, innovative, and competitive organisation. We are also proud to share that we have a range of Inclusion Networks such as: the Women's Business Network, Cultural and Ethnicity Network, LGBTQ+ & Allies Network, Neurodiversity Network and the Parent Network.
For more information on Diversity, Equity and Inclusion please click here: Creating Inclusion Together at NTT DATA UK | NTT DATA ( we'll offer you:**
We offer a range of tailored benefits that support your physical, emotional, and financial wellbeing. Our Learning and Development team ensure that there are continuous growth and development opportunities for our people. We also offer the opportunity to have flexible work options.
You can find more information about NTT DATA UK & Ireland here: are an equal opportunities employer. We believe in the fair treatment of all our employees and commit to promoting equity and diversity in our employment practices. We are also a proud Disability Confident Committed Employer - we are committed to creating a diverse and inclusive workforce. We actively collaborate with individuals who have disabilities and long-term health conditions which have an effect on their ability to do normal daily activities, ensuring that barriers are eliminated when it comes to employment opportunities. In line with our commitment, we guarantee an interview to applicants who declare to us, during the application process, that they have a disability and meet the minimum requirements for the role. If you require any reasonable adjustments during the recruitment process, please let us know. Join us in building a truly diverse and empowered team.
Back to search Email to a friend Apply now
Senior Data Scientist (Big Data Analytics)
Posted 4 days ago
Job Viewed
Job Description
Key Responsibilities:
- Design, develop, and implement sophisticated machine learning models and algorithms to solve business problems.
- Analyze large, complex datasets to identify trends, patterns, and actionable insights using advanced statistical methods.
- Develop data pipelines and frameworks for efficient data processing and analysis.
- Collaborate with engineering teams to deploy models into production environments.
- Build predictive models for forecasting, classification, clustering, and recommendation systems.
- Communicate complex findings and insights clearly to both technical and non-technical stakeholders through compelling visualizations and presentations.
- Stay current with the latest advancements in data science, machine learning, and artificial intelligence.
- Mentor junior data scientists and contribute to the team's technical growth.
- Define key metrics and develop dashboards to monitor business performance and model effectiveness.
- Ensure data quality and integrity throughout the analysis process.
- Contribute to the strategic direction of data science initiatives within the organization.
- Master's or Ph.D. in Computer Science, Statistics, Mathematics, or a related quantitative field.
- Minimum of 5 years of professional experience in data science or a related field, with a focus on Big Data technologies.
- Proficiency in programming languages such as Python or R, and experience with relevant data science libraries (e.g., scikit-learn, TensorFlow, PyTorch).
- Strong experience with Big Data technologies and distributed computing frameworks (e.g., Spark, Hadoop, Hive).
- Expertise in SQL and experience with various database systems (relational and NoSQL).
- Solid understanding of statistical modeling, machine learning algorithms, and data mining techniques.
- Experience with data visualization tools (e.g., Tableau, Power BI, Matplotlib).
- Excellent problem-solving and analytical skills.
- Strong communication and presentation skills, with the ability to explain complex concepts to diverse audiences.
- Experience working in a hybrid or agile development environment.
Senior Java Developer - (Java/Big Data)
Posted today
Job Viewed
Job Description
For over 20 years Global Relay has set the standard in enterprise information archiving with industry-leading cloud archiving, surveillance, eDiscovery, and analytics solutions. We securely capture and preserve the communications data of the world’s most highly regulated firms, giving them greater visibility and control over their information and ensuring compliance with stringent regulations.nWe believe great businesses thrive on diversity, inclusion, and the contributions of all employees. To that end, we recruit candidates from different backgrounds and foster a work environment that encourages employees to collaborate and learn from each other, completely free of barriers.nYour role
Joining the Reporting product line, you would work as a member of a highly focused team. This team specialises in Java-based data engineering, designing and delivering large-scale ETL workflows on a lake house platform. You’ll be working with modern big data technologies to move, transform, and optimise data for high-performance analytics and regulatory reporting. The environment encourages autonomy, problem-solving, and system-level thinking. If you’re passionate about clean, well-tested, performant code and enjoy working on complex data pipelines at scale, you’ll thrive here.nTech stack
Micro-services Container Platforms (Kubernetes, CRC, Docker)nBig Data Technologies (Apache Spark, Flink, HDFS, Airflow, Trino, Iceberg, Hive)nDependency injection frameworks (Spring)nObservability (Loki/Grafana)nLarge scale data processing (Kafka)nCI/CD Build tools (Maven, Git, Jenkins)nNoSQL DBs (CockroachDB, Cassandra, Zookeeper, ArangoDB)nYour responsibilities
Design, implement and provide architectural guidance in deploying microservices as a part of an agile development teamnMigrate existing services to microservices, with the goal of reducing complexity at the design and architecture levelnWrite unit and integration tests for your Java codenCollaborate with testers in development of functional test casesnDevelop deployment systems for Java based systemsnCollaborate with product owners on user story generation and refinementnMonitor and support the operation of production systemsnParticipate in knowledge sharing activities with colleaguesnPair programming and peer reviewsnAbout you
Required Experience:
Minimum 8 years of Java development experience in an Agile environment, building scalable applications and servicesnExperience with RESTful servicesnPassion for Test Driven DevelopmentnCI/CD
Attributes:
Good communicationnProblem SolvingnSelf-starternTeam player
What you can expect
At Global Relay, there’s no ceiling to what you can achieve. It’s the land of opportunity for the energetic, the intelligent, the driven. You’ll receive the mentoring, coaching, and support you need to reach your career goals. You’ll be part of a culture that breeds creativity and rewards perseverance and hard work. And you’ll be working alongside smart, talented individuals from diverse backgrounds, with complementary knowledge and skills.nGlobal Relay is an equal-opportunity employer committed to diversity, equity, and inclusion.nWe seek to ensure reasonable adjustments, accommodations, and personal time are tailored to meet the unique needs of every individual.nWe understand flexible work arrangements are important, and we encourage that in our work culture. Whether it’s flexibility around work hours, workstyle, or lifestyle, we want to ensure our employees have a healthy work/life balance. We support and value a hybrid work model that blends collaboration with the team in the office and focus time from the comfort of your home.nTo learn more about our business, culture, and community involvement, visit
Data Solutions Architect (Modern Big Data)
Posted today
Job Viewed
Job Description
Databricks Solutions Architect (Modern Big Data)
at
NTT DATAnWe are seeking a highly experienced Data Solutions Architect to join our Data & AI practice. The successful candidate will have extensive expertise in architecting and delivering modern big data platforms that are scalable, reliable, and business-aligned. This role focuses on enabling clients to harness streaming data, data lakes, lakehouses, and advanced analytics platforms, guiding them on data modernization journeys.nAs a trusted advisor, you will collaborate with executives, stakeholders, and technical teams to define modern big data strategies, design cloud-native architectures, and implement best practices. You will thrive in a fast-paced, evolving technology environment, continuously expanding your knowledge to keep NTT DATA and clients at the forefront of data-driven innovation.nWhat you'll be doing
Client Engagement & DeliverynSolution Design & ImplementationnModernisation & TransformationnThought Leadership & Knowledge SharingnBusiness Relationships
Client PartnersnPractice Leaders and MembersnPeer-level relationships within client organisations up to Head of Data Engineering, Chief Data Architect, CIO, and CDO levelnWhat experience you'll bring
8+ years data architecture experience with enterprise-scale solutions across multiple sectors and a proven delivery track recordnTechnical leadership at scale – Leading 15+ person cross-functional teams and serving as technical escalation point for C-level stakeholdersnFull data lifecycle mastery – End-to-end expertise from ingestion to consumption, including governance, security, and both batch/real-time processingnBusiness-technology translation – Ability to align data strategy with business objectives and communicate across all stakeholder levelsnDatabricks platform expertise – Deep hands-on experience with Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and multi-cloud implementationsnMust be eligible for SC clearancenNice to Have
Cloud-native architecture expertise – Hands-on experience with AWS/Azure/GCP, data lakes, real-time streaming, and infrastructure-as-codenPresales & business development experience – Opportunity qualification, bid reviews, proposal development, and client-facing sales activitiesnData governance & compliance – Security frameworks, regulatory compliance (GDPR), data lineage, and quality managementnAI/ML integration capabilities – Experience with MLOps, analytics platforms, and integrating AI/ML into data architecturesnAgile delivery & thought leadership – Proven agile/hybrid delivery experience with contributions to practice growthnExperience, Qualifications
Experience: Minimum 8–12 years in data architecture, engineering, or consulting, with at least 4+ years in modern big data solution architecturenEducation: University degree required; BSc/MSc in Computer Science, Data Engineering, or related field preferrednCertifications: Relevant certifications in Databricks, Kafka, or cloud platforms highly desirablenMeasures of Success
Delivery of modern big data solutions aligned to client business objectivesnHigh client satisfaction and repeat engagementsnLeadership in client transformation journeys to cloud-native data platformsnContribution to practice growth through assets, accelerators, and thought leadershipnWho we are
NTT DATA is a global services provider delivering consulting, applications, cloud, and infrastructure services. We value inclusion, collaboration, and continuous learning, with networks such as Women’s Business Network, Cultural & Ethnicity Network, LGBTQ+ & Allies Network, Neurodiversity Network, and Parent Network.nFor more information on Diversity, Equity and Inclusion please visit: Creating Inclusion Together at NTT DATA UKnWhat we'll offer you
We offer tailored benefits supporting physical, emotional, and financial wellbeing, with continuous growth and development opportunities and flexible work options.nYou can find more information about NTT DATA UK & Ireland here: & Accessibility
We are an equal opportunities employer, committed to equity and diversity in our employment practices. We guarantee an interview to applicants who declare they have a disability and meet the minimum requirements for the role, and we will provide reasonable adjustments during the recruitment process if requested.
#J-18808-Ljbffrn
Be The First To Know
About the latest Data streaming Jobs in United Kingdom !
Data Engineering Lead
Posted 14 days ago
Job Viewed
Job Description
Data Engineering Lead
I am working with a forward-thinking professional services organisation that is expanding its Data & Innovation capabilities and looking for a Data Engineering Lead to join their team. This is a fantastic opportunity to take on a hands-on leadership role where you will guide a small team of technical specialists while shaping the future of data engineering, automation, and systems development across the business.
You'll be at the heart of strategic technical delivery, blending architectural oversight with hands-on execution, and mentoring others to build scalable, modern solutions using technologies like Databricks and the Azure tech stack.
Key Responsibilities:
- Provide technical leadership to a small team focusing on data engineering and development
- Define and maintain scalable internal data and systems architecture aligned with business needs
- Lead the design and delivery of complex engineering solutions, ensuring best practices
- Guide the team on prioritised initiatives, ensuring timely and high-quality delivery
- Deliver hands-on technical change and development where required
Skills & Experience Required:
- Strong Data Engineering experience
- Hands-on expertise with the Azure tech stack (Synapse, Data Factory, Data Lake Storage) and Databricks
- Proven ability to lead and mentor technical teams in agile environments
- Ability to work closely with other leaders across the business and have input into strategy planning sessions focusing on technical execution
Benefits:
- Salary of up to 95,000 per year
- 25 days annual leave, plus bank holidays
- Private healthcare schemes and life insurance policies
- Enhanced parental leave policies
- Lifestyle benefits such as cycle to work schemes, retail discounts and vehicle salary sacrifice schemes
Data Engineering Manager
Posted 14 days ago
Job Viewed
Job Description
Location: Leeds (Mostly Remote – 1 Day On-Site)
Salary: Up to £75,000 per annum
Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just one day on-site per week.
You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.
About YouYou might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.
Key Responsibilities-
Lead development of data pipelines and solutions using Databricks, Python, and SQL
-
Design and maintain data models supporting analytics and business intelligence
-
Build and optimise ELT/ETL processes on AWS or Azure
-
Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products
-
Champion best practices in testing, CI/CD, version control, and infrastructure as code
-
Mentor and support your team, taking ownership of technical delivery and decisions
-
Drive continuous improvements in platform performance, cost, and reliability
-
Hands-on experience with Databricks or similar data engineering platforms
-
Strong Python and SQL skills in data engineering contexts
-
Expertise in data modelling and building analytics-ready datasets
-
Experience with AWS or Azure cloud data services
-
Proven leadership or mentorship experience
-
Excellent communication and stakeholder management
-
Agile delivery and DevOps tooling knowledge
-
Experience with infrastructure-as-code (Terraform, CloudFormation)
-
Familiarity with CI/CD pipelines and orchestration tools
-
Knowledge of data governance and quality controls
-
Experience in regulated or large-scale environments
Apply now to speak with VIQU IT in confidence, or reach out to Phoebe Rees via the VIQU IT website.
Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).
For more exciting roles and opportunities like this, follow us on LinkedIn @VIQU IT Recruitment.