340 Senior Big Data Engineer Databricks Relocation To Abu Dhabi jobs in the United Kingdom
External Examiner/BTEC Higher Nationals Cloud Computing
Posted today
Job Viewed
Job Description
**BTEC Higher Nationals**
**Purpose of this Role**
Affirm national standards have been achieved and upheld
Monitor through external examiner sampling and visit activities, centres' compliance with Pearson quality assurance expectations for RQF BTEC Higher National programmes
Support centres during the sampling process
Support centres in the delivery of BTEC Higher National programmes to national standards.
**Key Accountabilities**
Covering a defined range of programmes within a sector, the External Examiner (EE) will:
Undertake sampling of assessed student work within defined parameters and rules to establish that centres are assessing learning outcomes in accordance with Pearson standards for its Higher National qualifications
Provide sampling-related support and development to centres
Produce reports for centres and Pearson on the sampling undertaken, outcomes reached, and support provided
Apply appropriate sanctions in consultation with the team leader where it is deemed assessment outcomes are not consistent with the published national standards being met
Produce targeted actions for centres to assist with remedial actions where national standards are not being upheld
Support centres to understand and implement identified actions
Facilitate the Senior External Examiner (SEE) in sourcing materials for training and standardisation
Report back to Pearson and centres following EE activity within agreed service-level agreements
Undertake any other duties appropriate to the work of Technical and Professional Assessment in relation to this role
**Previous Experience:** **Essential:**
Significant experience in delivering and assessing BTEC Higher National qualifications in the subject area
Hold a qualification at least at Level 6 and a full and relevant competence qualification for working in the sector
Participation annually in online training and standardisation and successful completion of the set standardisation activity
**Desirable:**
Evidence of recent Continuous Professional Development (CPD) in the sector
A willingness to use technology-based approaches to communication and centre support
**Skills and Knowledge** **Essential:**
Excellent communication, written, verbal, IT and interpersonal skills
Good working knowledge of the specifications that comprise the area of expertise for the role
A customer-focused approach
The need to meet deadlines
Develop and monitor clear action plans
Ability to work effectively as part of a team
**Desirable:**
Word processing and intermediate Excel skills
**About Pearson**
We value the power of inclusive culture and embed diversity and inclusion in everything we do. Pearson promotes a company culture where differences are embraced as strengths, opportunities are equal and accessible, consideration and respect are the norm.
Through our talent, we believe that diversity and inclusion make us a more innovative and vibrant company. People are at the centre of our company. We are committed to a sustainable environment and workplace ecosystem where talent can learn, grow, and thrive.
Welcome to Pearson, the world's leading learning company. We provide content, assessment and digital services to learners, educational institutions, employers, governments and other partners globally.
We are the UK's largest awarding body and offer qualifications that are globally recognised and benchmarked, with educational excellence rooted in a range of General and Vocational courses.
**Application Information** We have a number of opportunities available for teaching professionals to join our growing teams of examiners, moderators and verifiers.
Big Data Engineer
Posted today
Job Viewed
Job Description
RELOCATION ASSISTANCE: Relocation assistance may be available
CLEARANCE TYPE: UK-Highest Level of Government Clearance
TRAVEL: Yes, 10% of the Time
**Salary: £77,400 - £116,000**
**Define Possible at Northrop Grumman UK**
At Northrop Grumman UK, our mission is to solve the most complex challenges by shaping the technology and solutions of tomorrow. We call it Defining Possible.
This mind-set goes beyond our customer solutions; it's the foundation for your career development and the impact we have within the community. So, what's your possible?
**Opportunity:**
This is more than just a job; it's a mission.
As a Big Data Systems Engineer, you will be responsible for designing, implementing, and maintaining scalable big data systems that support our data science, machine learning, and AI workloads. You will work closely with cross-functional teams to ensure seamless data integration, security, and compliance with GDPR and privacy regulations. Your expertise in scripting, troubleshooting, and integration testing will be essential in optimizing our data pipelines and orchestration processes.
Our UK Cyber & Intelligence business combines modern software development approaches with a rich heritage and experience in the Defence and security sectors. Our customers have complex and sensitive data and information requirements requiring a mission partner who quickly understands the context, delivering and sustaining a portfolio of challenging technology projects at scale and pace, supporting them through an ambitious digital transformation programme.
If you are looking for a career with meaning where you can make a difference to the nation's security and support critical missions, then look no further.
_"My purpose; to lead a team of engineers with the brightest minds, to push the boundaries and define possible together."_
**Role responsibilities:**
+ Scripting and Automation: Develop and maintain scripts for automating data processes and workflows.
+ Troubleshooting: Diagnose and resolve technical issues related to big data systems, data pipelines, and integrations.
+ Integration Testing: Conduct thorough testing to ensure seamless integration of new tools and technologies into existing systems.
+ Linux Internals: Utilize in-depth knowledge of Linux internals to optimize performance and reliability of big data infrastructure.
+ Network Protocols: Apply understanding of TCP/IP and OSI models in the design and troubleshooting of networked systems.
+ Data Pipeline Support: Manage and optimize data pipelines and orchestration tools such as NiFi and Airflow.
+ Scalable System Design: Design scalable big data systems with a focus on security, GDPR compliance, and privacy
+ Hybrid Cloud Management: Leverage hybrid cloud experience to manage on-premise and AWS cloud resources effectively
+ Data Science Support: Support data science, machine learning, and AI workloads using tools like Jupyter, Spacy, Transformers, and NLTK.
+ Big Data Platforms: Utilize big data NoSQL engines and platforms such as Hive, Impala, and Elasticsearch for data storage and processing
+ BI and Visualization: Implement and support business intelligence and visualization tools like Tableau, Kibana, and PowerBI to provide actionable insights.
**We are looking for:**
+ Strong troubleshooting skills and the ability to diagnose and resolve complex technical issues.
+ Experience with integration testing and ensuring seamless tool integration.
+ In-depth knowledge of Linux internals and system administration.
+ Understanding of TCP/IP and OSI models.
+ Hands-on experience with data pipeline tools like NiFi and Airflow.
+ Proven ability to design scalable big data systems with a focus on security and GDPR compliance.
+ Hybrid cloud experience, specifically with on-premise and AWS cloud environments.
+ Familiarity with data science, machine learning, and AI tools such as Jupyter, Spacy, Transformers, and NLTK.
+ Experience with big data NoSQL engines/platforms such as Hive, Impala, and Elasticsearch.
+ Proficiency with business intelligence and visualization tools like Tableau, Kibana, and PowerBI.
+ Excellent communication and collaboration skills.
Preferred Qualifications:
+ Certification in AWS or other cloud platforms.
+ Experience with additional data orchestration tools.
+ Familiarity with other big data tools and technologies.
+ Previous experience in a similar role within a dynamic and fast-paced environment.
Experience in Cloudera, Hadoop, Cloudera Data Science Workbench (CDSW), Cloudera Machine Learning (CML) would be highly desirable.
**Work Environment:**
+ Full time on-site presence required
**If you don't meet every single requirement, we still encourage you to apply.**
Sometimes, people hesitate to apply because they can't tick every box. We encourage you to apply if you believe the role will suit you well, even if you don't meet all the criteria. You might be exactly who we are looking for, either for this position or for our opportunities at Northrop Grumman UK. We are on an exciting growth trajectory and growing our teams across the UK.
**Security clearance:**
You must hold the highest level of UK Government security clearance. Our requirement team is on hand to answer any questions and we will guide you through the process: .
**Benefits:**
We can offer you a range of flexible working options to suit you, including optional compressed working schedule with every other Friday off. Our benefits including private health care, cash health plan, holiday buy and sell, career development opportunities and performance bonuses. For a comprehensive list of benefits, speak to our recruitment team.
**Why join us?**
+ **A mission to believe in** **-** Every day we contribute to building a more secure and connected world, expanding our reach from land, sea, and air to space and cyberspace. From engineering data and intelligence solutions, to developing maritime navigation and control systems and innovating command and control systems for the UK and NATO, what we do together matters.
+ **A place to belong and thrive** **-** Every voice matters at our table meaning you can bring your authentic self to work. From our Employee Resource Groups backed by thousands of employees to our partnerships with the Association For Black and Minority Ethnic Engineers, Forces Transition Group, Mind, and Women in Defence - we are passionate about growing and supporting our inclusive community where everyone can belong.
+ **Your career, your way** - Shape your career journey with diverse roles, mentorship, and development opportunities that fuel your curiosity, channel your expertise, and nurture your passion. Looking for flexibility? Balance your professional career with your personal life through our health and wellbeing benefits, discount schemes, and investment in your future development. Speak to our team to find the balance that's right for you.
**Ready to apply?**
**Yes** - Submit your application online. Your application will be reviewed by our team and we will be in touch.
**Possibly, I'd like to find out more** **about this role** - Reach out to our team for more information and support: .
**No, I don't think this role is right for me** - Our extensive UK growth means we have exciting, new opportunities opening all the time. Speak to our team to discuss your career goals.
Northrop Grumman is committed to hiring and retaining a diverse workforce, and encourages individuals from all backgrounds and all abilities to apply and consider becoming a part of our diverse and inclusive workforce.
Senior Databricks Data Engineer
Posted 15 days ago
Job Viewed
Job Description
Senior Databricks Data Engineer (flexible location)
Bibby Financial Services have an exciting opportunity available for a reliable Senior Databricks Data Engineer to join our team. You will join us on a full time, permanent basis and in return, you will receive a competitive salary of £60,000 - £70,000 per annum.
About the role:
As our Senior Databricks Data Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units domestically and internationally.
You will have an active leadership role in determining and developing the shape of your teams solution delivery against business requirements, as well as helping to inform and input into the wider technical architecture and strategy.
This is very much a hands-on role, where the majority of your time will be spent actively developing solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to.
Your responsibilities as our Senior Databricks Data Engineer will include:
- Understand the business / product strategy and supporting goals with the purpose of ensuring data interpretation aligns li>Provide technical leadership on how to break down initiatives into appropriately sized features, epics and stories that balance value and risk. Take a leadership role on setting standards, driving quality and consistency in solution delivery
- Work closely with the Data Architect to collaborate on Design of our data architecture and interpret into a build plan
- Lead the build and maintenance of scalable data pipelines and ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIs
- Deliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniques
- Collaborate with the BI Product Owner, analysts, and other business stakeholders to understand data requirements and deliver solutions that meet business needs
- Optimize and tune data processing systems for performance, reliability, and scalability
- Implement data quality and validation processes to ensure the accuracy and integrity of data throughout the pipelines
- Operate an agile CI/CD environment within Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices
- Develop and maintain data models, schemas, and documentation
- Monitor and troubleshoot data pipeline issues, ensuring timely resolution
- Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as appropriate
- Ensure adherence to BFS Governance processes
- Provide line management and technical leadership to a small team of Data Engineers
- Work closely with the Data Architect to collaborate on Design of our data architecture and interpret into a build plan
- Lead the build and maintenance of scalable data pipelines and ETL processes to support data integration and analytics from a diverse range of data sources, Cloud storage, databases and APIs
- Deliver large-scale data processing workflows (ingestion, cleansing, transformation, validation, storage) using best practice tools and techniques
What we are looking for in our ideal Senior Databricks Data Engineer:
- A Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Alternatively, relevant experience in the data engineering field
- Databricks, including Unity Catalog
- Terraform, defining, deploying, and managing cloud infrastructure as code
- Proficiency in programming languages such as Python, Spark, SQL
- Strong experience with SQL databases
- Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF)
- Experience with cloud platforms (Azure preferred) and related data services
- Excellent problem-solving skills and attention to detail li>Inclusive and curious, continuously seeks to build knowledge and understanding
- Strong communication and collaboration skills. li>Experience of Waterfall and Agile delivery methodologies
As our Senior Databricks Data Engineer , we will reward you and your hard work with:
- Private healthcare for you and your family
- Company car allowance
- Company pension scheme
- Wide range of flexible benefits, such as gym membership, technology, or health assessments
- Access to an online wellbeing centre
- Range of discounts from many businesses
- 25 days holiday, which increases with servic,e and options to buy or sell more
- Electric Vehicle/Plug-in Hybrid Vehicle (EV/PHEV) scheme
Why us?
We’ve supported small and medium-sized enterprises (SMEs) since 1982, and today we support more than 9000 businesses worldwide. We are proud to help businesses, both big and small to grow and thrive in domestic and international markets.
We’re in the business of relationships. Whether working together or supporting our clients, that’s what makes us stand out from the crowd.
We know our value lies in our brilliant people, It is fast-paced and varied, and we can handle it. We trust each other, take ownership, work flexibly, have fun and deliver for our clients every time.
We empower our colleagues to be themselves and grow in the way they want – we believe in them and celebrate their success.
There’s no place quite like BFS and we’re proud of that. It’s all down to our colleagues - they make us the business with which every SME wants to partner.
If you would like to join us, please click ‘Apply ’ today to be considered as our Senior Databricks Data Engineer – we would love to hear from you! This role will be hybrid and can be based in any of our UK offices.
We're absolutely committed to being a truly inclusive place to work, where everyone has an equal opportunity to reach their true potential. Let us know if you need adjustments to support you through any stage of the recruitment process.
We reserve the right to close applications early. No agencies, please.
Data Engineer (Databricks) - Leeds
Posted 5 days ago
Job Viewed
Job Description
Data Engineer (Databricks) - Leeds
(Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Data Engineer)
Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for Data Engineers with significant Databricks experience to join an exceptional Agile engineering team.
We are seeking a Data Engineer with strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL - Aurora, MS SQL Server, MySQL is expected, as well as significant Agile and Scrum exposure along with SOLID principles. Continuous Integration tools, Infrastructure as code and strong Cloud Platform knowledge, ideally with AWS is also key.
We are keen to hear from talented Data Engineer candidates from all backgrounds.
This is a truly amazing opportunity to work for a prestigious brand that will do wonders for your career. They invest heavily in training and career development with unlimited career progression for top performers.
Location: Leeds
Salary: £40k - £50k + Pension + Benefits
To apply for this position please send your CV to Nathan Warner at Noir Consulting.
(Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Data Engineer)
NOIRUKTECHREC
NOIRUKREC
Lead Data Engineer (Databricks) - Leeds
Posted 5 days ago
Job Viewed
Job Description
Lead Data Engineer (Databricks) - Leeds
(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer)
Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship.
We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing complex enterprise data ETL and ML pipelines and projections.
The successful candidate will have strong Python, PySpark and SQL experience, possess a clear understanding of databricks, as well as a passion for Data Science (R, Machine Learning and AI). Database experience with SQL and No-SQL - Aurora, MS SQL Server, MySQL is expected, as well as significant Agile and Scrum exposure along with SOLID principles. Continuous Integration tools, Infrastructure as code and strong Cloud Platform knowledge, ideally with AWS is also key.
We are keen to hear from talented Lead Data Engineer candidates from all backgrounds.
This is a truly amazing opportunity to work for a prestigious brand that will do wonders for your career. They invest heavily in training and career development with unlimited career progression for top performers.
Location: Leeds
Salary: £55k - £70k + Pension + Benefits
To apply for this position please send your CV to Nathan Warner at Noir Consulting.
(Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer)
NOIRUKTECHREC
NOIRUKREC
Data Engineer - Azure & Databricks
Posted 18 days ago
Job Viewed
Job Description
Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team.
Why This Role?
This is a chance to shape the future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that drive real business value.
In line with a hybrid working model, you'll spend 3 days per week either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders.
What You'll Be Doing:
- Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks.
- Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet systems.
- Collaborating with a cross-functional team of analysts, developers, and project managers to deliver clean, reliable, and actionable data.
- Supporting the likely transition to Azure Synapse and contributing to the evolution of the company's data architecture.
- Acting as a senior technical voice in the team - without line management responsibilities.
What We're Looking For:
Essential:
- Strong experience in Azure-based data engineering roles
- Strong skills in Azure Data Factory, Databricks, Azure Data Lake, SQL, and Python.
- Excellent communication and collaboration skills - you'll thrive in a dynamic, agile environment
- Available to start within a 4-week notice period
Desirable:
- Experience working with D365 or other CRM systems.
- Exposure to Azure Synapse and Power BI.
- Background in the construction or infrastructure industry.
What's on Offer:
- Salary : 60,000-80,000 depending on experience
- Hybrid Working : 3 days in office (Central London and / or Hertfordshire)
- Benefits : 26 days holiday + bank holidays, 5% matched pension, private healthcare (self-cover).
Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.
Tenth Revolution Group / Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed)
Data Engineer - Azure & Databricks
Posted 18 days ago
Job Viewed
Job Description
Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team.
Why This Role?
This is a chance to shape the future of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that drive real business value.
In line with a hybrid working model, you'll spend 3 days per week either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders.
What You'll Be Doing:
- Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks.
- Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet systems.
- Collaborating with a cross-functional team of analysts, developers, and project managers to deliver clean, reliable, and actionable data.
- Supporting the likely transition to Azure Synapse and contributing to the evolution of the company's data architecture.
- Acting as a senior technical voice in the team - without line management responsibilities.
What We're Looking For:
Essential:
- Strong experience in Azure-based data engineering roles
- Strong skills in Azure Data Factory, Databricks, Azure Data Lake, SQL, and Python.
- Excellent communication and collaboration skills - you'll thrive in a dynamic, agile environment
- Available to start within a 4-week notice period
Desirable:
- Experience working with D365 or other CRM systems.
- Exposure to Azure Synapse and Power BI.
- Background in the construction or infrastructure industry.
What's on Offer:
- Salary : 60,000-80,000 depending on experience
- Hybrid Working : 3 days in office (Central London and / or Hertfordshire)
- Benefits : 26 days holiday + bank holidays, 5% matched pension, private healthcare (self-cover).
Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and Credit Check.
Tenth Revolution Group / Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, and the London Power BI User Group. To find out more and speak confidentially about your job search or hiring needs, please contact me directly at (url removed)
Be The First To Know
About the latest Senior big data engineer databricks relocation to abu dhabi Jobs in United Kingdom !