156 Big Data Technologies jobs in the United Kingdom
Data Engineering Lead
Posted 8 days ago
Job Viewed
Job Description
Data Engineering Lead
I am working with a forward-thinking professional services organisation that is expanding its Data & Innovation capabilities and looking for a Data Engineering Lead to join their team. This is a fantastic opportunity to take on a hands-on leadership role where you will guide a small team of technical specialists while shaping the future of data engineering, automation, and systems development across the business.
You'll be at the heart of strategic technical delivery, blending architectural oversight with hands-on execution, and mentoring others to build scalable, modern solutions using technologies like Databricks and the Azure tech stack.
Key Responsibilities:
- Provide technical leadership to a small team focusing on data engineering and development
- Define and maintain scalable internal data and systems architecture aligned with business needs
- Lead the design and delivery of complex engineering solutions, ensuring best practices
- Guide the team on prioritised initiatives, ensuring timely and high-quality delivery
- Deliver hands-on technical change and development where required
Skills & Experience Required:
- Strong Data Engineering experience
- Hands-on expertise with the Azure tech stack (Synapse, Data Factory, Data Lake Storage) and Databricks
- Proven ability to lead and mentor technical teams in agile environments
- Ability to work closely with other leaders across the business and have input into strategy planning sessions focusing on technical execution
Benefits:
- Salary of up to 95,000 per year
- 25 days annual leave, plus bank holidays
- Private healthcare schemes and life insurance policies
- Enhanced parental leave policies
- Lifestyle benefits such as cycle to work schemes, retail discounts and vehicle salary sacrifice schemes
Data Engineering Manager
Posted 9 days ago
Job Viewed
Job Description
Location: Leeds (Mostly Remote – 1 Day On-Site)
Salary: Up to £75,000 per annum
Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just one day on-site per week.
You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.
About YouYou might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.
Key Responsibilities-
Lead development of data pipelines and solutions using Databricks, Python, and SQL
-
Design and maintain data models supporting analytics and business intelligence
-
Build and optimise ELT/ETL processes on AWS or Azure
-
Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products
-
Champion best practices in testing, CI/CD, version control, and infrastructure as code
-
Mentor and support your team, taking ownership of technical delivery and decisions
-
Drive continuous improvements in platform performance, cost, and reliability
-
Hands-on experience with Databricks or similar data engineering platforms
-
Strong Python and SQL skills in data engineering contexts
-
Expertise in data modelling and building analytics-ready datasets
-
Experience with AWS or Azure cloud data services
-
Proven leadership or mentorship experience
-
Excellent communication and stakeholder management
-
Agile delivery and DevOps tooling knowledge
-
Experience with infrastructure-as-code (Terraform, CloudFormation)
-
Familiarity with CI/CD pipelines and orchestration tools
-
Knowledge of data governance and quality controls
-
Experience in regulated or large-scale environments
Apply now to speak with VIQU IT in confidence, or reach out to Phoebe Rees via the VIQU IT website.
Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).
For more exciting roles and opportunities like this, follow us on LinkedIn @VIQU IT Recruitment.
Data Engineering Manager
Posted 9 days ago
Job Viewed
Job Description
Role: Data Engineering Manager - Manchester, hybrid
The Team:
A highly passionate bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models. We are with them to help protect their information, make informed decisions, deliver a personalised service and automate their workloads. Our engineers might be building data pipelines, modelling data, developing predictive models or automations for repeatable tasks or creation of data products.
The role:
Your role in the division is to lead the team developing our cloud data platform to further build-out our ‘single source of truth’ for company data. We have a recently implemented technology stack and clear direction of travel, so your initial objectives will be to understand our business data and team capabilities to then expand and improve our Kimball-model data warehouse in Azure, focusing on new datasets, pipeline resilience, performance and security. You will lead and coach the team in deploying tools and processes to ensure good practice is embedded, in line with our strategic themes of quality, efficiency, empowerment, transparency and governance. That means you will be conversant with data warehouse modelling, source control, CICD and Infrastructure as Code.
Our technology stack is based on Microsoft software: Azure, SQL Server and DevOps, using Terraform for infrastructure deployment. Our source data is also in Microsoft technology, currently on-premise in hosted data centres in the EU and US.
We currently manage our work in Kanban, with the support of a dedicated Delivery Lead, to respond to rapid growth in use-cases for our data.
Tasks & responsibilities include:
- Deliver good software development lifecycle processes are used for all our software artifacts, including use of source control, unit testing, CICD, IaC
- Deliver an enterprise data model considering all our current and likely future data sources
- Manage the improvement of our Kimball-style data warehouse in Azure
- Lead and coach a team of engineers to build and maintain the platform
- Partner with our delivery lead to manage the strategic roadmap and tactical workflow, ensuring that work items are delivered on time and with high quality
- Ability to communicate clearly with diverse teams, including across our geographic locations
- Ability to identify when a business need is unclear or ambiguous and ask the right questions
- Ability to translate a business need into a technical solution, considering scalability, security and resilience
- Relentless approach to continuous improvement of both processes and individuals
We think you’ll be a great fit if you have:
- Experience of team leadership, especially of hybrid on- and off-shore teams
- Experience of managing a team’s workload in collaboration with delivery, project or product professionals
- Experience of modelling and building an enterprise data warehouse to support analytical workloads
- Experience of using Azure services including Azure SQL Database, Data Factory, DevOps, Power BI
- Experience of good SDLC practices: source control (git), CI/CD, test and release processes
- Any experience using any of the following would also be a bonus in our environment: Dynamics CRM, Rabbit MQ, HubSpot, C# .NET development or legacy Microsoft data technologies (SSIS, SSRS)
We are looking for the right person who is a team player who can communicate effectively and is comfortable working within a diversified, multi-cultural and multi-functional team, both locally and remote, understanding the perspectives of each partner. Above all, someone with the passion to drive and succeed in their own career.
Experience in any of the above would help you to become productive in the job more quickly. We are genuinely committed to your success so, if you don’t quite meet all of our requirements yet, we encourage you to apply anyway and start a conversation.
Data Engineering Lead
Posted 8 days ago
Job Viewed
Job Description
Data Engineering Lead
I am working with a forward-thinking professional services organisation that is expanding its Data & Innovation capabilities and looking for a Data Engineering Lead to join their team. This is a fantastic opportunity to take on a hands-on leadership role where you will guide a small team of technical specialists while shaping the future of data engineering, automation, and systems development across the business.
You'll be at the heart of strategic technical delivery, blending architectural oversight with hands-on execution, and mentoring others to build scalable, modern solutions using technologies like Databricks and the Azure tech stack.
Key Responsibilities:
- Provide technical leadership to a small team focusing on data engineering and development
- Define and maintain scalable internal data and systems architecture aligned with business needs
- Lead the design and delivery of complex engineering solutions, ensuring best practices
- Guide the team on prioritised initiatives, ensuring timely and high-quality delivery
- Deliver hands-on technical change and development where required
Skills & Experience Required:
- Strong Data Engineering experience
- Hands-on expertise with the Azure tech stack (Synapse, Data Factory, Data Lake Storage) and Databricks
- Proven ability to lead and mentor technical teams in agile environments
- Ability to work closely with other leaders across the business and have input into strategy planning sessions focusing on technical execution
Benefits:
- Salary of up to 95,000 per year
- 25 days annual leave, plus bank holidays
- Private healthcare schemes and life insurance policies
- Enhanced parental leave policies
- Lifestyle benefits such as cycle to work schemes, retail discounts and vehicle salary sacrifice schemes
Data Engineering Manager
Posted 9 days ago
Job Viewed
Job Description
Location: Leeds (Mostly Remote – 1 Day On-Site)
Salary: Up to £75,000 per annum
Are you an experienced Senior Data Engineer ready to step into a leadership role? We’re looking for a Lead Data Engineer to join our client's team based in Leeds, working mostly remotely with just one day on-site per week.
You’ll lead the design and delivery of scalable, cloud-based data solutions using Databricks, Python, and SQL, while mentoring a team and driving engineering best practices.
About YouYou might currently be a Senior/Lead Data Engineer ready to grow your leadership skills. You’re passionate about building robust, efficient data pipelines and shaping cloud data architecture in an agile environment.
Key Responsibilities-
Lead development of data pipelines and solutions using Databricks, Python, and SQL
-
Design and maintain data models supporting analytics and business intelligence
-
Build and optimise ELT/ETL processes on AWS or Azure
-
Collaborate closely with analysts, architects, and stakeholders to deliver high-quality data products
-
Champion best practices in testing, CI/CD, version control, and infrastructure as code
-
Mentor and support your team, taking ownership of technical delivery and decisions
-
Drive continuous improvements in platform performance, cost, and reliability
-
Hands-on experience with Databricks or similar data engineering platforms
-
Strong Python and SQL skills in data engineering contexts
-
Expertise in data modelling and building analytics-ready datasets
-
Experience with AWS or Azure cloud data services
-
Proven leadership or mentorship experience
-
Excellent communication and stakeholder management
-
Agile delivery and DevOps tooling knowledge
-
Experience with infrastructure-as-code (Terraform, CloudFormation)
-
Familiarity with CI/CD pipelines and orchestration tools
-
Knowledge of data governance and quality controls
-
Experience in regulated or large-scale environments
Apply now to speak with VIQU IT in confidence, or reach out to Phoebe Rees via the VIQU IT website.
Do you know someone great? We’ll thank you with up to £1,000 if your referral is successful (terms apply).
For more exciting roles and opportunities like this, follow us on LinkedIn @VIQU IT Recruitment.
Data Engineering Manager
Posted 9 days ago
Job Viewed
Job Description
Role: Data Engineering Manager - Manchester, hybrid
The Team:
A highly passionate bunch, our data, analytics and AI team bring our unique software solutions to life. Our mission is to empower our customers and internal stakeholders to improve business performance and minimise risk by providing them with clean, reliable data and analytical models. We are with them to help protect their information, make informed decisions, deliver a personalised service and automate their workloads. Our engineers might be building data pipelines, modelling data, developing predictive models or automations for repeatable tasks or creation of data products.
The role:
Your role in the division is to lead the team developing our cloud data platform to further build-out our ‘single source of truth’ for company data. We have a recently implemented technology stack and clear direction of travel, so your initial objectives will be to understand our business data and team capabilities to then expand and improve our Kimball-model data warehouse in Azure, focusing on new datasets, pipeline resilience, performance and security. You will lead and coach the team in deploying tools and processes to ensure good practice is embedded, in line with our strategic themes of quality, efficiency, empowerment, transparency and governance. That means you will be conversant with data warehouse modelling, source control, CICD and Infrastructure as Code.
Our technology stack is based on Microsoft software: Azure, SQL Server and DevOps, using Terraform for infrastructure deployment. Our source data is also in Microsoft technology, currently on-premise in hosted data centres in the EU and US.
We currently manage our work in Kanban, with the support of a dedicated Delivery Lead, to respond to rapid growth in use-cases for our data.
Tasks & responsibilities include:
- Deliver good software development lifecycle processes are used for all our software artifacts, including use of source control, unit testing, CICD, IaC
- Deliver an enterprise data model considering all our current and likely future data sources
- Manage the improvement of our Kimball-style data warehouse in Azure
- Lead and coach a team of engineers to build and maintain the platform
- Partner with our delivery lead to manage the strategic roadmap and tactical workflow, ensuring that work items are delivered on time and with high quality
- Ability to communicate clearly with diverse teams, including across our geographic locations
- Ability to identify when a business need is unclear or ambiguous and ask the right questions
- Ability to translate a business need into a technical solution, considering scalability, security and resilience
- Relentless approach to continuous improvement of both processes and individuals
We think you’ll be a great fit if you have:
- Experience of team leadership, especially of hybrid on- and off-shore teams
- Experience of managing a team’s workload in collaboration with delivery, project or product professionals
- Experience of modelling and building an enterprise data warehouse to support analytical workloads
- Experience of using Azure services including Azure SQL Database, Data Factory, DevOps, Power BI
- Experience of good SDLC practices: source control (git), CI/CD, test and release processes
- Any experience using any of the following would also be a bonus in our environment: Dynamics CRM, Rabbit MQ, HubSpot, C# .NET development or legacy Microsoft data technologies (SSIS, SSRS)
We are looking for the right person who is a team player who can communicate effectively and is comfortable working within a diversified, multi-cultural and multi-functional team, both locally and remote, understanding the perspectives of each partner. Above all, someone with the passion to drive and succeed in their own career.
Experience in any of the above would help you to become productive in the job more quickly. We are genuinely committed to your success so, if you don’t quite meet all of our requirements yet, we encourage you to apply anyway and start a conversation.
Data Engineering Analyst
Posted today
Job Viewed
Job Description
Data Engineering Analyst
Duration: 6 Months (potential to extend)
Location: Leeds or Edinburgh (Hybrid – 2 days per week in-office)
About the Role:
We’re looking for an experienced Data Engineering Analyst to join our team on a 6-month contract. In this role, you'll be instrumental in shaping our data infrastructure, enabling seamless data flows, and delivering actionable insights through advanced analytics and visualization.
What You’ll Be Doing:
- Design, build, and maintain data pipelines using GCP technologies such as BigQuery, Cloud Storage, and Cloud Dataflow
- Develop insightful dashboards and reports in Power BI to support key business decisions
- Write efficient, scalable Python code for data transformation and analysis
- Collaborate across teams to gather requirements and deliver data solutions
- Troubleshoot and optimize existing data systems for performance and scalability
What We’re Looking For:
- Experience in data engineering, data analysis, or a related discipline
- Proven hands-on expertise with GCP services (BigQuery, Cloud Storage, Dataflow)
- Proficiency in Power BI for creating reports and dashboards
- Strong Python skills, including experience with data libraries like Pandas and NumPy
- Solid background in ETL processes, data pipeline design, and data warehousing
- Detail-oriented with excellent problem-solving and communication skills
Nice to Have:
- Knowledge of data governance, quality, and security best practices
- Experience working in Agile environments and using Git for version control
Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone’s chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.
Be The First To Know
About the latest Big data technologies Jobs in United Kingdom !
Data Engineering Lead
Posted 8 days ago
Job Viewed
Job Description
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
---
Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: , or please contact .
Please read our Candidate Privacy Policy ( .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Data Engineering Lead
Posted 8 days ago
Job Viewed
Job Description
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
---
Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: , or please contact .
Please read our Candidate Privacy Policy ( .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Data Engineering Consultant
Posted 12 days ago
Job Viewed
Job Description
Come join us
As a member of the Data Engineering team, you'll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade's Data & AI practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft Fabric and / or Azure Databricks technologies to deliver modern, highly scalable data platforms for all our client's analytics and AI needs. Our clients look to us for innovation, which means you'll have early access to the latest technologies so you can master them and stay ahead of the curve.
Together we do what matters.
What you'll do
* Design, development, and delivery of enterprise-grade analytics solutions based on Azure and Databricks technologies
* Evangelise and evolve best practices for our clients and our team including to mentor your colleagues, supporting their personal development
* Constantly developing technical skills in the latest Azure and Databricks technologies - achieving & maintaining relevant certifications
* Working directly with high profile clients across a variety of sectors to understand their requirements and present solutions to customer sponsors
Skills and experiences
* Demonstrable end-to-end experience in Data Engineering, including large-scale projects
* Experience in working with the latest Azure technologies, such as; Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen 2), Purview, Cosmos DB, Open AI, Azure ML, AI Foundary, Kubernetes,
* Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL
* Confident communicator who is able to explain technical terms to non-technical audiences and mentor junior colleagues
* Leads small development teams: track work, manage assignments, manage capacity, etc.
About you
Characteristics that can spell success for this role
* Analytical, curious, agile
* Team player and good communicator
* Problem-solver, patient, quality-driven
* Self-motivating
* Innovative mindset
Enjoy your career
Some of the best things about working at Avanade
* Opportunity to work for Microsoft's Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
* Real-time access to technical and skilled resources globally
* Collaborate with some of the brightest "Microsoft minds"
* Build your expertise, solve problems, learn, and develop
Find out more about some of our benefits here.
A great place to work
As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.
Create a future for our people that focuses on
- Expanding your thinking - Experimenting courageously - Learning and pivoting
Inspire greatness in our people by
- Empowering every voice - Encouraging boldness - Celebrating progress
Accelerate the impact of our people by
- Amazing the client - Prioritizing what matters - Acting as one
Learn more
To learn more about the types of projects our Data Engineering team works on check out these case studies:
* thyssenkrupp Materials Services uses data to help strike a delicate operational balance
* What matters to SSE Renewables is innovating for a sustainable future
Interested in knowing what's going on inside Avanade? Check out our blogs:
* Avanade Insights - exchange ideas that drive tomorrow's innovation
* Inside Avanade - explore what life is like working at Avanade
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.