68 Etl Processes jobs in London
Data Engineering Lead
London, London
RELX INC
Posted 10 days ago
Job Viewed
Job Description
Data Engineering Lead
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
---
Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: , or please contact .
Please read our Candidate Privacy Policy ( .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
Do you enjoy Team Management?
Are you a team player?
About Us
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society . Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice . At Elsevier, your work contributes to the world's grand challenges and a more sustainable future . We harness innovative technologies to support science and healthcare to partner for a better world.
The Team
The Enterprise Data Platforms and Services (EDPS) team are a central technology group responsible for building, administering, govern ing , and setting global standards for a growing number of Elsevier strategic data platforms and services . The capabilities we are responsible for enable data to be collected, accessed, processed and integrated across a wide range of digital business solutions , used by functions including billing and order management, customer and product master data management , and business analytics and insights delivery . Due to our footprint across the enterprise , we are relied upon to ensure our systems are trusted, reliable and available . The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Tableau, DBT, Talend, Collibra, Kafka/Confluent , Astronomer/Airflow , and Kubernetes .
This forms part of a longer-term strategic direction to implement Data Mesh, and with it establish shared platform s that enables a connected collection of enterprise-ready time saving services , applying a self-service first approach . Our mission is to enable frictionless experiences for all Elsevier c olleagues, so that they can openly and securely consume and produce trustworthy data, enhancing everyday colleague and customer interactions and decisions.
The Role
As the Software Engineering Lead , you will be responsible for nurturing a high performing cross- functional squad of software and data engineers . This squad is responsible for a growing number of strategic capabilities and components that serve a large number of engineering , d ata science, and analytics use cases and stakeholders . You will be expected to be the technical subject matter expert overseeing the squad building an Enterprise Data Platform that support s both operational and analytical use cases.
In practice, this will mean combining your technical expertise with strong stakeholder engagement to build a deep understanding of business needs when design ing a technical solution that is fit-for-purpose . To be successful, you need to understand user requirements and map diverse user interactions with the various platform components to inform your implementation decisions . Y ou will be expected to collaborate closely with other technology teams to ensure that we are driving a culture of contributing towards shared services .
Your success will be primarily measured by demonstrable increases in the number of teams adopting and contributing to the platform capabilities and shared repositories we provision, and clear improvements in technical efficiency /value gains .
Key Responsibilities and Accountabilities:
+ Accountable for team performance - manage a high performing agile delivery squad , ensuring you nurture team skills, trust , and relationships through coaching and mentoring .
+ Accountable for releases - set technical development and coding standards that make up a robust and mature SDLC, and review team release s to guarantee these are met.
+ Accountable for shared services - build common frameworks and patterns that can be easily reused, contributed to, and reliably deployed by other teams via self-service.
+ Accountable for best practices - establish component specific guidelines in collaboration with your team, wider engineering team s , architecture , end-users, data product owners, and enablement teams, to promote these through regular knowledge sharing sessions.
+ Accountable for operational efficiency - drive improvements in efficien cy , reliab ility , and scala bility supported by logging , monitoring and observability as a foundational capability.
+ Responsible for adoption - promote the platform capabilities through technical communities of practice leadership, high internal standards for documented processes and internal guides, an d take steps to capture and action user feedback.
+ Responsible for platform evolution - collaborate with key stakeholder groups to analyse and identify capability gaps, and drive discussions required to make a case for change .
+ Responsible for technical governance - establish and manage the technical design authority process for each capability to successfully govern self-service use of the platform .
Essential Skills & Experience :
+ Team leadership - driven line manager and technical lead, deeply interested in coaching and mentoring, to motivat e cross functional squads to deliver complex technical initiatives.
+ Software development lifecycle (SDLC) - applied understanding of SDLC best practices, having delivered improvements in previous teams' SDLC and DataOps /DevOps maturity.
+ Agile delivery - facilitat ing ceremonies , removing impediments, coordinat ing requirements refinement to ensure tasks are achievable , and driv ing a culture of iterative improvemen t.
+ Modern data stack - hands-on deploy ment and govern ance of enterprise technologies at scale (e.g. Snowflake, Tableau, DBT, Fivetran , Airflow, AWS , GitHub, Terraform, etc ) for self-service workloads .
+ Coding languages - deployable and reusable Python , Java S cript , and Jinja templating languages for ETL / ELT data applications , data pipelines , and stored procedures.
+ Thought leadership and influencing - deep interest in data platforms landscape to build well-articulated proposals that are supported by strong research, value delivery , and previous success in driving but also adopting change.
+ Solution design and architecture - apt at creating comprehensive technical design documents, including architecture and infrastructure artifacts, to support scalable, secure, and efficient data platforms , ensuring reliable data flow s from ingestion to consumption .
+ AWS cloud ecosystem - deep knowledge of AWS data and analytics services and the infrastructure required for production grade data solutions and applications .
+ Prioritisation - a daptable to changing needs within the organi s ation with a professional, flexible and pragmatic response to rapidly evolving priorities, while mitigat ing impacts.
+ Data and technology governance - knowledgeable in applying data management, data privacy and data security practices at scale to ensure platform use is compliant .
Work in a way that works for you
We promote a healthy work/life balance across the organisation. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and long-term goals.
+ Working remotely from home or in our office in a flexible hybrid style
+ Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive
Working with us
We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it.
Working for you
At Elsevier, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
+ Generous holiday allowance with the option to buy additional days
+ Access to learning platforms and encouragement to book up to 10 days focused learning/development time per year
+ Health screening, eye care vouchers and private medical benefits
+ Wellbeing programs
+ Life assurance
+ Access to a competitive contributory pension scheme
+ Long service awards
+ Save As You Earn share option scheme
+ Travel Season ticket loan
+ Maternity, paternity and shared parental leave
+ Access to emergency care for both the elderly and children
+ RELX Cares days, giving you time to support the charities and causes that matter to you
+ Access to employee resource groups with dedicated time to volunteer
+ Access to extensive learning and development resources
+ Access to employee discounts via Perks at Work
About the Business
A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
---
Elsevier is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: , or please contact .
Please read our Candidate Privacy Policy ( .
RELX is a global provider of information-based analytics and decision tools for professional and business customers, enabling them to make better decisions, get better results and be more productive.
Our purpose is to benefit society by developing products that help researchers advance scientific knowledge; doctors and nurses improve the lives of patients; lawyers promote the rule of law and achieve justice and fair results for their clients; businesses and governments prevent fraud; consumers access financial services and get fair prices on insurance; and customers learn about markets and complete transactions.
Our purpose guides our actions beyond the products that we develop. It defines us as a company. Every day across RELX our employees are inspired to undertake initiatives that make unique contributions to society and the communities in which we operate.
This advertiser has chosen not to accept applicants from your region.
0
Data Engineering Consultant
London, London
Avanade Inc.
Posted 14 days ago
Job Viewed
Job Description
Our talented Data Engineering team is made up of globally recognised experts - and there's room for more analytical, innovative, client-driven data professionals. If you're passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let's talk. Take your skills to a new level and launch a career where you can truly do what matters.
Come join us
As a member of the Data Engineering team, you'll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade's Data & AI practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft Fabric and / or Azure Databricks technologies to deliver modern, highly scalable data platforms for all our client's analytics and AI needs. Our clients look to us for innovation, which means you'll have early access to the latest technologies so you can master them and stay ahead of the curve.
Together we do what matters.
What you'll do
* Design, development, and delivery of enterprise-grade analytics solutions based on Azure and Databricks technologies
* Evangelise and evolve best practices for our clients and our team including to mentor your colleagues, supporting their personal development
* Constantly developing technical skills in the latest Azure and Databricks technologies - achieving & maintaining relevant certifications
* Working directly with high profile clients across a variety of sectors to understand their requirements and present solutions to customer sponsors
Skills and experiences
* Demonstrable end-to-end experience in Data Engineering, including large-scale projects
* Experience in working with the latest Azure technologies, such as; Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen 2), Purview, Cosmos DB, Open AI, Azure ML, AI Foundary, Kubernetes,
* Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL
* Confident communicator who is able to explain technical terms to non-technical audiences and mentor junior colleagues
* Leads small development teams: track work, manage assignments, manage capacity, etc.
About you
Characteristics that can spell success for this role
* Analytical, curious, agile
* Team player and good communicator
* Problem-solver, patient, quality-driven
* Self-motivating
* Innovative mindset
Enjoy your career
Some of the best things about working at Avanade
* Opportunity to work for Microsoft's Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
* Real-time access to technical and skilled resources globally
* Collaborate with some of the brightest "Microsoft minds"
* Build your expertise, solve problems, learn, and develop
Find out more about some of our benefits here.
A great place to work
As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.
Create a future for our people that focuses on
- Expanding your thinking - Experimenting courageously - Learning and pivoting
Inspire greatness in our people by
- Empowering every voice - Encouraging boldness - Celebrating progress
Accelerate the impact of our people by
- Amazing the client - Prioritizing what matters - Acting as one
Learn more
To learn more about the types of projects our Data Engineering team works on check out these case studies:
* thyssenkrupp Materials Services uses data to help strike a delicate operational balance
* What matters to SSE Renewables is innovating for a sustainable future
Interested in knowing what's going on inside Avanade? Check out our blogs:
* Avanade Insights - exchange ideas that drive tomorrow's innovation
* Inside Avanade - explore what life is like working at Avanade
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.
Come join us
As a member of the Data Engineering team, you'll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade's Data & AI practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft Fabric and / or Azure Databricks technologies to deliver modern, highly scalable data platforms for all our client's analytics and AI needs. Our clients look to us for innovation, which means you'll have early access to the latest technologies so you can master them and stay ahead of the curve.
Together we do what matters.
What you'll do
* Design, development, and delivery of enterprise-grade analytics solutions based on Azure and Databricks technologies
* Evangelise and evolve best practices for our clients and our team including to mentor your colleagues, supporting their personal development
* Constantly developing technical skills in the latest Azure and Databricks technologies - achieving & maintaining relevant certifications
* Working directly with high profile clients across a variety of sectors to understand their requirements and present solutions to customer sponsors
Skills and experiences
* Demonstrable end-to-end experience in Data Engineering, including large-scale projects
* Experience in working with the latest Azure technologies, such as; Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen 2), Purview, Cosmos DB, Open AI, Azure ML, AI Foundary, Kubernetes,
* Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL
* Confident communicator who is able to explain technical terms to non-technical audiences and mentor junior colleagues
* Leads small development teams: track work, manage assignments, manage capacity, etc.
About you
Characteristics that can spell success for this role
* Analytical, curious, agile
* Team player and good communicator
* Problem-solver, patient, quality-driven
* Self-motivating
* Innovative mindset
Enjoy your career
Some of the best things about working at Avanade
* Opportunity to work for Microsoft's Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
* Real-time access to technical and skilled resources globally
* Collaborate with some of the brightest "Microsoft minds"
* Build your expertise, solve problems, learn, and develop
Find out more about some of our benefits here.
A great place to work
As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.
Create a future for our people that focuses on
- Expanding your thinking - Experimenting courageously - Learning and pivoting
Inspire greatness in our people by
- Empowering every voice - Encouraging boldness - Celebrating progress
Accelerate the impact of our people by
- Amazing the client - Prioritizing what matters - Acting as one
Learn more
To learn more about the types of projects our Data Engineering team works on check out these case studies:
* thyssenkrupp Materials Services uses data to help strike a delicate operational balance
* What matters to SSE Renewables is innovating for a sustainable future
Interested in knowing what's going on inside Avanade? Check out our blogs:
* Avanade Insights - exchange ideas that drive tomorrow's innovation
* Inside Avanade - explore what life is like working at Avanade
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Avanade believes that all persons are entitled to equal employment opportunities, and we do not discriminate against our employees, applicants, or job seekers because of their race, color, gender, religion, national origin, disability, veteran status, age, marital status, sexual orientation, genetic information, gender identity, or any other protect group status as defined by law.
This advertiser has chosen not to accept applicants from your region.
1
Data Engineering Manager
London, London
£105000 - £123000 annum
Virgin
Posted 2 days ago
Job Viewed
Job Description
This is your chance to lead the charge in shaping the backbone of Virgin Red’s data capability. We’re looking for a passionate Data Engineering Manager to drive our technical vision, guide cross-functional teams, and power up the data platforms that keep our our loyalty products and systems ticking.
Our Virgin Family
Join the Virgin Group – a diverse collective driving change, enhancing customer experience, and having a blast. We're daring, disrupting industries from finance to space, united as part of the Virgin Family.
Virgin Red rewards customers who live the Virgin lifestyle. Earn Virgin Points across our vast partner network, unlocking everyday rewards and exclusive experiences. As the Virgin network hub, we foster deeper customer understanding, opening doors for partners. Bold, distinctive, customer-centric – that's Virgin Red.
We’re a huge brand, but not a huge team, which means we take a hands-on approach while thinking strategically. Everyone rolls up their sleeves to get things done, making it an exciting and collaborative place to work.
Tell me more
- Lead, grow and support a team of up to 15 engineers across multiple squads, blending strategic direction with hands-on guidance.
- Define and deliver a future-fit data engineering roadmap alongside our Principal Data Engineer.
- Drive quality and innovation across our data platform, warehouse and pipelines – ensuring scalability, security and sustainability.
- Keep engineering outcomes sharp and focused, balancing today’s delivery with tomorrow’s tech ambitions.
- Collaborate across Product, Commercial and Marketing teams, aligning data capabilities with business impact.
- Promote a culture of curiosity, inclusion and experimentation, with an eye on emerging AI opportunities.
What you’ll need
- Strong technical know-how, particularly in Python, SQL, modern data stacks (Snowflake, DBT, Spark, Airflow) and cloud platforms like AWS.
- Experience leading high-performing engineering teams with empathy and clarity.
- A knack for building scalable data solutions and making strategic tech decisions without losing sight of day-to-day pragmatism.
- Familiarity with CI/CD, DevOps, data governance and responsible AI practices.
- Strong data modelling skills – e.g. dimensional modelling
- Experience leveraging AI tooling to accelerate and automate tasks
- Experience with Data Mesh practices is a plus
- Confidence in setting direction, managing ambiguity, and bringing people with you – from engineers to execs.
- Curiosity and courage to explore the new, while delivering the now.
The extra details
Role type: Permanent
Location: London hub (approx. 1-2 days per week) & your home space
Salary: £105,000 - £123,000 plus bonus - We're putting our salaries out there for everyone to see - no smoke and mirrors, just honest numbers. We'll offer a salary that matches your skills, always aiming for room to grow.
Working hours: Full time - We embrace flexible working. Let us know what hours empower you to be at your best both professionally and personally, we’ll try to find a perfect match for you and us.
Benefits: Buckle up for an adventure with Virgin! Our benefits package isn't just a list - it's your ticket to an extraordinary career and life. Imagine unlimited leave for your globe-trotting dreams, a "Screw it, let's do it pot" to enjoy being you, and a learning budget to fuel your curiosity. We've got your back with top-notch health care, family support that goes the extra mile, and a pension plan to keep your future bright. From electric vehicles to flexible volunteering, we're not just offering a job - we're inviting you to join a community that celebrates your whole self.
Closing date: 17 September 2025
Some of the attributes that define a Virgin person just can’t be quantified in words. We pride ourselves on welcoming people from all walks of life, with all sorts of skill sets. Most recently, we successfully campaigned to add ‘Dyslexic Thinking’ as a skill on LinkedIn. We truly value passion for Purpose and Sustainability, welcoming creative thinkers and innovators. Any uniqueness is a strength and will be considered an asset to our workforce. If there is something you would like us to consider, to tailor the hiring process to the way you work best, please don’t hesitate to let us know.
Ready to turn your career into the ultimate adventure? Virgin's got the map, the compass, and the crew. Your great adventure awaits!
This advertiser has chosen not to accept applicants from your region.
2
Principal, Data Engineering (Remote)
City of London, London
Jazz Pharmaceuticals
Posted today
Job Viewed
Job Description
If you are a current Jazz employee please apply via the Internal Career site. Jazz Pharmaceuticals is a global biopharma company whose purpose is to innovate to transform the lives of patients and their families. We are dedicated to developing life-changing medicines for people with serious diseases — often with limited or no therapeutic options. We have a diverse portfolio of marketed medicines, including leading therapies for sleep disorders and epilepsy, and a growing portfolio of cancer treatments. Our patient-focused and science-driven approach powers pioneering research and development advancements across our robust pipeline of innovative therapeutics in oncology and neuroscience. Jazz is headquartered in Dublin, Ireland with research and development laboratories, manufacturing facilities and employees in multiple countries committed to serving patients worldwide. Please visit for more information. The Principal will be responsible for supporting complex or leading singular projects related to data engineering requirements and initiatives across Jazz Research and Development. The Principal will support data projects from across the business including Clinical, Pre-Clinical, Non-Clinical, Chemistry, RWD and Omics. Essential Functions Support the design, development and maintenance of data pipelines for processing Research and Development data from diverse sources (Clinical Trials, Medical Devices, Pre-Clinical, Omics, Real World Data) utilizing the AWS technology platform. Create and optimize ETL/ELT processes for structured and unstructured data using Python, R, SQL, AWS services and other tools. Build and maintain data repositories using AWS S3 and FSx technologies. Establish data warehousing solutions using Amazon Redshift. Build and maintain standard data models. Develop data quality frameworks, validation processes and KPIs to ensure accuracy and consistency of data pipelines. Implement data versioning and lineage tracking to support data traceability, regulatory compliance and audit requirements. Create and maintain documentation for data processes, architectures, and workflows. Implement modern software development best practices (e.g. Code Versioning, DevOps, CD/CI). Support collaboration with RnD Researchers, Data scientists and Stakeholders to understand data requirements and deliver appropriate solutions in a global working model. Maintain compliance with data privacy regulations such as HIPAA, GDPR May be required to develop, deliver or support data literacy training across R&D. Required Knowledge, Skills and Abilities Strong knowledge of data engineering tools such as Python, R and SQL for data processing. Strong proficiency with AWS services particularly S3, Redshift, FSx, Glue, Lambda. Strong proficiency with relational databases. Strong background in data modeling and database design. Familiarity with unstructured database technologies (e.g. NoSQL) and other database types (e.g. Graph). Familiarity with Containerization such as Docker and EKS/Kubernetes. Familiarity with one or more RnD research process and associated regulatory requirements. Exposure to healthcare data standards (CDISC, HL7, FHIR, SNOMED CT, OMOP, DICOM). Exposure to big data technologies and handling. Knowledge of machine learning operations (MLOps) and model deployment. Strong problem-solving and analytical abilities. Excellent communication skills for collaborating with stakeholders. Experience working in an Agile development environment. Required/Preferred Education Bachelor’s Degree in Computer Science, Statistics, Mathematics, Life Sciences, or other relevant scientific fields; Master’s Degree preferred 3-5 years of experience in data engineering, with at least 1.5 years focusing on healthcare, research or clinical related data Description of Physical Demands Occasional mobility within office environment Routinely sitting for extended periods of time Constantly operating a computer, printer, telephone and other similar office machinery Jazz Pharmaceuticals is an equal opportunity/affirmative action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any characteristic protected by law. The successful candidate will also be eligible to participate in various benefits offerings, including, but not limited to, medical, dental and vision insurance, retirement savings plan, and flexible paid vacation. For more information on our Benefits offerings please click here: .
This advertiser has chosen not to accept applicants from your region.
3
Principal Data Engineering Consultant
London, London
Fynity
Posted today
Job Viewed
Job Description
Principal Data Engineering Consultant
Principal Data Engineering Consultant required to join the high-performing, busy Data & Insights practice of a boutique consultancy.
This is a superb opportunity to lead and apply your data engineering skills across a variety of client projects.
Day-to-Day
As a Principal Data Engineering Consultant, you will utilise your functional and hands-on technical data engineering skills to implement end-to-end reporting, analytics and data solutions for a variety of different customers, from large enterprises to small start-ups.
You will lead exciting and complex projects that vary in size and complexity, and you will take ownership of deliveries; gathering requirements, understanding business problems, designing and building solutions, reporting and analysis through to go-live and training.
This role will provide you with plenty of opportunities to flex your data skills to help harness solutions and solve problems, and you will get to see the fruits of your labour and the impact the deliveries have on the client.
You will be responsible for:
- Engaging with customer stakeholders and building strong relationships
- Building and implementing technical data solutions for customers using a variety of different data tools and platforms
- Consulting with clients on the best approach and most suitable data technologies
- Technical project leadership, requirements gathering, delivery and documentation
- Using your hands-on technical skills to write code and build solutions
- Managing and mentoring junior consultants on deliveries
You will need
You will be a Technical Data Consultant or Data Engineer who has a track record of leading the design and delivery of data solutions.
You will bring a strong blend of technical and functional experience and will have previously operated within a client-facing environment.
You will be able to evidence where you have led the delivery of data solutions, managing projects and mentoring or overseeing the work of more junior colleagues.
You will need to possess a hands-on technical skillset spanning data engineering, data integration and data migration. You will be adaptable and able to work with different tools and technologies, depending on the client and project needs but will ideally possess stength in:
- MS Fabric stack
- Databricks
- Azure
- SQL
- Tableau / Power BI
A knowledge of data modelling and of general IT architecture and systems integration is also required. Other technologies such as Azure Data Factory, RedShift, Informatica, Qlik or similar are also useful, and you will be open-minded to learning new skills. Experience in Oracle OBIEE and/or Oracle Analytics Cloud is also desirable but not essential.
Excellent communication skills and the ability to engage and manage client stakeholders is also required.
What is on offer?
A competitive salary of £70,000-£5,000 is on offer (depending on your level of experience) as well as an annual bonus of k- k (paid quarterly), private medical, pension (up to 5% matched) and other perks such as a mobile phone allowance.
This is a hybrid role that offers lots of flexibility to work remotely, but visits to the office in Surrey are required roughly once a week (some weeks less, some weeks more, with possible visits to client sites if requested)
This consultancy has big ambitions to grow, so if you are a Principal Data Engineering Consultant and want to work alongside some of the industry’s best on some exciting client projects, then this could be the challenge you are seeking!
This advertiser has chosen not to accept applicants from your region.
4
Data Engineering Manager, Analytics
London, London
Meta
Posted 21 days ago
Job Viewed
Job Description
**Summary:**
Do you want to use data to help drive the direction of products that impact the lives of over 1 billion people every day? If yes, we want to talk to you. We're looking for a leader in our Data Engineering team to work closely with Product Managers, Data Scientists and Software Engineers to support product launches and roadmaps by building the data architecture that informs and drives insight. In this role, you'll see a direct link between your work, company growth, and user satisfaction. You'll work with some of the brightest minds in the industry, work with one of the richest data sets in the world, use cutting edge technology, and see your efforts affect products and people on a regular basis.
**Required Skills:**
Data Engineering Manager, Analytics Responsibilities:
1. Proactively drive the vision for BI and Data Warehousing across a product vertical, and define and execute on a plan to achieve that vision.
2. Define the processes needed to achieve operational excellence in all areas, including project management and system reliability.
3. Build a high-quality BI and Data Warehousing team and design the team to scale.
4. Build cross-functional relationships with Data Scientists, Product Managers and Software Engineers to understand data needs and deliver on those needs.
5. Manage data warehouse plans across a product vertical.
6. Drive the design, building, and launching of new data models and data pipelines in production.
7. Drive data quality across the product vertical and related business areas.
8. Manage the delivery of high impact dashboards and data visualizations.
9. Define and manage SLA's for all data sets and processes running in production.
**Minimum Qualifications:**
Minimum Qualifications:
10. 8+ years of experience in BI and Data Warehousing.
11. Experience scaling and managing 3+ person teams.
12. Communication and leadership experience, with experience initiating and driving projects.
13. Project management experience.
14. Data architecture experience.
15. Experience in SQL or similar languages.
16. Development experience in at least one object-oriented language (Python, Java, etc.).
17. BA/BS in Computer Science, Math, Physics, or other technical fields.
**Preferred Qualifications:**
Preferred Qualifications:
18. Experience in a consumer web or mobile company.
19. Experience with data sets, Hadoop, and data visualization tools.
20. Advanced degree
**Industry:** Internet
Do you want to use data to help drive the direction of products that impact the lives of over 1 billion people every day? If yes, we want to talk to you. We're looking for a leader in our Data Engineering team to work closely with Product Managers, Data Scientists and Software Engineers to support product launches and roadmaps by building the data architecture that informs and drives insight. In this role, you'll see a direct link between your work, company growth, and user satisfaction. You'll work with some of the brightest minds in the industry, work with one of the richest data sets in the world, use cutting edge technology, and see your efforts affect products and people on a regular basis.
**Required Skills:**
Data Engineering Manager, Analytics Responsibilities:
1. Proactively drive the vision for BI and Data Warehousing across a product vertical, and define and execute on a plan to achieve that vision.
2. Define the processes needed to achieve operational excellence in all areas, including project management and system reliability.
3. Build a high-quality BI and Data Warehousing team and design the team to scale.
4. Build cross-functional relationships with Data Scientists, Product Managers and Software Engineers to understand data needs and deliver on those needs.
5. Manage data warehouse plans across a product vertical.
6. Drive the design, building, and launching of new data models and data pipelines in production.
7. Drive data quality across the product vertical and related business areas.
8. Manage the delivery of high impact dashboards and data visualizations.
9. Define and manage SLA's for all data sets and processes running in production.
**Minimum Qualifications:**
Minimum Qualifications:
10. 8+ years of experience in BI and Data Warehousing.
11. Experience scaling and managing 3+ person teams.
12. Communication and leadership experience, with experience initiating and driving projects.
13. Project management experience.
14. Data architecture experience.
15. Experience in SQL or similar languages.
16. Development experience in at least one object-oriented language (Python, Java, etc.).
17. BA/BS in Computer Science, Math, Physics, or other technical fields.
**Preferred Qualifications:**
Preferred Qualifications:
18. Experience in a consumer web or mobile company.
19. Experience with data sets, Hadoop, and data visualization tools.
20. Advanced degree
**Industry:** Internet
This advertiser has chosen not to accept applicants from your region.
5
Principal Data Engineering Consultant
London, London
Fynity
Posted today
Job Viewed
Job Description
Principal Data Engineering Consultant Principal Data Engineering Consultant required to join the high-performing, busy Data & Insights practice of a boutique consultancy. This is a superb opportunity to lead and apply your data engineering skills across a variety of client projects. Day-to-Day As a Principal Data Engineering Consultant, you will utilise your functional and hands-on technical data engineering skills to implement end-to-end reporting, analytics and data solutions for a variety of different customers, from large enterprises to small start-ups. You will lead exciting and complex projects that vary in size and complexity, and you will take ownership of deliveries; gathering requirements, understanding business problems, designing and building solutions, reporting and analysis through to go-live and training. This role will provide you with plenty of opportunities to flex your data skills to help harness solutions and solve problems, and you will get to see the fruits of your labour and the impact the deliveries have on the client. You will be responsible for: Engaging with customer stakeholders and building strong relationships Building and implementing technical data solutions for customers using a variety of different data tools and platforms Consulting with clients on the best approach and most suitable data technologies Technical project leadership, requirements gathering, delivery and documentation Using your hands-on technical skills to write code and build solutions Managing and mentoring junior consultants on deliveries You will need You will be a Technical Data Consultant or Data Engineer who has a track record of leading the design and delivery of data solutions. You will bring a strong blend of technical and functional experience and will have previously operated within a client-facing environment. You will be able to evidence where you have led the delivery of data solutions, managing projects and mentoring or overseeing the work of more junior colleagues. You will need to possess a hands-on technical skillset spanning data engineering, data integration and data migration. You will be adaptable and able to work with different tools and technologies, depending on the client and project needs but will ideally possess stength in: MS Fabric stack Databricks Azure SQL Tableau / Power BI A knowledge of data modelling and of general IT architecture and systems integration is also required. Other technologies such as Azure Data Factory, RedShift, Informatica, Qlik or similar are also useful, and you will be open-minded to learning new skills. Experience in Oracle OBIEE and/or Oracle Analytics Cloud is also desirable but not essential. Excellent communication skills and the ability to engage and manage client stakeholders is also required. What is on offer? A competitive salary of £70,000-£5,000 is on offer (depending on your level of experience) as well as an annual bonus of k- k (paid quarterly), private medical, pension (up to 5% matched) and other perks such as a mobile phone allowance. This is a hybrid role that offers lots of flexibility to work remotely, but visits to the office in Surrey are required roughly once a week (some weeks less, some weeks more, with possible visits to client sites if requested) This consultancy has big ambitions to grow, so if you are a Principal Data Engineering Consultant and want to work alongside some of the industry’s best on some exciting client projects, then this could be the challenge you are seeking!
This advertiser has chosen not to accept applicants from your region.
Be The First To Know
About the latest Etl processes Jobs in London !
6
Principal Data Engineering Consultant
London, London
Fynity
Posted today
Job Viewed
Job Description
Principal Data Engineering Consultant Principal Data Engineering Consultant required to join the high-performing, busy Data & Insights practice of a boutique consultancy. This is a superb opportunity to lead and apply your data engineering skills across a variety of client projects. Day-to-Day As a Principal Data Engineering Consultant, you will utilise your functional and hands-on technical data engineering skills to implement end-to-end reporting, analytics and data solutions for a variety of different customers, from large enterprises to small start-ups. You will lead exciting and complex projects that vary in size and complexity, and you will take ownership of deliveries; gathering requirements, understanding business problems, designing and building solutions, reporting and analysis through to go-live and training. This role will provide you with plenty of opportunities to flex your data skills to help harness solutions and solve problems, and you will get to see the fruits of your labour and the impact the deliveries have on the client. You will be responsible for: Engaging with customer stakeholders and building strong relationships Building and implementing technical data solutions for customers using a variety of different data tools and platforms Consulting with clients on the best approach and most suitable data technologies Technical project leadership, requirements gathering, delivery and documentation Using your hands-on technical skills to write code and build solutions Managing and mentoring junior consultants on deliveries You will need You will be a Technical Data Consultant or Data Engineer who has a track record of leading the design and delivery of data solutions. You will bring a strong blend of technical and functional experience and will have previously operated within a client-facing environment. You will be able to evidence where you have led the delivery of data solutions, managing projects and mentoring or overseeing the work of more junior colleagues. You will need to possess a hands-on technical skillset spanning data engineering, data integration and data migration. You will be adaptable and able to work with different tools and technologies, depending on the client and project needs but will ideally possess stength in: MS Fabric stack Databricks Azure SQL Tableau / Power BI A knowledge of data modelling and of general IT architecture and systems integration is also required. Other technologies such as Azure Data Factory, RedShift, Informatica, Qlik or similar are also useful, and you will be open-minded to learning new skills. Experience in Oracle OBIEE and/or Oracle Analytics Cloud is also desirable but not essential. Excellent communication skills and the ability to engage and manage client stakeholders is also required. What is on offer? A competitive salary of £70,000-£5,000 is on offer (depending on your level of experience) as well as an annual bonus of k- k (paid quarterly), private medical, pension (up to 5% matched) and other perks such as a mobile phone allowance. This is a hybrid role that offers lots of flexibility to work remotely, but visits to the office in Surrey are required roughly once a week (some weeks less, some weeks more, with possible visits to client sites if requested) This consultancy has big ambitions to grow, so if you are a Principal Data Engineering Consultant and want to work alongside some of the industry’s best on some exciting client projects, then this could be the challenge you are seeking!
This advertiser has chosen not to accept applicants from your region.
7
Staff Engineer - Data Engineering
London, London
Claremont Consulting
Posted today
Job Viewed
Job Description
Overview
Staff Engineer (Data Engineering) – A leading tech and data company is looking for a Staff Engineer within their Data Engineering function to provide architectural expertise and guidance on overall solutions to be delivered. You will be working on operational excellence and supporting the extensive data platform and the bespoke streaming platform. This is a permanent role based in central London with a hybrid working model.nResponsibilities
The data engineering team manages and works on multiple streams and projects that have a high impact and importance for the business.nThis role sits within the Core Data Platform (CDP) team, which is split into two teams: the Platform team that focuses on operational excellence and supporting the extensive data platform, and the Streaming team that supports the bespoke streaming platform.nAs a Staff Engineer, you will assume a key position providing architectural expertise and guidance to enable the vision of the overall solution to be delivered.nYou will use your knowledge of the architectural configuration of your product area to influence decisions about tools and technologies that will enhance the service offering.nThis is a technical role; your enthusiasm for exploring new technology and tools will be valued along with your desire to guide others.nYou will have a deep understanding of the services in your area of the business and how you contribute to customer success and positive commercial outcomes.nYou will ensure we maintain our standards of engineering excellence within your area and contribute to company-wide standards, processes, and tools.nExperience / Qualifications
Strong experience in Data Engineering.nCreates alignment across teams in their domain, ensuring that best practices and architectural decisions are well understood within the domain.nCapable of setting short- to medium-term strategies for services and products, creating designs and roadmaps to communicate and plan changes over time in a domain’s estate; able to align key stakeholders with these strategies.nProvides direction, advice, and guidance on approaches to delivering services and products.nCollaborates with and guides other engineers in assessing and evaluating new technologies within the domain.nReduces complexity within software, processes, and tools.nAdvocate of engineering excellence within the domain; contributes to engineering standards, processes, and tools across the organization.nContributes to the assessment and adoption of standards, processes, and tools across the organization.nProvides technical input into planning and business case definitions.nTakes a risk-based approach to decision making and guides other engineers to do the same; ensures risk controls are considered when delivering software.nUnderstands the regulatory framework in which the company operates and how it applies to their role and other engineering roles.nExperience with streaming technologies like Kafka is advantageous.
#J-18808-Ljbffrn
Staff Engineer (Data Engineering) – A leading tech and data company is looking for a Staff Engineer within their Data Engineering function to provide architectural expertise and guidance on overall solutions to be delivered. You will be working on operational excellence and supporting the extensive data platform and the bespoke streaming platform. This is a permanent role based in central London with a hybrid working model.nResponsibilities
The data engineering team manages and works on multiple streams and projects that have a high impact and importance for the business.nThis role sits within the Core Data Platform (CDP) team, which is split into two teams: the Platform team that focuses on operational excellence and supporting the extensive data platform, and the Streaming team that supports the bespoke streaming platform.nAs a Staff Engineer, you will assume a key position providing architectural expertise and guidance to enable the vision of the overall solution to be delivered.nYou will use your knowledge of the architectural configuration of your product area to influence decisions about tools and technologies that will enhance the service offering.nThis is a technical role; your enthusiasm for exploring new technology and tools will be valued along with your desire to guide others.nYou will have a deep understanding of the services in your area of the business and how you contribute to customer success and positive commercial outcomes.nYou will ensure we maintain our standards of engineering excellence within your area and contribute to company-wide standards, processes, and tools.nExperience / Qualifications
Strong experience in Data Engineering.nCreates alignment across teams in their domain, ensuring that best practices and architectural decisions are well understood within the domain.nCapable of setting short- to medium-term strategies for services and products, creating designs and roadmaps to communicate and plan changes over time in a domain’s estate; able to align key stakeholders with these strategies.nProvides direction, advice, and guidance on approaches to delivering services and products.nCollaborates with and guides other engineers in assessing and evaluating new technologies within the domain.nReduces complexity within software, processes, and tools.nAdvocate of engineering excellence within the domain; contributes to engineering standards, processes, and tools across the organization.nContributes to the assessment and adoption of standards, processes, and tools across the organization.nProvides technical input into planning and business case definitions.nTakes a risk-based approach to decision making and guides other engineers to do the same; ensures risk controls are considered when delivering software.nUnderstands the regulatory framework in which the company operates and how it applies to their role and other engineering roles.nExperience with streaming technologies like Kafka is advantageous.
#J-18808-Ljbffrn
This advertiser has chosen not to accept applicants from your region.
8