17 Cloud Data jobs in the United Kingdom
Business Analyst – Media, Cloud & Data Integrations
Posted 1 day ago
Job Viewed
Job Description
About the company
Banijay Entertainment is the largest independent content producer and distributor, home to over 130 production companies across 20+ territories, with a multi-genre catalogue boasting over 200,000 hours of original programming.
Banijay Entertainment is a collective of creative entrepreneurs. The group represents some of the biggest global brands including Survivor, Big Brother, Peaky Blinders, Temptation Island, MasterChef, Wallander, Rogue Heroes, Mr Bean, The Wall, Hunted, and Black Mirror among others. By imagining and delivering high-quality multi-genre IP that was born locally and travels globally, the business offers the best stories told the best way.
Banijay Entertainment is built on independence, creative freedom, entrepreneurialism, and commercial acumen.
As the largest independent content producer and distributor in the world, Banijay Entertainment is at the forefront of innovation in media, delivering world-class storytelling to audiences everywhere.
Join us as we redefine the future of content creation and distribution through cutting-edge technology.
About this role
We are seeking a Business Analyst to support a global transformation programme, focused on delivering new integrations across rights management, media workflows, cloud, and data platforms.
The role will work closely with the Programme Director, technology teams, and operating companies (OpCos) to capture requirements, align stakeholders, and ensure integration solutions meet business and technical needs.
The ideal candidate will bring experience in media/entertainment environments, combined with strong knowledge of cloud platforms (AWS/GCP), data integration/analytics, and system-to-system workflows.
Key Responsibilities
- Gather, analyse, and document business and technical requirements for new system integrations.
- Work with stakeholders to define integration points between rights management tools, MAM systems, data platforms, and finance systems.
- Translate business needs into integration use cases, data mapping, and interface specifications.
- Document end-to-end process flows, service journeys, and hand-offs across business and technology teams.
- Act as a bridge between business, technical, and vendor teams, ensuring requirements are clearly understood and implemented.
- Work with architects and engineers to validate integration approaches against business needs and enterprise standards.
- Support review of supplier solution designs by validating business requirements, dependencies, and integration impacts across multi-vendor and supplier technology stacks.
- Capture and validate requirements for data flows, APIs, and reporting outputs.
- Align integration designs with cloud services (AWS/GCP), security, and monitoring standards.
- Identify gaps and opportunities in existing workflows and recommend improvements.
- Maintain structured documentation to support ongoing operations and knowledge sharing.
Essential Experience & Skills
- Proven experience as a Business Analyst on system or data integration projects.
- Media/entertainment industry experience, with exposure to rights management, content workflows, or AdTech/MediaTech platforms desirable.
- Strong knowledge of data integration, APIs, analytics, and/or cloud platforms (AWS/GCP).
- Ability to produce interface specifications, data mappings, and process flows.
- Experience working with multiple vendors and suppliers.
- Excellent stakeholder management and communication skills, with the ability to work across Group and OpCo landscapes.
- Strong analytical and problem-solving skills with a structured approach to documentation.
Reporting to
Programme Director.
Contract Type
Permanent, full-time.
Hours
Monday-Friday – 9:30am - 6pm.
Hybrid working (3 days per week in the office).
If you apply for this role, your personal information will be used by Banijay for recruitment purposes and in accordance with our Recruitment Privacy Policy
We are an inclusive and disability confident employer. We actively encourage applications from individuals from diverse and under-represented backgrounds and are committed to providing a creative and inspirational home for all people. To make sure we are inclusive and accessible to all, please let us know if you require any reasonable adjustments or assistance either to help you with your application or whilst working with us.
Cloud Data Analytics Platform Engineer - VP
Posted 17 days ago
Job Viewed
Job Description
**What You'll Do:**
+ **Architect and Build:** Design and implement a robust, cloud-native data analytics platform spanning AWS, GCP, and other emerging cloud environments. You'll leverage services like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. **(Required)**
+ **Data Lake , Data Zone, Data Governance:** Design, build, and manage data lakes and data zones within our cloud environment, ensuring data quality, discoverability, and accessibility for various downstream consumers. Implement and maintain enterprise-grade data governance capabilities, integrating with data catalogs and lineage tracking tools to ensure data quality, security, and compliance. **(Required)**
+ **Infrastructure as Code (IaC):** Champion IaC using Terraform, and preferably other tools like Harness, Tekton, or Lightspeed, developing modular patterns and establishing CI/CD pipelines to automate infrastructure management and ensure consistency across our environments. **(Required, with expanded toolset)**
+ **Collaboration and Best Practices:** Work closely with data engineering, information security, and platform teams to define and enforce best practices for data infrastructure, fostering a culture of collaboration and knowledge sharing. **(Required)**
+ **Kubernetes and Orchestration:** Manage and optimize Kubernetes clusters, specifically for running critical data processing workloads using Spark and Airflow. **(Required)**
+ **Cloud Security:** Implement and maintain robust security measures, including cloud networking, IAM, encryption, data isolation, and secure service communication (VPC peering, PrivateLink, PSC/PSA). **(Required) .** Your knowledge of compliance frameworks relevant to cloud data will be invaluable in maintaining a secure and compliant data environment. **(Optional)**
+ **Snowflake and Databricks (Optional, but highly desired):** Leverage your experience with Snowflake and Databricks to enhance our data platform's capabilities and performance. While not mandatory, experience with these technologies is a significant advantage.
+ **Event-Driven Architectures , FinOps and Cost Optimization (Optional):** Contribute to the development of event-driven data pipelines using Kafka and schema registries, enabling real-time data insights and responsiveness. Apply FinOps principles and multi-cloud cost optimization techniques to ensure efficient resource utilization and cost control.
**What You'll Bring:**
+ **Hands-on Engineering Expertise:** You're a builder who enjoys diving into the technical details and getting your hands dirty. You thrive in a fast-paced environment and are eager to make a direct impact.
+ **Experience : 8** - **13** years of relevant experience in Data Engineering & Infrastructure Automation
+ **Cloud Expertise:** Proven hands-on experience with AWS and/or GCP, including a deep understanding of their data analytics service offerings.
+ **Data Lake/Zone/Governance Experience:** Demonstrable experience designing, building, and managing data lakes and data zones. Familiarity with data governance tools and frameworks.
+ **IaC Proficiency:** Solid experience with Terraform and preferably Harness, Tekton, or Lightspeed for CI/CD pipeline management.
+ **Kubernetes Mastery:** Strong command of Kubernetes, especially in the context of data processing workloads.
+ **Security Focus:** A firm grasp of cloud security principles and best practices.
+ **Financial Services Experience:** Experience working in financial services, banking, or on data-related cloud transformation projects within the financial industry. (Highly Desired)
**We offer:**
By joining Citi London, you will not only be part of a business casual workplace with a hybrid working model (up to 2 days working at home per week), but also receive a competitive base salary (which is annually reviewed), and enjoy a whole host of additional benefits such as:
+ 27 days annual leave (plus bank holidays)
+ A discretional annual performance related bonus
+ Private Medical Care & Life Insurance
+ Employee Assistance Program
+ Pension Plan
+ Paid Parental Leave
+ Special discounts for employees, family, and friends
+ Access to an array of learning and development resources
Visit our Global Benefits page to learn more. ( these benefits Citi is committed to ensuring our workplace is where everyone feels comfortable coming to work as their whole self, every day. We want the best talent around the world to be energized to join us, motivated to stay and empowered to thrive.
#LI-MK2
---
**Job Family Group:**
Technology
---
**Job Family:**
Systems & Engineering
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Business Analyst - Media, Cloud & Data Integrations
Posted today
Job Viewed
Job Description
About the company
Banijay Entertainment is the largest independent content producer and distributor, home to over 130 production companies across 20+ territories, with a multi-genre catalogue boasting over 200,000 hours of original programming.
Banijay Entertainment is a collective of creative entrepreneurs. The group represents some of the biggest global brands including Survivor, Big Brother, Peaky Blinders, Temptation Island, MasterChef, Wallander, Rogue Heroes, Mr Bean, The Wall, Hunted, and Black Mirror among others. By imagining and delivering high-quality multi-genre IP that was born locally and travels globally, the business offers the best stories told the best way.
Banijay Entertainment is built on independence, creative freedom, entrepreneurialism, and commercial acumen.
As the largest independent content producer and distributor in the world, Banijay Entertainment is at the forefront of innovation in media, delivering world-class storytelling to audiences everywhere.
Join us as we redefine the future of content creation and distribution through cutting-edge technology.
About this role
We are seeking a Business Analyst to support a global transformation programme, focused on delivering new integrations across rights management, media workflows, cloud, and data platforms.
The role will work closely with the Programme Director, technology teams, and operating companies (OpCos) to capture requirements, align stakeholders, and ensure integration solutions meet business and technical needs.
The ideal candidate will bring experience in media/entertainment environments, combined with strong knowledge of cloud platforms (AWS/GCP), data integration/analytics, and system-to-system workflows.
Key Responsibilities
- Gather, analyse, and document business and technical requirements for new system integrations.
- Work with stakeholders to define integration points between rights management tools, MAM systems, data platforms, and finance systems.
- Translate business needs into integration use cases, data mapping, and interface specifications.
- Document end-to-end process flows, service journeys, and hand-offs across business and technology teams.
- Act as a bridge between business, technical, and vendor teams, ensuring requirements are clearly understood and implemented.
- Work with architects and engineers to validate integration approaches against business needs and enterprise standards.
- Support review of supplier solution designs by validating business requirements, dependencies, and integration impacts across multi-vendor and supplier technology stacks.
- Capture and validate requirements for data flows, APIs, and reporting outputs.
- Align integration designs with cloud services (AWS/GCP), security, and monitoring standards.
- Identify gaps and opportunities in existing workflows and recommend improvements.
- Maintain structured documentation to support ongoing operations and knowledge sharing.
Essential Experience & Skills
- Proven experience as a Business Analyst on system or data integration projects.
- Media/entertainment industry experience, with exposure to rights management, content workflows, or AdTech/MediaTech platforms desirable.
- Strong knowledge of data integration, APIs, analytics, and/or cloud platforms (AWS/GCP).
- Ability to produce interface specifications, data mappings, and process flows.
- Experience working with multiple vendors and suppliers.
- Excellent stakeholder management and communication skills, with the ability to work across Group and OpCo landscapes.
- Strong analytical and problem-solving skills with a structured approach to documentation.
Reporting to
Programme Director.
Contract Type
Permanent, full-time.
Hours
Monday-Friday – 9:30am - 6pm.
Hybrid working (3 days per week in the office).
If you apply for this role, your personal information will be used by Banijay for recruitment purposes and in accordance with our Recruitment Privacy Policy -notice/
We are an inclusive and disability confident employer. We actively encourage applications from individuals from diverse and under-represented backgrounds and are committed to providing a creative and inspirational home for all people. To make sure we are inclusive and accessible to all, please let us know if you require any reasonable adjustments or assistance either to help you with your application or whilst working with us.
Lead Software Engineer - Python, Cloud, Data, AIML
Posted 1 day ago
Job Viewed
Job Description
We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. Join JPMorgan Chase as a Lead Software Engineer within the Corporate Investment Bank, Markets Research Technology Team. Design and deliver trusted market-leading technology products in a secure, stable, and scalable way. Work on cutting-edge projects, including LLM and GenerativeAI solutions, and help industrialize AI/ML models at production scale.
As a Lead Software Engineer at JPMorgan Chase within the Corporate Investment Bank, Markets Research Technology Team, you will play a crucial role in an agile team, focusing on the design and delivery of secure, stable, and scalable market-leading technology products. Your responsibilities will encompass implementing essential technology solutions across various technical domains to support the firm's business goals. You will participate in innovative projects, including LLM and GenerativeAI solutions, and aid in the industrialization of AI/ML models at a production scale. This position is a hands-on team member contributor engineering role.
Job responsibilities
- Regularly provides technical guidance and direction to support the business and its technical teams, contractors, and vendors
- Develops secure and high-quality production code, and reviews and debugs code written by others
- Drives decisions that influence the product design, application functionality, and technical operations and processes
- Serves as a function-wide subject matter expert in one or more areas of focus
- Actively contributes to the engineering community as an advocate of firmwide frameworks, tools, and practices of the Software Development Life Cycle
- Influences peers and project decision-makers to consider the use and application of leading-edge technologies
- Adds to the team culture of diversity, opportunity, inclusion, and respect
- Designs and implements hands-on solutions while providing technical leadership and mentorship to more junior team members
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and proficient advanced experience
- Hands-on practical experience delivering system design, application development, testing, and operational stability
- Advanced in Python software engineering
- Advanced knowledge of software applications and technical processes with considerable in-depth knowledge in one or more technical disciplines (e.g., Data engineering, ML engineering, Cloud)
- Ability to tackle design and functionality problems independently with little to no oversight
- Practical cloud native experience
- Practical experience with Kubernetes, EKS, Docker, Terraform, MLOps
Preferred qualifications, capabilities, and skills
- Experience developing large-scale Cloud-native data/AI/ML engineering solutions in large corporate environments
- Prior experience collaborating with data scientists, productionizing POCs to industrial scalable solutions
- AWS clod native experience
- Experience with data science/ML modelling
- Familiarity with modern LLM technologies, Vector databases (e.g., OpenSearch), and Knowledge Graph
About Us
J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
About The Team
J.P. Morgan's Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.
Senior Sales Executive - Cloud, Data & AI Software Solutions
Posted 3 days ago
Job Viewed
Job Description
Senior Sales Executive - Cloud, Data & AI Software Solutions
£100,000 – £30,000 + Double OTE Uncapped
UK – Remote / Hybrid
Are you an experienced sales professional with a proven track record selling software development and technology consulting services into the Retail/CPG or Betting & Gaming industries?
We’re looking for a Senior Sales Executive to join a leading technology consultancy that helps major brands harness the power of Cloud, Data, and AI to innovate, scale, and transform. This is a fantastic opportunity to take ownership of a vertical, build strategic relationships, and play a key role in driving digital transformation for some of the most exciting companies in the market.
What You’ll Be Doing
- Leading new logo business development within your industry vertical (Retail/CPG or Betting & Gaming).
- Driving growth through the sale of cloud-native software development , data platforms , and AI-led solutions .
- Building trusted, long-term partnerships with senior technology and business stakeholders.
- Managing the full sales cycle - from strategy and prospecting through to proposal, negotiation, and close.
- Working closely with solution architects, delivery leads, and marketing teams to create compelling, value-led propositions.
- Representing the company at key industry events, conferences, and networking opportunities.
What We’re Looking For
- A strong background in selling technology services and software development projects - ideally across Cloud, Data, or AI.
- Deep sector experience within either Retail/CPG or Betting & Gaming.
- A consultative sales style with the ability to translate complex technology into clear business value.
- A strong network of senior decision-makers and the confidence to open new doors.
- Proven success winning enterprise-level deals (£500K+ T ) and consistently achieving targets.
- Driven, curious, and credible - someone who genuinely understands how technology can enable business growth.
What’s on Offer
- £1 ,000 - 30,000 base salary + double OTE uncapped
- A highly collaborative, supportive culture that values professionalism, integrity, and ambition.
- Access to cutting-edge Cloud, Data, and AI capabilities to strengthen your value proposition.
- A chance to work with some of the most respected technical experts in the industry.
- Opportunities for progression and genuine influence as the business continues to expand.
If you’re passionate about helping organisations unlock the power of Cloud, Data, and AI , and you thrive in a consultative, high-growth environment - we’d love to hear from you.
Apply now or reach out directly to discuss the role in confidence.
Remote Lead Data Scientist - Cloud & Big Data
Posted 15 days ago
Job Viewed
Job Description
Key Responsibilities:
- Lead and mentor a team of data scientists and engineers.
- Develop and implement advanced statistical and machine learning models.
- Design and optimize big data processing pipelines on cloud platforms.
- Collaborate with stakeholders to identify business opportunities for data science.
- Translate complex analytical results into actionable business insights.
- Define and manage the technical strategy for data science projects.
- Ensure the scalability, reliability, and performance of data science solutions.
- Stay abreast of the latest advancements in AI, ML, and big data technologies.
- Drive innovation and best practices in data science within the organization.
- Oversee data governance and ethical considerations in model development.
- PhD or Master's degree in Computer Science, Statistics, Mathematics, or a related quantitative field.
- Extensive experience in data science, with a proven track record of leading successful projects.
- Deep expertise in machine learning, statistical modeling, and data mining techniques.
- Strong proficiency in Python or R, and SQL.
- Hands-on experience with cloud platforms (AWS, Azure, or GCP) and big data technologies (Spark, Hadoop).
- Demonstrated leadership and team management skills.
- Excellent problem-solving, analytical, and critical thinking abilities.
- Outstanding communication and presentation skills, with the ability to explain complex concepts to non-technical audiences.
- Experience with data visualization tools.
- Ability to thrive in a remote, collaborative environment.
Salesforce Data Cloud Specialist
Posted 10 days ago
Job Viewed
Job Description
As part of our continuous growth, we are seeking a Salesforce Data Cloud Specialist to join our Salesforce Practice in London. This role will play a key part in driving data driven innovations, providing data-driven insights and enabling data-driven decision-making for our enterprise customers.
**What you'll be doing:**
+ Serve as the Subject Matter Expert (SME) for Salesforce Data Cloud within NTTDATA UK, offering expert guidance on platform capabilities, use cases, cost estimation, and best practices.
+ Collaborate with Salesforce product teams and domain experts to identify opportunities for innovation and future growth leveraging Data Cloud platform.
+ Lead the design and implementation of Salesforce Data Cloud solutions for enterprise clients, ensuring alignment with both business objectives and technical requirements.
+ Architect and manage complex data models and system integrations to facilitate seamless data flow across multiple platforms and systems.
+ Provide technical leadership throughout the project lifecycle, from requirements gathering to final solution delivery, ensuring adherence to best practices.
+ Conduct workshops and technical training sessions to promote knowledge sharing and skill development within the team.
+ Stay informed about Salesforce Data Cloud advancements and industry trends to continually drive innovation and keep our practice at the forefront.
**What experience you'll bring:**
+ Proven experience as a Salesforce Data Cloud Specialist, with in-depth knowledge of Data Cloud components, such as Data Streams, Unified Data Model, Transformations/Insights, Identity Resolution, Segmentation, and Activations.
+ Hands-on experience with at least two full lifecycle Salesforce Data Cloud implementations.
+ Expert-level understanding of data architecture, data flows, and data integration best practices within Salesforce Data Cloud and the broader Salesforce ecosystem.
+ Salesforce Data Cloud Consultant certification is required.
+ Strong experience with APIs and third-party integrations, including REST, SOAP, and other protocols.
+ Proficiency in ETL tools, data migration, and data cleansing methodologies.
+ Moderate to advanced SQL skills, with experience writing complex queries.
+ Experience integrating with cloud-based data warehouses/data lakes (e.g., Snowflake, AWS, Databricks, Big Query) and data analytics tools (e.g., Tableau).
+ Excellent communication skills, with the ability to explain complex technical concepts to non-technical stakeholders.
+ Ability to thrive in a fast-paced, collaborative environment focused on delivering exceptional solutions.
+ Experience with additional Salesforce products like Sales Cloud, Service Cloud, Marketing Cloud, Marketing Personalization, Loyalty Management, and Commerce Cloud will be good to have.
+ Additional Salesforce certifications are desirable, including Marketing Cloud Consultant, Integration Architect, AI Associate, or AI Specialist.
+ Familiarity with cloud platforms such as AWS, Azure, and Google Cloud.
+ Knowledge of data security and compliance best practices in cloud-based environments.
**Who we are:**
We're a business with a global reach that empowers local teams, and we undertake hugely exciting work that is genuinely changing the world. Our advanced portfolio of consulting, applications, business process, cloud, and infrastructure services will allow you to achieve great things by working with brilliant colleagues, and clients, on exciting projects.
Our inclusive work environment prioritises mutual respect, accountability, and continuous learning for all our people. This approach fosters collaboration, well-being, growth, and agility, leading to a more diverse, innovative, and competitive organisation. We are also proud to share that we have a range of Inclusion Networks such as: the Women's Business Network, Cultural and Ethnicity Network, LGBTQ+ & Allies Network, Neurodiversity Network and the Parent Network.
For more information on Diversity, Equity and Inclusion please click here: Creating Inclusion Together at NTT DATA UK | NTT DATA ( we'll offer you:**
We offer a range of tailored benefits that support your physical, emotional, and financial wellbeing. Our Learning and Development team ensure that there are continuous growth and development opportunities for our people. We also offer the opportunity to have flexible work options.
Back to search Email to a friend Apply now
Be The First To Know
About the latest Cloud data Jobs in United Kingdom !
Cloud Security Analyst - Data Security
Posted 3 days ago
Job Viewed
Job Description
Cloud Security Analyst – Data Security in a Health/ Finance Regulated Environment | BigQuery
- 2-month short-term contract
- £600–£650 p/d Outside IR35
- Fully Remote
The role
Our client, a global consumer finance platform, is receiving sensitive data from third party sources i.e. medical information, credit scores, other data-driven insights, via APIs .
This data needs to be securely extracted, stored, encrypted, secured, classified , with appropriate access controls and sensitivity labels applied.
You will be responsible for ensuring the data security , including encryption and key management. The data will primarily be for the US market, so knowledge of HIPPA or HITRUST is fantastic. However, experience with GDPR and ISO 27001 is also ok.
Non-Negotiables
- BigQuery in-depth use
- Data security principles and cloud compliance experience
- Encryption (KMS) , secrets management , and IAM/RBAC experience.
Core Focus Areas
- Data security and encryption across the Cloud, ensuring sensitive third-party data is encrypted, classified, and labelled appropriately.
- Configure IAM roles,
- Role-based access controls (RBAC).
- Segregation of duties to enforce secure, system-level access.
- Symmetric or asymmetric encryption.
- Enforce & maintain regulatory compliance under HIPAA compliance standards (US). Prior HIPPA experience is not required – you can read up on this.
- Support security audits, logging, and monitoring to provide compliance evidence.
- Advise on best practice data handling policies and procedures.
- Background in highly regulated industries eg. healthcare, or finance.
Why Join
This is a high-impact role where your work will directly influence security design, governance, and trust across the organisation.
You’ll have autonomy, ownership, and the opportunity to set the benchmark for secure cloud data management in a rapidly evolving environment.
Cloud Security Analyst – Data Security in a Health/ Finance Regulated Environment | BigQuery
Senior Data Engineer - Big Data & Cloud
Posted 21 days ago
Job Viewed
Job Description
Responsibilities:
- Design, construct, install, and maintain scalable data pipelines and data warehousing solutions.
- Develop and implement ETL/ELT processes for ingesting, transforming, and loading data from various sources.
- Optimize data storage and processing for performance, reliability, and cost-efficiency on cloud platforms.
- Build and maintain data infrastructure using big data technologies such as Spark, Hadoop, and Kafka.
- Collaborate with data scientists, analysts, and other engineers to understand data needs and deliver solutions.
- Implement data governance, quality, and security best practices.
- Monitor data systems, troubleshoot issues, and implement solutions to ensure high availability.
- Develop and maintain robust data models for analytical purposes.
- Stay current with emerging technologies and trends in data engineering and big data.
- Mentor junior data engineers and contribute to the team's technical growth.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- 5+ years of experience in data engineering, with a focus on big data and cloud environments.
- Proficiency in at least one major cloud platform (AWS, Azure, or GCP) and its data services.
- Strong experience with programming languages like Python, Scala, or Java.
- Expertise in SQL and experience with distributed data processing frameworks (e.g., Apache Spark, Hadoop ecosystem).
- Solid understanding of data warehousing concepts, data modeling, and ETL/ELT design patterns.
- Experience with real-time data streaming technologies (e.g., Kafka, Kinesis) is a plus.
- Excellent problem-solving, analytical, and communication skills.
- Ability to work independently and collaboratively in a remote, fast-paced environment.
- This is a fully remote role, ideal for a skilled Data Engineer located near **Manchester, Greater Manchester, UK**, or elsewhere.
Senior Data Engineer - Big Data & Cloud
Posted 24 days ago
Job Viewed
Job Description
Responsibilities:
- Design, develop, and optimize robust and scalable ETL/ELT data pipelines using cloud-based technologies.
- Implement and manage data warehousing solutions and data lake architectures on platforms like AWS, Azure, or GCP.
- Ensure data quality, integrity, and reliability across all data systems.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver effective solutions.
- Develop and maintain data models that support business needs and analytical capabilities.
- Automate data processes and implement monitoring solutions to ensure system performance and reliability.
- Optimize data storage and retrieval processes for performance and cost-efficiency.
- Contribute to the development and enforcement of data governance policies and best practices.
- Troubleshoot and resolve complex data-related issues.
- Mentor junior data engineers and contribute to team knowledge sharing.
- Stay current with emerging technologies and trends in big data and data engineering.
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- Proven experience (5+ years) in data engineering, with a strong focus on building and managing large-scale data pipelines.
- Expertise in at least one major cloud platform (AWS, Azure, GCP) and their data services (e.g., S3, Redshift, BigQuery, Snowflake, Databricks).
- Proficiency in programming languages such as Python, SQL, or Scala.
- Experience with big data technologies like Spark, Hadoop, Kafka, etc.
- Strong understanding of data warehousing concepts, data modeling, and database design.
- Familiarity with containerization technologies (e.g., Docker, Kubernetes) is a plus.
- Excellent problem-solving skills and ability to work with complex datasets.
- Strong communication and collaboration skills, with the ability to translate technical concepts to non-technical stakeholders.
- Ability to work effectively in a hybrid work environment.