357 Data Platforms jobs in the United Kingdom
Data Platform Engineer
Posted today
Job Viewed
Job Description
Data Platform Engineer
Snowflake / DataOps / CI/CD
500 - 600/day Inide IR35 | 6 Months
Fully Remote
We're working with a well-known insurance company currently undergoing a company-wide transformation programme. They're looking for a Data Platform Engineer to help improve their cloud-based data platform and build out their DataOps capabilities.
The organisation has invested in several PaaS tools but currently has limited capability, giving you the opportunity to build things from the ground up, implement best practices, and share your knowledge. A key part of your role will be setting up monitoring and alerting across the platform.
Experience Required:
- Hands-on with Data Platform tools: Snowflake (Must Have), dbt, Airflow, and Fivetran
- Experience implementing DataOps best practices: CI/CD, modular pipelines, automated testing, code promoting
- Access management using Azure Active Directory (Entra ID)
- Proven experience setting up monitoring and alerts
- Proactive approach with strong communication skills
Desirable (Not Essential):
- Experience with Elastic
Please apply directly and we'll be in touch!
Data Platform Engineer
Posted today
Job Viewed
Job Description
Data Platform Engineer
London - Hybrid
80,000-90,000 + 38 Days Holiday + Private Healthcare + Life Assurance + Flexible Working + Pension + Package
Excellent opportunity for a Data-focused Site Reliability Engineer or a Data Platform Engineer with some DevOps principals to join a forward-thinking and high-growth Fintech company offering a hybrid work environment, a great benefits package, and opportunities for further progression!
This company are a bleeding-edge technology business driving innovation across the global financial services sector. Their platform processes vast amounts of real-time and batch data, supporting business critical reporting and analytics. With a strong culture rooted in integrity, creativity, and technical excellence, they've become a trusted partner across a wide range of businesses.
In this role you'll take ownership of the reliability and performance of large-scale date pipelines built on AWS, Apache Flink, Kafka, and Python. You'll play a key role in diagnosing incidents, optimising system behaviour, and ensuring reporting data is delivered on time and without failure.
The ideal candidate will have a strong experience working with streaming and batch data systems, a solid understanding of monitoring a observability, and hands-on experience working with AWS, Apache Flink, Kafka, and Python.
This is a fantastic opportunity to step into a SRE role focused on data reliability in a modern cloud native environment, with full ownership of incident management, architecture, and performance.
The Role:
*Maintaining and monitoring real-time and batch data pipelines using Flink, Kafka, Python, and AWS
*Act as an escalation point for critical data incidents and lead root cause analysis
*Optimising system performance, define SLIs/SLOs, and drive reliability
*Woking closely with various other departments and teams to architect scalable, fault-tolerant data solutions
The Person:
*Experience in a data-focused SRE, Data Platform, or DevOps role
*Strong knowledge of Apache Flink, Kafka, and Python in production environments
*Hands-on AWS experience with AWS (Lambda, EMR, Step Functions, Redshift, etc.)
*Comfortable with monitoring tools, distributed systems debugging, and incident response
Reference Number: BBBH(phone number removed)
To apply for this role or for to be considered for further roles, please click "Apply Now" or contact Tommy Williams at Rise Technical Recruitment.
Rise Technical Recruitment Ltd acts an employment agency for permanent roles and an employment business for temporary roles.
The salary advertised is the bracket available for this position. The actual salary paid will be dependent on your level of experience, qualifications and skill set. We are an equal opportunities employer and welcome applications from all suitable candidates.
Data Platform Engineer
Posted today
Job Viewed
Job Description
Data Platform Engineer
London - Hybrid
£80,000-£90,000 + 38 Days Holiday + Private Healthcare + Life Assurance + Flexible Working + Pension + Package
Excellent opportunity for a Data-focused Site Reliability Engineer or a Data Platform Engineer with some DevOps principals to join a forward-thinking and high-growth Fintech company offering a hybrid work environment, a great benefits package, and op.
WHJS1_UKTJ
Data Platform Engineer
Posted 2 days ago
Job Viewed
Job Description
Lyst is a global fashion shopping platform founded in London in 2010 and catering to over 160M shoppers per year. We offer our customers the largest assortment of premium & luxury fashion products in one place, curating pieces from 27,000 of the world's leading brands and stores. In 2025, Lyst joined Zozo, operators of Zozotown, the leading fashion e-commerce platform in Japan. This partnership marks a bold new era for Lyst, as we accelerate our vision and work together to transform the future of fashion shopping through AI and technology.
At Lyst, we obsess over the customer, providing a search & discovery experience which offers inspiration, fulfilment, and personalisation. We believe that fashion is amazing but shopping for fashion often isn't, and use our technology, data and creativity to bring more joy, greater choice and fewer fails. Our mission is to help fashion shoppers make better choices and help fashion partners find better audiences as the category-leading destination for every fashion shopper.
The Role
Lyst is looking for a Software Engineer to join their Data Platform team. The engineer will help build upon and improve our customer facing analytics ingestion pipelines that power our business intelligence and decision making.
You will work in a fast-paced environment with a high level of autonomy. While your work will be peer reviewed and subject to approvals, it is important that you are able to liaise with both team members and wider partners in the organisation to gather requirements and lead on appropriate solutions.
You will be maintaining and improving a system that handles a high volume of traffic so experience with cloud and data warehouse infrastructure will help you in this role (we use AWS, Cloudflare and snowflake). Familiarity with infrastructure as code will also help when updating our cloud architecture (we use terraform).
We place a large focus on data quality so you'll be expected to review the small picture (data contracts via versioned schemas) and the wider picture (data integrity and data completeness across tables and databases). We also value the ability for team members to think of ways we can improve data quality and drive those initiatives across the business.
Within the first three months, you will be able to:
- Contribute to every part of our system, ranging from code and tests to infrastructure changes.
- Ensure the stability of our system by implementing and improving monitoring and observability tools.
- Write resilient code that is well tested.
- Be curious — not just the code, but the architecture of our platforms and everything that enables the business to thrive.
- Gain expertise over our tools and services: Python, Docker, Github Actions, Snowflake, AWS
- Participate in all team ceremonies and have direct input in the team's ways of working.
This is a high-trust, supportive, and collaborative environment where you will have plenty of opportunities to make an impact on your team and the wider company. We value attitude as much as we do direct experience—we want to hire people to grow into the role and beyond.
About the team:
- Python is our bread and butter.
- The wider data platform team uses dbt, Snowflake, and Looker to model, transform, and expose data for analytics and reporting across the business.
- We use Docker and Kubernetes to manage our production services.
- We use Github Actions for continuous integration and deployment. Lyst deploys new changes to production more than 500 times a month.
- The Data Platform team is one of Lyst's fundamental teams, and the data we manage is critical for the business. We have a strong relationship across the rest of the organisation, and almost all of Lyst engineering engages with us on a regular basis.
- We care about robustness and integrity in our pipelines and use observability tools to monitor.
Requirements
- Experience in developing robust and secure software solutions and data pipelines.
- Effective communication skills, comfortable working with technical and non-technical individuals and teams.
- Proficiency in developing with Python.
- Experience with delivering software solutions and data pipelines within public cloud technologies and architecture (perferably AWS exp).
- Experience with containers (Docker) and container orchastration.
- Experience with Infrastructure as Code (we use Terraform).
- Experience utilising monitoring, observability and logging tools.
- Experience with git, gitOps, github actions.
- Exposure or experience with cloud data warehouse/data platforms (we use Snowflake).
Things that matter to us:
- You have a passion for utilising your software engineering skills in data engineering.
- You enjoy building sustainable, robust software that scales and automate and drive efficiencies at every chance.
- You are excited to learn and equally share your knowledge with peers.
- You enjoy problem solving as an individual but also solving problems within a team or with wider colaboration across teams.
- You take pride in code ownership and maintaining responsibilities to a high level with good documentation and test coverage.
- You understand the importance of good Data management practices and broader Data Governance principles and their impact on things like Data Quality.
- You effectively support and maintain production data pipelines, ensuring monitoring and observability is in place and respond to sustain service levels and data consistency within Data platforms.
Benefits
- Our Ways of Working: We all come into the office on Tuesdays and Thursdays , with the option to work remotely or come into the office on the other days. We believe that in person collaboration and community spirit is super important, which is why we spend some of our time in the office and some of our time at home.
- Time Off: In addition to the 8 statutory bank holidays, you will receive 29 holidays per year. Lyst’s holiday year runs from 1 April to 31 March.
- Competitive Family Leave Package: This includes Enhanced Family Leave for those eligible, paid Time off for Dependents and Support for Fertility Treatment & Loss.
- Clothing Benefit: We want you to enjoy using the Lyst app and site as much as our customers, so we provide you with a clothing allowance to use on Lyst every year. This starts at £250 when you join and increases up to £,000 with your length of service.
- Private Healthcare: Our healthcare provider is Vitality. Your health is important to us which is why we offer all employees a comprehensive healthcare scheme from the day you start.
- Training Allowance: We’re big on continuous learning and growth, so all employees are currently entitled to an annual training allowance of £1 00. This can be used to attend conferences, industry events, training courses and to purchase resources.
- Pension Scheme: Our pension provider is The People’s Pension. We offer a minimum employee contribution of 5% and 3% employer contribution.
- Eye Tests and Vouchers: Employees can make a saving on their eye test and glasses through our chosen provider. You’ll receive a free eye test every year and a discount towards glasses.
- Cycle-to-Work Scheme: Lyst will purchase a bicycle from your chosen retailer, you will then receive a voucher to pick up your bicycle from them.
- Transport Season Ticket Loan: Employees can apply for an interest free season ticket loan to support your travel to work.
- Social Events: Frequent company wide social events including Christmas & summer parties, sports days, themed drinks, quizzes, cook alongs, as well as smaller team socials. We also have plenty of interest based groups such as football, running club, book club, culinary and more.
We want to build a world where fashion works for everyone, and we want teams that are just as inclusive. Diversity and inclusion is an integral part of our culture at Lyst. We recognise and celebrate the value and impact diversity brings to our company and are committed to ensuring this is a consistent focus, for which we are held to account. We are committed to treating all applicants fairly and equally, and encourage candidates from all backgrounds to apply for this role. We are happy to talk about flexible working arrangements.
Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. At Lyst we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles.
Data Platform Engineer
Posted 14 days ago
Job Viewed
Job Description
About Us
YouLend is the preferred global embedded financing platform for many of the world’s leading e-commerce sites, tech companies and payment services providers such as Amazon, eBay, Shopify, Mollie, Dojo, Paysafe, Just Eat Takeaway and Takepayments. Our software platform and APIs enable our partners to offer flexible financing products, in their desired branding, to their merchant base. With YouLend's AI-driven credit risk assessment solutions, more merchants and SMEs than ever can receive fast, flexible and affordable funding. We operate in 9+ geographies across the UK, EU and the US. We believe that the future of financial services will be delivered by customer-oriented tech companies that embed financing in their customer journeys, and we are building the solutions that will power that future.
The Role:
We’re looking for a Data Platform Engineer to join our growing Data Engineering & Platform team . This role sits at the intersection of infrastructure, DevOps, and modern data tooling — with a focus on enabling fast, secure, and scalable analytics. To help us build and scale a best-in-class data platform to support everything from dashboards and experimentation to ML and compliance
Requirements
- Build and manage infrastructure for our data platform (AWS, Snowflake, dbt, Airflow)
- Design and implement CI/CD pipelines for dbt and other data workflows
- Automate data platform operations with Python and infrastructure-as-code tools (Pulumi/Terraform)
- Collaborate with analytics, ML, product, and engineering teams to scale data solutions
- Ensure data quality, lineage, and governance through testing and monitoring
- Work with cost observability tools to ensure efficient platform usage
Essential:
- Proven experience working with cloud-based data platforms (Snowflake, Redshift, BigQuery, etc.)
- Proficiency in Python and SQL for automation and analytics
- Experience with CI/CD, preferably in dbt and/or data platforms
- Hands-on with IaC tools like Pulumi, Terraform, or CloudFormation
- Good understanding of orchestration tools like Airflow
- Strong communicator, with experience working cross-functionally
Desirable Skills:
- Cloud: AWS (S3, Lambda, MWAA), Azure DevOps
- Platform: Snowflake, dbt Cloud, Fivetran
- Orchestration: Airflow (MWAA), dbt jobs
- Languages: Python, SQL
- IaC: Pulumi, Terraform
- Monitoring: DataDog
Salary: £60,000 - 90,000 + 10% annual bonus
Benefits
Why work at YouLend?
- Award-Winning Workplace: YouLend has been recognised as one of the “Best Places to Work 2024” by the Sunday Times for being a supportive, diverse, and rewarding workplace.
- Award-Winning Fintech: YouLend has been recognised as a “Top 250 Fintech Worldwide” company by CNBC.
We offer comprehensive benefits package that includes:
- Stock Options
- Private Medical insurance via Vitality
- EAP with Health Assured
- Enhanced Maternity and Paternity Leave
- Modern and sophisticated office space in Central London
- Free Gym in office building in Holborn
- Subsidised Lunch via Feedr
- Deliveroo Allowance if working late in office
- Monthly in office Masseuse
- Team and Company Socials
- Football Power League / Squash Club
At YouLend, we champion diversity and embrace equal opportunity employment practices. Our hiring, transfer, and promotion decisions are exclusively based on qualifications, merit, and business requirements, free from any discrimination based on race, gender, age, disability, religion, nationality, or any other protected basis under applicable law.
Azure Data Platform Engineer
Posted today
Job Viewed
Job Description
Job Description:
Azure Data Platform Engineer
Location : Greater Manchester, hybrid 1 day a week in the office.
Salary: Competitive (per annum)
Terms: 3-Year Fixed Term (potential to extend or become permanent)
Benefits: 53 days paid annual leave with a generous pension
We're hiring an Azure Data Platform Engineer to join a digital research programme focused on high-performance computing and real-w.
Lead Data Platform Engineer (Python & AWS)
Posted 534 days ago
Job Viewed
Job Description
Lyst is a global Fashion Tech company and premium shopping app, founded in London in 2010 and catering to over 200M shoppers per year. We offer our customers the largest assortment of premium & luxury fashion items & products in one place, via an assortment of 8.5M+ items from over 17,000 of the world’s leading brands. We are a scale-up business with a current team size of c. 160 people in London, combining an agile mentality with a proven business model and over a decade of experience. This provides a balance between foundations and structure, and autonomy and pace.
At Lyst we obsess over the customer, providing a search & discovery experience which offers inspiration, fulfilment, and personalisation. We believe that fashion is amazing but shopping for fashion often isn’t, and use our technology, data and creativity to bring more joy, greater choice and fewer fails. Our mission is to help fashion shoppers make better decisions and help fashion partners find better audiences as the category-leading destination for every fashion shopper. Lyst has raised over $160m from leading investors including Accel, Balderton, Molten Ventures, Fidelity International, and LVMH.
We’re looking for a Lead Data Platform Engineer to join our central Analytics Engineering team, and help drive the Data Engineering discipline within the Data Platform chapter. This is a great opportunity for someone who wants to have impact from day one and make their mark as an expert in a high performing, collaborative team.
We record nearly 100 million lines of data daily, and we are looking for a senior engineer to support and maintain a data platform that is scalable, reliable and enables data-led decision making business-wide.
As a data engineer within the central data platform function, you will maintain the data ingestion infrastructure in AWS for data owners across Lyst to leverage and to ensure the data created is of high quality. You will identify, design and implement improvements to these processes, including data contracts and testing. This role will work closely with our engineers, analytics engineers and analysts to help us successfully deliver our data platform and data strategy.
Key responsibilities:
- Maintain our data ingestion infrastructure, and liaise with Engineering data owners on the infrastructure and standards
- Identify, design and implement process improvements for data ingestion and testing
- Create documentation and guidelines on building reliable, scalable data pipelines
- Own our data contract capabilities, and develop guidelines for data owners
- Advocate data quality across the organisation
- Support data owners on data ingestion, for new and existing data pipelines
- Work closely with Analytics Engineering to bridge the gap between data creation and transformation
- Support in delivering our data strategy
- We work mainly in Python and SQL, running on a range of AWS technologies such as S3, EKS, SQS, Firehose, Kinesis & Lambda and non-AWS tools such as Snowflake, dbt, Looker, CircleCI, Docker, Terraform & GitHub.
Requirements
- Experience with Python, AWS data tooling, and software fundamentals (SQL, Git)
- Experience with data processing & testing in the cloud, with a large amount of data
- Excellent Python knowledge and experience and up to date on best Python practices, as well as experience writing efficient SQL
- Experience working on full data engineering projects, from design to implementation
- Experience iterating & refactoring existing code as well as writing new code
- Communication: You are able to communicate clearly and be humble when sharing ideas and solutions. You can communicate with both technical and non-technical stakeholders
- You strive to write clear, well documented, tested code, and look to improve existing code and ways of working. When you find an opportunity, you’re are excited to go for it
- (Bonus) Experience with data contract implementation
Things that matter to us:
- You are curious at heart and like to take ownership of something to make it better
- You are detail oriented
- You are a team player and communicate with your peers and other stakeholders in the company on a day to day basis
- Being confronted with a difficult or strange problem makes you feel like a detective that wants to crack the mystery
- You have a sense of ownership over products, features and services the team looks after
Benefits
- Our Ways of Working: We come into the office between 2-4 days a week and we're always in on Tuesdays and Thursdays . We strongly believe that in-person collaboration and time spent together as a team allows us to deliver high impact work, but the flexibility to also work remotely supports our diverse team.
- Time Off : In addition to the 8 statutory bank holidays, you will receive 29 holidays per year. Lyst’s holiday year runs from 1 April to 31 March.
- Competitive Family Leave Package : This includes Enhanced Family Leave for those eligible, paid Time off for Dependents and Support for Fertility Treatment & Loss.
- Clothing Benefit: We want you to enjoy using the Lyst app and site as much as our customers, so we provide you with a clothing allowance to use on Lyst every year. This starts at £250 when you join and increases up to £,000 with your length of service
- Private Healthcare: Our healthcare provider is Vitality. Your health is important to us which is why we offer all employees a comprehensive healthcare scheme from the day you start.
- Training Allowance : We’re big on continuous learning and growth, so all employees are currently entitled to an annual training allowance of £1 00. This can be used to attend conferences, industry events, training courses and to purchase resources.
- Pension Scheme: Our pension provider is The People’s Pension. We offer a minimum employee contribution of 5% and 3% employer contribution.
- Eye Tests and Vouchers: Employees can make a saving on their eye test and glasses through our chosen provider. You’ll receive a free eye test every year and a discount towards glasses.
- Cycle-to-Work Scheme : Lyst will purchase a bicycle from your chosen retailer, you will then receive a voucher to pick up your bicycle from them.
- Transport Season Ticket Loan : Employees can apply for an interest free season ticket loan to support your travel to work.
- Social Events : Frequent company wide social events including Christmas & summer parties, sports days, themed drinks, quizzes, cook alongs, as well as smaller team socials. We also have plenty of interest based groups such as football, running club, book club, culinary and more.
We want to build a world where fashion works for everyone, and we want teams that are just as inclusive. Diversity and inclusion is an integral part of our culture at Lyst. We recognise and celebrate the value and impact diversity brings to our company and are committed to ensuring this is a consistent focus, for which we are held to account. We are committed to treating all applicants fairly and equally, and encourage candidates from all backgrounds to apply for this role. We are happy to talk about flexible working arrangements.
Don’t meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they meet every single qualification. At Lyst we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles.
Be The First To Know
About the latest Data platforms Jobs in United Kingdom !
Data Engineer
Posted today
Job Viewed
Job Description
Data Engineer
Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting.
With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential of the company's data and drive data-led decision-making.
As part of this role, you will be responsible for some of the following areas
- Architect and build a scalable data platform integrating diverse data sources
- Develop and maintain robust, efficient data pipelines
- Write clean, reliable code to transform and manipulate data
- Partner with senior technical leaders to shape modern data platform best practices
- Contribute to long-term data strategy with a strong focus on data integrity and GDPR compliance
To be successful in the role you will have
- Hands-on coding experience with Python or PySpark
- Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines
- Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse
- Strong command of SQL
- Excellent communication and collaboration skills
What's in It for You:
- Up to 60,000 salary depending on experience
- Hybrid working: 3 days in Bristol office, 2 days from home
- 24 days annual leave plus bank holidays (rising to 27 with service)
- Private healthcare and other wellness benefits
- Company pension scheme
This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will call you to discuss further. My client is looking to begin the interview process ASAP, so don't miss out, APPLY now! To do so please email me at (url removed) or call me on (phone number removed).
Data Engineer
Posted today
Job Viewed
Job Description
Data Engineers - Permanent Opportunity
Based in Reading: 1-2 days per week
A major UK organization is expanding their Data Engineering team to drive forward their ambitious data platform transformation initiative.
Are you an experienced Data Engineer ready to tackle complex data challenges at scale? This established organization is building their next-generation Enterprise Data Platform and needs skilled professionals to accelerate their journey toward becoming a data-centric organisation.
About Our Client
Our client operates critical infrastructure serving millions of customers across the UK. They're investing significantly in modernizing their data capabilities, creating a centralized data lakehouse architecture that will transform how they leverage information across the business. Join their Digital Data division during this exciting period of growth and innovation.
Your Role as Data Engineer
- Design and implement robust data pipelines using Azure Data Factory to integrate operational systems with analytical platforms
- Analyze business data requirements and create comprehensive documentation following established protocols
- Transform legacy manual processes into automated, scalable data workflows
- Partner with data architects and analytics teams to identify critical data needs for business insights
- Resolve complex integration challenges involving diverse database systems and unstructured datasets
- Support stakeholders across Data Science and Business Intelligence functions with reliable data delivery
- Help establish and maintain enterprise-wide data governance standards
Core Technical Requirements of the Data Engineer
- Azure Data Factory mastery - demonstrable expertise in pipeline development and management
- Proficient SQL and/or Python capabilities - minimum 2-3 years hands-on experience
- Comprehensive Data Engineering background - proven track record in enterprise data solutions
- Experience with ETL processes and data transformation, preferably using Databricks
- Strong foundation in Data Warehousing architectures and dimensional modeling
- Familiarity with batch processing from relational database sources
Communication & Collaboration Skills of the Data Engineer
- Outstanding stakeholder engagement abilities across technical and business audiences
- Strong relationship-building skills with experience managing diverse internal customers
- Demonstrated success working within cross-functional project teams
Additional Valuable Experience
- Microsoft Azure Data Engineering certifications (MCSA or equivalent)
- Azure Fundamentals knowledge and certification
- Exposure to industry standards frameworks (ISO certifications, ITIL practices)
- Previous experience in regulated industries or similar sectors
Compensation & Benefits Package
- Attractive salary reaching £70,000 based on experience
- Annual performance bonus opportunity (up to 10% of base salary)
- Flexible hybrid model - 2 office days weekly (Thursday being core collaboration day) based in Reading
- Holiday entitlement starting at 26 days, progressing to 30 days with tenure
- Comprehensive pension arrangement and extensive benefits portfolio
Data Engineer
Posted today
Job Viewed
Job Description
About Us
Makutu designs, builds and supports Microsoft Azure cloud data platforms. We are a Microsoft Solutions Partner (Azure Data & AI) and are busy building a talented team with relevant skills to deliver industry leading data platforms for our customers.
The Role
The Data Engineer role is key to building and growing the in-house technical team at Makutu. The role will provide the successful applicants with the opportunity for significant career development while working with a range of large businesses to whom data is critical to their success.
Working as part of the team and with the customer, you'll require excellent written and verbal English language and communication skills.
Big growth plans are in place to build a broader and deeper technical capability with a focus on the Microsoft Azure technology stack.
The position of Data Engineer is a key role in the wider capability of our team. Occasional visits to our Head Office and customers sites will be required.
Key responsibilities:
- Identify, design, and implement working practices across data pipelines, data architectures, testing and deployment
- Understand complex business requirements and providing solutions to business problems
- Understand modern data architecture approaches and associated cloud focused solutions
- Defining data engineering best practice and sharing across the organisation
- Collaborating with the wider team on data strategy
Skills and experience:
- A relevant Bachelors degree in Computing, Mathematics, Data Science or similar (ideal but not essential)
- A Masters degree in Data Science (ideal but not essential)
- Experience building data pipelines with modern practices including the use of cloud native technologies, DevOps practices, CI/CD pipelines and agile delivery
- Experience with data modelling, data warehousing, data lake solutions
- Able to communicate effectively with senior stakeholders.
Successful candidates will likely posses Azure certifications such as DP-600 and/or DP-700.
Also, applicants will have experience working with some of the following technologies:
- Power BI
- Power Apps
- Blob storage
- Synapse
- Azure Data Factory (ADF)
- IOT Hub
- SQL Server
- Azure Data Lake Storage
- Azure Databricks
- Purview
- Power Platform
- Python