Data Engineer

Details:
  • Salary:
  • Category: Engineering
  • Location: England London
  • Date: 1 month ago
This job offer is no longer available. See below for similar jobs:
Register
Description:

As a Data Engineer you will have a major influence in building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Google ‘big data’ technologies.

You will help us create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

You’ll be given the opportunity to work on AI that uses machine learning to identify messages that could be considered as abusive behaviours, and many more other projects such as improving matchmaking on our competitive gaming platform.

Responsibilities

Create and maintain optimal data pipeline architecture Create and maintain AI and ML infrastructures on GCP that our data scientist can leverage to train and host ML models Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Google ‘big data’ technologies Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Work with data and analytics experts to strive for greater functionality in our data systems.

Requirements:

Advanced working SQL knowledge and experience working with relational and non-relational databases Experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Strong analytic skills related to working with unstructured datasets

Exposure to the following software/tools:

Big data tools: Hadoop, Spark, Kafka, etc. SQL and NoSQL databases, including Postgres and MongoDB.

Graph technologies, including Neo4j

Data pipeline and workflow management tools: Airflow, Luigi, etc. Google Cloud services: Bigquery, Dataflow, Cloud Ai, Cloudrun, etc Stream-processing systems: Apache Beam, Spark-Streaming, etc. Object-oriented/object function scripting languages: Python, Java, etc.

Benefits:

Lunch provided daily; Kitchen stocked with refreshments, cereals, bread, spreads (coffee machines everywhere – our founding team is Italian after all!);

Pension plan

Flexible working environment

Monthly drinks and dinner in the office; Monthly massages; Quarterly team outings; 5 a side twice monthly; Your professional growth is important to us. We provide ongoing training opportunities;

When applying for a job, do not provide bank account details or any other financial information. Never make any form of payment. WhatJobs is not responsible for any external website content. Report this job

Email me jobs like this

Enter your email address and we will send you Data Engineer job alerts England, London ()

Your browser does not support Cookies or JavaScript or this option is turned off in your browser settings.

How to enable Cookies and JavaScript

Your browser is out of date!

Update your browser to view this website correctly. Update my browser now

×