Overview

Senior Data Engineer Jobs in Abu Dhabi – UAE at Airswift

Title: Senior Data Engineer

Company: Airswift

Location: Abu Dhabi – UAE

Type: Contract

Category: IT/Tech, Software Development

Job description

Airswift’s IT and Technology department are currently searching for a Senior Data Engineer to work on a major data centre project in the Middle East. This role will be on a long term contract basis.

Responsibilities- Create, Develop and maintain scalable data pipelines and build out new API integrations which will support ongoing increases in volume data and complexity. Work closely with business teams and analytics to optimise data models that feed into the business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Implements systems and processes to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that rely on it.

Performs analysis or data required to troubleshoot data related issues and assist in the resolution of issues. Works closely with a team of frontend and backend engineers, product managers, and analysts. Designs data integrations and data quality framework. Designs and evaluates open source and vendor tools for data lineage. Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.

Requirements

-Must havehands on experience with the following – Image Processing, Python, and Data science libraries such as Pytorch, OpenCV and Tensorflow.

Experience withdatabases such as Postgre

SQL and Mongo

DB.

Must haveexperience of Docker Expert understanding of messaging broker concept. Good knowledge on task scheduling techniques.

Experience withdata pipeline and workflow management tools

Experience withor knowledge of Agile Software Development methodologies Process oriented with great documentation skills Excellent problem solving and troubleshooting skills Experience – 5+ years of Python or other 5+ years of No

SQL & SQL experience 5+ years of experience with schema design and dimensional data modelling

Experience withprogramming languages like JavaScript (NodeJs) and Java Ability in managing and communicating data warehouse plans to internal clients Experience designing, building, and maintaining data processing systems

Experience workingwith either a Map Reduce or an MPP system on any size/scale For further information on this role please contact Airswift’s IT/Technology department.

 

About Airswift