Senior Data Engineer Jobs in Abu Dhabi – UAE at Airswift
Title: Senior Data Engineer
Location: Abu Dhabi – UAE
Category: IT/Tech, Software Development
Airswift’s IT and Technology department are currently searching for a Senior Data Engineer to work on a major data centre project in the Middle East. This role will be on a long term contract basis.
Responsibilities- Create, Develop and maintain scalable data pipelines and build out new API integrations which will support ongoing increases in volume data and complexity. Work closely with business teams and analytics to optimise data models that feed into the business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization. Implements systems and processes to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that rely on it.
Performs analysis or data required to troubleshoot data related issues and assist in the resolution of issues. Works closely with a team of frontend and backend engineers, product managers, and analysts. Designs data integrations and data quality framework. Designs and evaluates open source and vendor tools for data lineage. Works closely with all business units and engineering teams to develop strategy for long term data platform architecture.
-Must havehands on experience with the following – Image Processing, Python, and Data science libraries such as Pytorch, OpenCV and Tensorflow.
Experience withdatabases such as Postgre
SQL and Mongo
Must haveexperience of Docker Expert understanding of messaging broker concept. Good knowledge on task scheduling techniques.
Experience withdata pipeline and workflow management tools
Experience withor knowledge of Agile Software Development methodologies Process oriented with great documentation skills Excellent problem solving and troubleshooting skills Experience – 5+ years of Python or other 5+ years of No
SQL & SQL experience 5+ years of experience with schema design and dimensional data modelling
Experience workingwith either a Map Reduce or an MPP system on any size/scale For further information on this role please contact Airswift’s IT/Technology department.