Overview
Data Engineer Jobs in Abu Dhabi Emirate at ADSS
Title: Data Engineer
Company: ADSS
Location: Abu Dhabi Emirate
ABOUT THE ROLE
ADSS is a successful retail and institutional brokerage based in Abu Dhabi with operations in the UK. The company is currently executing a multi-year transformation to become a faster growing, purpose-led, next generation broker delivering personalized propositions, content and experiences to traders.
As a data engineer, you combine good data engineering and SQL skills, data modelling, integration knowledge with your business understanding, and strong analytical skills that enable you to deliver the expected benefits to the business.
You will be working with databricks and azure services and will have overview of engineering activities within the data team. You will have a point of view on information architecture, and how it can be evolved to support business strategy and functional requirements. You will play a key role in the Data transformation programme, interfacing with the governance, data science, reporting and business partnering teams.
This is an exciting opportunity to influence the quality of data-based decision-making across the business while working with the latest technologies on a cloud-based environment in a multi-disciplinary team with analysts, data scientists, data engineers, and SMEs.
KEY RESPONSIBILITIES
Contribute to the development of data platform and support analytics, ensuring easy and standardized access and sharing of data.
You need to learn and work with Synapse, Databricks, Azure Events Hub and Azure Data Lake
You will help evolve, build, and maintain data pipelines for multiple data sources and interface with system owners.
Ensure consistency of data interfacing with governance and quality data capabilities and tools
Ensure the delivery of transformation backlog across source systems, derived tables and data products
Work closely together with senior and lead engineers to deliver new products and support BAU activities
Debug issues related to BAU, log JIRA and work on process enhancements.
Conduct complex data analysis and report on results
You need to participate during on-call issues to support any critical failures
You will participate in on-call rota during production support
You need to support ad hoc data requests and production issues
ABOUT YOU
Degree qualified
Data Engineering certification (Azure Data Engineer or IBM Certified Data Engineer or Google Certified Professional) is a plus
At least 5 years of experience working in Data and Technology management services
Good debugging and problem-solving skills
Experience manipulating, processing, and extracting value from large, disconnected datasets using different frameworks like pandas etc.
Good knowledge in designing efficient and robust data pipelines, ETL workflows, data warehousing and Big Data processing.
Strong with SQL, python and pyspark.
Working experience and understanding of Azure Databricks, Azure Events Hub, Azure Data Lake, Azure Synapse, and Azure SQL is required.
Experience in business processing mapping of data and analytics solutions.
Experience with enterprise data modelling principles
Experience with real time development is a plus
THE ADSS WAY
We exist to help our clients become better traders.We obsess about improving the opportunities and experiences we offer to clients and their ability to achieve positive outcomes.
We set the pace on innovation by unlocking potential.Speed matters, so we think and act with urgency. We are relentless in staying at the forefron…
