
Discovered
Senior Data Engineer Jobs In Dubai | Discovered
We have partnered with a leading bank here in the UAE who are looking to add a Senior Data Engineer to its growing Analytics function. The successful candidate will use technologies to acquire, ingest and transform big data. You will prepare data and conduct feature engineering to be used in machine learning models to support use case execution with a view to achieving overall objectives and targets.
Responsibilities:
- Work with the analytics delivery lead and lead engineer to understand the business needs and build impactful analytics solutions
- Contribute to cross-functional problem-solving sessions with your team and provide tangible solutions using your expertise in data engineering and domain data knowledge
- Data onboarding and access process – work with business analysts and analytics delivery lead to manage stakeholders that are affected by changes
- Design and build high-performance, secure, and scalable data pipelines to support data science projects following software engineering best practices
- Design and develop the data and analytics platform selecting the right technologies for each problem at hand (big-data stack, SQL, no-SQL, etc.)
Requirements:
- Ability to write clean, maintainable, and robust code in Python
- Hands-on experience with technologies like Python, Spark/Pyspark, Hadoop/MapReduce/HIVE, Pandas, etc.
- Familiarity with query languages and database technologies, CI/CD, testing and validation of data and software
- Experience with analytics, feature engineering, algorithms, anomaly detection, data quality assessment, and python visualization libraries
- Knowledge of testing frameworks and libraries
Requirements of Qatar construction company job vacancies 2023