Senior Manager, Data Engineering

1 day ago


Qatar Talent Pal Full time

**Job Purpose Summary**:
The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming, database, and software engineering skills as well as knowledge of data architectures and frameworks.

**Essential Duties & Responsibilities by Dimensions**:

- Plan and monitor the implementation of development lifecycle strategies, policies, standards and guidelines for design, selection, development and ongoing maintenance of systems
- Contribute to data model deployment in test and production and creating data workflow automation
- Ensure proper implementation of strategies policies, standards and guidelines of project management and control to deliver the projects assigned objectives within the limited resources, time and budget
- Implement test plans and scripts standards
- Monitor and recommend solutions to cater for the user business requirements and provide the most adequate systems to resolve these requirements
- Carry out any projects or assignment as assigned by Data Scientist or Data Analysis
- Participate proactively in any new projects that require deployment or during the acquisition of new tool/technology required by the Group and follow up on the progress of ongoing projects
- Implement and ensure readiness of all data tools or software required by data scientist team to assist them in building analytics models
- Implement and ensure all quarries and data set are provided on time and with quality to Data Analysis team to assist them in their analytics
- Implement automated processes and data monitoring techniques to ensure data quality, ensuring production data is accurate and available for key stakeholders
- Ensure all dev/test environment setup and configuration are delivered on time with quality
- Recommend live operations of the systems or retirement of the system with the Group's IT architecture based on business objective and strategy
- Ensure compliance and adherence to existing standards and policies by all the Data Development staff and follow the most recent control objectives and best practices
- Implement tasks according to the prioritization based on the overall business plans and other factors of limitation and urgencies
- Ensure the enforcement of segregation of critical role as Developer and Tester, as well adherence to all data governance and quality guidelines

**Education & Experience Requirements**:

- University graduate preferably with a Major in computer science, data science, software engineering, information systems, or related quantitative field
- At least 8 years of relevant experience, preferably within a Data Engineer role
- Experience building and optimizing data pipelines, architectures, data sets and all its underlying environments
- Excellent oral and written communication skills (including report writing) in English and Arabic
- Excellent Coding knowledge, Python, Golang, Ruby, Perl, Scala, Java, SAS, R, MATLAB, C, and C++, etc
- Excellent Data Warehouse solutions technical knowledge, such as Panoply or Redshift
- Excellent OS administrative knowledge, MS, Linux, Solaris, UNIX, etc
- Excellent database and relational database related administrative knowledge, MySQL, Oracle, SQL, Etc
- Experience with data pipeline and workflow management tools (ETL, Airflow, etc.) and big data tools (Hadoop, Spark, Kafka, etc)
- Ability to make decisions and follow through with initiatives

This job has been sourced from an external job board.



  • Qatar Talent Pal Full time

    Job Purpose Summary: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming, database,...

  • Staff Data Engineer

    7 days ago


    Qatar Talent Pal Full time

    About Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with more than 3.6 million accommodations globally. Based in Asia and part of Booking Holdings, our 6,000+ employees representing 90+ nationalities foster a work environment rich in diversity,...


  • Qatar Talent Pal Full time

    About QNB Established in 1964 as the country s first Qatari-owned commercial bank, QNB Group has steadily grown to become the largest bank in the Middle East and Africa (MEA) region. QNB Group s presence through its subsidiaries and associate companies extends to more than 31 countries across three continents providing a comprehensive range of advanced...


  • Qatar Talent Pal Full time

    **About QNB**: Established in 1964 as the country's first Qatari-owned commercial bank, QNB Group has steadily grown to become the largest bank in the Middle East and Africa (MEA) region. QNB Group's presence through its subsidiaries and associate companies extends to more than 31 countries across three continents providing a comprehensive range of advanced...

  • Senior Analytics

    7 days ago


    Qatar Talent Pal Full time

    Join our growing, international and fun Doha team as a Senior Analytics / Big Data Consultant focusing on both backend and frontend data & analytics technologies. You should have 4-6 years experience working with leading analytics solutions and love what you do! You will help us deliver analytics excellence to our tier 1 customers in Qatar and our other GCC...

  • Data Engineer

    1 day ago


    Qatar Talent Pal Full time

    **Data Engineer**: This job has been sourced from an external job board.

  • Senior Data Analyst

    7 days ago


    Qatar Beinex Full time

    **Highlights**: - Experience **3-5 Years** - Joining Date Immediate or max 30 days’ Notice Period - Qualification Preferably a bachelor’s degree or a master's degree in Engineering, Statistics or Mathematics. **Responsibilities**: - Translating business user stories to technical requirements - Identifying challenges in day-to-day business...


  • Qatar Talent Pal Full time

    Data Cloud Engineer Azure **Job Location**: Qatar **Job Details**: Bachelors / Masters or equivalent degree in Computer Science, Engineering. Below are the required skills for this Data Engineer Role (cloud), Minimum 6-9 years relevant experience in object-oriented/object function scripting languages: Python, Scala, etc and in Python programming and...


  • Qatar Talent Pal Full time

    **Data Cloud Engineer Azure**: Job Location: Qatar Job Details: Bachelors / Masters or equivalent degree in Computer Science, Engineering. Below are the required skills for this Data Engineer Role (cloud), Minimum 6-9 years relevant experience in object-oriented/object function scripting languages: Python, Scala, etc and in Python programming and libraries...


  • Qatar EPAM Systems, Inc. Full time

    We’re looking for an experienced **AI Business Engineer** to play a pivotal role in shaping innovative solutions using generative AI technologies for a major client in the financial services and banking domain. As a Senior AI Business Engineer, you will act as a strategic bridge between business stakeholders, technical teams and generative AI...