Data Engineer

1 month ago


Doha Qatar Novel Overseas Corporation Full time
Description & Experience :

The data engineer is responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise.

? At least six years of work experience in data management disciplines, including data integration, modeling, optimization and data quality, or other areas directly relevant to data engineering responsibilities and tasks

? Proven project experience developing and maintaining data warehouses in big data solutions (Snowflake)

RESPONSIBILITIES & DUTIES

? Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems

? Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance

? Integrates data from different sources, including databases, data warehouses, APIs, and external systems

? Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed

? Transforms raw data into a usable format by applying data cleansing, aggregation, filtering, and enrichment techniques

? Optimizes data pipelines and data processing workflows for performance, scalability, and efficiency

? Monitors and tunes data systems, identifies and resolves performance bottlenecks, and implements caching and indexing strategies to enhance query performance

? Implements data quality checks and validations within data pipelines to ensure the accuracy, consistency, and completeness of data

? Takes authority, responsibility, and accountability for exploiting the value of enterprise information assets and of the analytics used to render insights for decision making, automated decisions and augmentation of human performance

? Works with board members and other executives to establish the vision for managing data as a business asset

? Establishes the governance of data and algorithms used for analysis, analytical applications, and automated decision making

Job Type: Full-time

Experience: . banking/ Finance institution domain: 1 year (Required) . Data Management: 5 years (Required


  • Data Engineer

    7 days ago


    Qatar Talent Pal Full time

    **Data Engineer**: This job has been sourced from an external job board.

  • Staff Data Engineer

    3 weeks ago


    Qatar Talent Pal Full time

    About Agoda Agoda is an online travel booking platform for accommodations flights and more. We build and deploy cuttingedge technology that connects travelers with more than 3.6 million accommodations globally. Based in Asia and part of Booking Holdings our 6000 employees representing 90 nationalities foster a work environment rich in diversity creativity...

  • Data Engineer

    3 weeks ago


    Doha, Qatar Robert Walters Full time

    Data Engineer – What will you be doing? Identifying and resolving data quality issues.Designing and developing ETL processes.Designing, building and maintaining the end-to-end data pipelines.Taking the lead on the data lake and warehouse platform.Ensuring that data and common stores of code are delivered and maintained. Data Engineer – What will...

  • Data Engineer

    3 weeks ago


    Doha, Qatar Robert Walters Full time

    Data Engineer– What will you be doing?Identifying and resolving dataquality issues.Designing and developing ETLprocesses.Designing, building and maintainingthe end-to-end data pipelines.Taking the leadon the data lake and warehouseplatform.Ensuring that data and common storesof code are delivered and maintained.Data Engineer– What will you...


  • Qatar Talent Pal Full time

    **Data Cloud Engineer Azure**: Job Location: Qatar Job Details: Bachelors / Masters or equivalent degree in Computer Science, Engineering. Below are the required skills for this Data Engineer Role (cloud), Minimum 6-9 years relevant experience in object-oriented/object function scripting languages: Python, Scala, etc and in Python programming and libraries...


  • Qatar Talent Pal Full time

    Data Cloud Engineer AzureJob Location: QatarJob Details: Bachelors / Masters or equivalent degree in Computer Science Engineering. Below are the required skills for this Data Engineer Role (cloud) Minimum 69 years relevant experience in objectoriented/object function scripting languages: Python Scala etc and in Python programming and libraries like Pandas...


  • Doha, Baladīyat ad Dawḩah, Qatar Qatar Airways Full time

    About Your Job:In this role, you will be responsible for leading and managing a team of data engineers to design, build, maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with cross-functional teams across the organization to ensure that the data products are accessible, reliable and...

  • Data Engineer

    3 weeks ago


    Doha, Qatar Falcon Services Full time

    Provide technical and thought leadership forData Engineering and Business Intelligence Create, implement andoperate the strategy for robust and scalable data pipelines forbusiness intelligence and machine learning Develop and maintaincore data framework and key infrastructures Data Warehouse designand data modeling for efficient and cost effective...

  • Data Engineer

    3 weeks ago


    Doha, Qatar Falcon Services Full time

    📍Provide technical and thought leadership for Data Engineering and Business Intelligence 📍Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning 📍Develop and maintain core data framework and key infrastructures 📍Data Warehouse design and data modeling for efficient and cost...

  • Senior Data Engineer

    3 weeks ago


    Doha, Qatar Energy Jobline Full time

    Job Description - Senior Data EngineerNigel Frank International are working alongside a market leading legal firm who are on the search for an experienced Data Engineer to join their growing team. This Azure cloud focused organisation are currently having a huge focus on building out their data centric team, which consists of Data Engineers and Analysts with...

  • Azure Data Engineer

    2 weeks ago


    Doha, Qatar Insight Global Full time

    Must-havesBachelor's degree (computer science, IT/IS, engineering, statistics, supply chain, business, or related field)3+ years of experience in data engineering or related field (software engineering, data analytics, business intelligence, data science)Expert in SQL, with extensive experience writing DML and DDL statementsStrong Python skills,...


  • Qatar Talent Pal Full time

    **Job Purpose Summary**: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming,...

  • Senior Data Engineer

    3 weeks ago


    Doha, Qatar Energy Jobline Full time

    Job Description - Senior DataEngineerNigel FrankInternational are working alongside a market leading legal firm whoare on the search for an experienced Data Engineer to join theirgrowing team. This Azure cloud focused organisation are currentlyhaving a huge focus on building out their data centric team, whichconsists of Data Engineers and Analysts with great...


  • Qatar Talent Pal Full time

    Job Purpose Summary: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design construct test and optimize data pipelines databases data warehouses and other data systems. They also ensure data quality reliability and performance through strong programming database and software...


  • Qatar Talent Pal Full time

    Requirement Azure Data EngineerExperience 6 yrsProject Timing 2 PM 11 PM (2 nd shift)Skills Databricks SQL PysparkDatabricks Certification Good to haveGood comms and problem solving skillsRelevant experience in Azure data engineering: 4 years.Relevant experience in Databricks (PySpark / Scala / SparkSQL): 2 years.Relevant experience in Azure Data Factory...

  • Azure Data Engineer

    2 weeks ago


    Doha, Qatar Insight Global Full time

    Must-havesBachelor'sdegree (computer science, IT/IS, engineering, statistics, supplychain, business, or related field)3+ years ofexperience in data engineering or related field (softwareengineering, data analytics, business intelligence, datascience)Expert in SQL, with extensiveexperience writing DML and DDLstatementsStrong Python skills, including...


  • Qatar Talent Pal Full time

    We are seeking a Cloud Developer for a renowned construction company in Doha. This is a fulltime position based in Doha Qatar.Job Purpose: Data Engineering and Data Science Expert who will be responsible for managing databases analyzing data and implementing ETL processes. The ideal candidate should possess a strong understanding of MSSQL Python programming...


  • Qatar Petro Staff International Full time

    **Petro Staff International** - Published- June 13, 2023- Location- Qatar- Category- International- Job Type- Full-time- Field or Industry- Engineering DESCRIPTION **Department** NON-OPERATED OIL DEVT & TECH SUPPORT **Roles and Responsibilities**: 1. Seismic Data Management: Full lifecycle management of seismic data with inclusion of tape transcription...

  • Big Data Engineer

    3 weeks ago


    Doha, Qatar Virtusa Full time

    Analyze the Authority’s data needs and document the requirements.Refine data collection/consumption by migrating data collection to more efficient channels.Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.Develop test plan and scripts for system testing, support user acceptance testing.Work with the...


  • Doha, Qatar Virtusa Full time

    Snowflake Data Engineering:Design, develop, and maintain Snowflake data warehouses and databases to ensure efficient and scalable storage and retrieval of data.Implement and optimize ETL processes within Snowflake to enable seamless data integration from various sources.Experience in snowflake best practices for error handling, optimization, job layout, job...