Data Engineer

2 weeks ago

Doha, Qatar Brunel Full time

Technical role responsible for operating and ingesting data into COMPANY data repositories (e.g., Digital Data Platform, Data warehouse, etc.) to ensure the availability of data for data visualization, data analytics and digital use cases by designing, building and reviewing data integration pipelines.
- Maintain close alignment with the data governance, data architecture, data security and overall IS strategy.
- Continuous collaboration with the various COMPANY business entities to ensure the data governance practices are applied on the data repositories (e.g., Data Quality).
- Data Management covers (but not limited to) the following main business entities: Reservoir and
- Geosciences, Field Operations, Drilling and Wells, Logistics, Engineering & Constructions and Major Projects, HR and HSE-Q.
- Data is one of the 5 pillars of IS strategy to enable the value of data analytics and digitalization
- Al Shaheen field produces petroleum data from different COMPANY entities with large data sets with complex data streams (RGS) and interfaces (drilling and production real-time data)
- Technical leadership and strategic direction for the technologies, standards, processes and architectures for data across the enterprise.
- Data and Information management along with its associated concepts, policies and standards in COMPANY
- Handles all types of data in its structured and unstructured data
- Approximately 70 Data Sources
- Approximately 120 Server Applications

**About this role**
- Operate the Digital Data Platform (DDP) to support data analytics, data integration data visualization and digital use cases
- Build DDP components and technology to support COMPANY activities in alignment with the data architect and Digital Project group
- Implement data ingestion requirements following Data Governance, Data Architecture and Data Security principles
- Direct involvement in the Data management lifecycle, from producing data integration mapping specifications, design and validation through to development and production deployments
- Design, Develop & Monitor Data integration pipeline
- Develop, construct, test and maintain data integration architectures including migrating on premises Integration pipelines to Cloud based.
- Align architecture with business requirements
- Identify ways to improve data reliability, performance, efficiency and quality
- Deploy complex analytical algorithms, machine learning and statistical methods using programming languages and tools
- Support data analytics through preparing and developing descriptive, diagnostic, predictive and prescriptive modeling
- Use data to discover patterns and tasks that can be automated
- Develop data set processes and data acquisitions
- Contribute to the design, development, implementation and maintenance of complex data systems and solutions.
- Drive initiatives in collaboration with IS teams especially data architect, data analysts and the various business entities to deliver solutions that maximizes the value of data.
- Evaluate and recommend innovative solutions to mature COMPANY’s data operations and overall data management
- Build and maintain effective working relationships with key entities and stakeholders in COMPANY and other parties as needed.
- Support COMPANY to define new requirements, participating in End user meetings to derive and define the business requirement, propose cost effective solutions for data analytics and familiarize the team with the requirements, specifications, design targets & techniques to support task performance and delivery.
- Review & Propose industry best tools & technology for ever changing business rules and data set from data engineering point of view. Conduct Proof of Concepts (POC) with new tools & technologies to derive convincing benchmarks and deliver value-based solution in Quick time.

**What you need to bring**
- Bachelor’s degree from an accredited university in Information Management or Computer Science or an engineering/business related equivalent.
- Full understanding of Data Discovery, Data Visualization, Data Warehousing, Data Governance (e.g., datalogging, profiling, ownership/stewardship, Data Quality, etc.)
- Strong experience in database technologies and techniques (e.g., SQL, NoSQL, Oracle, etc.)
- Strong hands-on experience designing, developing, deploying, testing and maintaining in Informatica suit (IICS, Lake house management, CDQ MDM, EDC, IDQ, Axon and MDM)
- Technical experience in Informatica Intelligent Cloud Services. (IICS) including Cloud Mass Ingestion (CDMI) and Cloud Data Integration (CDI)
- Strong hands-on knowledge on Informatica administration activities which includes creating connections, upgrades, secure agent installation.
- Identify and understand architectural pieces, provide direction and technical expertise in design, development and systems
- Strong hands-on experience on Azure data services (ADLS, Azure Synapse, Azure SQL, Azure Databricks, etc.)
- Strong experience

  • Data Engineer

    3 weeks ago

    Doha, Qatar Robert Walters Full time

    Data Engineer – What will you be doing? Identifying and resolving data quality issues.Designing and developing ETL processes.Designing, building and maintaining the end-to-end data pipelines.Taking the lead on the data lake and warehouse platform.Ensuring that data and common stores of code are delivered and maintained. Data Engineer – What will...

  • Data Engineer

    3 weeks ago

    Doha, Qatar Robert Walters Full time

    Data Engineer– What will you be doing?Identifying and resolving dataquality issues.Designing and developing ETLprocesses.Designing, building and maintainingthe end-to-end data pipelines.Taking the leadon the data lake and warehouseplatform.Ensuring that data and common storesof code are delivered and maintained.Data Engineer– What will you...

  • Manager Data Engineering

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Qatar Airways Full time

    About Your Job:In this role, you will be responsible for leading and managing a team of data engineers to design, build, maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with cross-functional teams across the organization to ensure that the data products are accessible, reliable and...

  • Data Engineer

    4 weeks ago

    Doha, Qatar Falcon Services Full time

    📍Provide technical and thought leadership for Data Engineering and Business Intelligence 📍Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning 📍Develop and maintain core data framework and key infrastructures 📍Data Warehouse design and data modeling for efficient and cost...

  • Data Engineer

    3 weeks ago

    Doha, Qatar Falcon Services Full time

    Provide technical and thought leadership forData Engineering and Business Intelligence Create, implement andoperate the strategy for robust and scalable data pipelines forbusiness intelligence and machine learning Develop and maintaincore data framework and key infrastructures Data Warehouse designand data modeling for efficient and cost effective...

  • Senior Data Engineer

    3 weeks ago

    Doha, Qatar Energy Jobline Full time

    Job Description - Senior Data EngineerNigel Frank International are working alongside a market leading legal firm who are on the search for an experienced Data Engineer to join their growing team. This Azure cloud focused organisation are currently having a huge focus on building out their data centric team, which consists of Data Engineers and Analysts with...

  • Azure Data Engineer

    2 weeks ago

    Doha, Qatar Insight Global Full time

    Must-havesBachelor's degree (computer science, IT/IS, engineering, statistics, supply chain, business, or related field)3+ years of experience in data engineering or related field (software engineering, data analytics, business intelligence, data science)Expert in SQL, with extensive experience writing DML and DDL statementsStrong Python skills,...

  • Senior Data Engineer

    3 weeks ago

    Doha, Qatar Energy Jobline Full time

    Job Description - Senior DataEngineerNigel FrankInternational are working alongside a market leading legal firm whoare on the search for an experienced Data Engineer to join theirgrowing team. This Azure cloud focused organisation are currentlyhaving a huge focus on building out their data centric team, whichconsists of Data Engineers and Analysts with great...

  • Azure Data Engineer

    2 weeks ago

    Doha, Qatar Insight Global Full time

    Must-havesBachelor'sdegree (computer science, IT/IS, engineering, statistics, supplychain, business, or related field)3+ years ofexperience in data engineering or related field (softwareengineering, data analytics, business intelligence, datascience)Expert in SQL, with extensiveexperience writing DML and DDLstatementsStrong Python skills, including...

  • Big Data Engineer

    4 weeks ago

    Doha, Qatar Virtusa Full time

    Analyze the Authority’s data needs and document the requirements.Refine data collection/consumption by migrating data collection to more efficient channels.Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.Develop test plan and scripts for system testing, support user acceptance testing.Work with the...

  • Snowflake Data Engineer

    3 weeks ago

    Doha, Qatar Virtusa Full time

    Snowflake Data Engineering:Design, develop, and maintain Snowflake data warehouses and databases to ensure efficient and scalable storage and retrieval of data.Implement and optimize ETL processes within Snowflake to enable seamless data integration from various sources.Experience in snowflake best practices for error handling, optimization, job layout, job...

  • Senior Data Engineer

    4 weeks ago

    Doha, Qatar Agoda Full time

    Lead the team technically in improving scalability, stability, accuracy, speed and efficiency of our existing Data systemsBuild, administer and scale data processing pipelinesBe comfortable navigating the following technology stack: Scala, Spark, java, Golang, Python3, scripting (Bash/Python), Hadoop, SQL, S3 etcImprove scalability, stability, accuracy,...

  • Senior Data Engineer

    3 weeks ago

    Doha, Qatar Agoda Full time

    Lead the team technically inimproving scalability, stability, accuracy, speed and efficiency ofour existing Data systemsBuild, administer andscale data processing pipelinesBe comfortablenavigating the following technology stack: Scala, Spark, java,Golang, Python3, scripting (Bash/Python), Hadoop, SQL, S3etcImprove scalability, stability, accuracy,speed and...

  • Data Centre Shift Engineer

    4 weeks ago

    Doha, Qatar Energy Jobline Full time

    Job title: Data Centre Shift EngineerLocation: SloughI am currently recruiting for a Shift Engineer to work for a global leader in the development and operation of sustainable, scalable, high-availability and flexible data centre solutions.The position is and M&E focused maintenance/operational engineering role, working a one-man continental shift on site in...

  • Senior Manager, Data Engineering

    5 days ago

    Doha, Qatar Qatar National Bank Full time

    Job Purpose Summary: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming, database,...

  • Senior Data Engineer

    4 weeks ago

    Doha, Qatar CMS GROUP OF COMPANIES Full time

    Expectations timeline 1 MonthYou have gone through different onboarding sessions covering our product, its current architecture, the relevant data infrastructure, pipelines, and tooling we currently use, learned about the company's origin and current vision, and met colleagues from different departments as part of onboarding as well as weekly virtual...

  • Data Ingestion Engineer mfd

    1 month ago

    Doha, Qatar Siemens Full time

    As a Data Ingestion Engineer, your main responsibilities include developing, managing, and monitoring data pipelines and ensuring the smooth execution and scalability of the data integration service for our customers.In this role, you will actively contribute to strategic programs and projects aimed at driving Siemens towards becoming a data-driven...

  • Senior Data Engineer

    3 weeks ago

    Doha, Qatar CMS GROUP OF COMPANIES Full time

    Expectations timeline 1 MonthYou have gonethrough different onboarding sessions covering our product, itscurrent architecture, the relevant data infrastructure, pipelines,and tooling we currently use, learned about the company'sorigin and current vision, and met colleagues from differentdepartments as part of onboarding as well as weekly virtual...

  • Big Data Engineer

    4 weeks ago

    Doha, Qatar Talent Pal Full time

    Analyze the Authoritys data needs and document the requirements.Refine data collection / consumption by migrating data collection to more efficient channels.Plan design and implement data engineering jobs and reporting solutions to meet the analytical needs.Develop test plan and scripts for system testing support user acceptance testing.Work with the...

  • Data Scientist

    4 weeks ago

    Doha, Qatar Boeing Full time

    Job Responsibilities Conduct Exploratory Data Analysis (EDA) on tabular data or time-series data focused on autonomous flight, aircraft manufacturing, or factory digitalization using machine learning, data/text mining, or statisticsWorks with Data Engineers and MLOps Engineers to derive crucial features from the data processed in ML modelsWorks with a...