Data Engineer

5 hours ago


Doha, Qatar Nair System Full time

**Nair Systems **is currently looking for **Data Engineer **for our **Qatar o**perations with the following terms & conditions.

**Technical Skills required**:

- Must have Cloudera Hadoop cluster deployment experience, including but not limited to deploying a Hadoop cluster, maintaining a Hadoop cluster, adding and removing nodes using cluster monitoring tool Cloudera Manager, configuring and upgrading the Cloudera Manager, CDH, CDSW and Kafka etc.
- Experience with relational SQL and NoSQL databases, including Teradata, Postgres and Cassandra.
- Hands-on experience with data delivery teams to setup new Hadoop users, including but not limited to setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Impala and Spark access for the new users.
- Perform installations, configurations, troubleshoot, performance tune, upgrade, backup and recovery of various Bigdata/Hadoop services such as HDFS, Hive, Impala, HBase, Spark, Kerberos.
- Must have Experience on Nifi in cluster deployment, including but not limited to maintaining, administrating, perform configuration change, perform upgrade, design & development of new data flows.
- Experience with big data tools: Hadoop, Hive, Spark, Kafka, etc.
- Strong hands on experience in implementation of Security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation.
- Experience in Cloudera platforms and workloads migration from On-premise to On-premise or On-premise to Cloud (Azure).
- Experience with data pipeline and workflow management tools: Nifi, Airflow, etc.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Scala, etc.
- Experience with Data modeling, create CDM,LDM and PDM using different methodology - Dimensional, 3nf, DataVault etc.
- Strong understanding and experience on Teradata CLDM.
- Strong Experience with design and development of ETL/ELT solution using Informatica Powercenter and Teradata( SQL, Utilities).
- Good understanding of DWH and BI platforms.
- Gathering and processing raw data and translating analyses.
- Evaluating new data sources for acquisition and integration.
- Working directly with the technology and engineering teams to integrate data processing and business objectives.
- Create and maintain optimal data pipeline architecture.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Strong analytic skills related to working with structured and unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Perform Maintenance and administration activities on DWH and Datalake Platform.
- Evaluate and access new platform/solution to fulfil business/technology requirement. Lead E2E POC and do technical evaluation.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Analyzes designs, creates and implements Cloudera infrastructures, including access methods, device allocations, validation checks, organization and security. Documents and maintain work-instructions, complete audit required tasks

**Domain: Telecom**

**Terms and conditions**
**Joining time frame: 2 weeks (maximum 1 month)**

Ability to commute/relocate:

- Doha: Reliably commute or planning to relocate before starting work (preferred)


  • Data Engineer

    2 days ago


    Doha, Qatar PanData Tech Full time

    **Job description** **_About the job: _** We are looking for a **Data Engineer** with practical experience in developing data systems and pipelines. **_Requirements: _** - At least 3 years of experience in data engineering or related fields. - Strong English-language communication skills. - Professional experience with Python. - Experience in designing,...

  • Data Engineer

    7 days ago


    Doha, Qatar Qatar Airways Full time

    **About Your Job**: In this role, you will create reliable architectures for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. You will design, implement, maintain a full suite of real-time and batch jobs that fuels our cutting edge data analytics platform to...

  • Data Engineer

    6 hours ago


    Doha, Qatar Qatar Airways Full time

    **About the role** Responsible for creating reliable software programs for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. Responsibilities include building real-time and batch data ingestion pipelines, setting up of data catalogues, data warehouses, data...


  • Doha, Qatar NES FIRCROFT Full time

    Ensure that Contractors comply at all times with safety rules, taking actions as required in case of disregards. Promote safety culture within NOC personnel and contractors as well as reporting of anomalies. Ensure and monitor the safety of personnel and installations as well as protection of the environment in his activities. Organize, specify, and...


  • Doha, Qatar Brunel Full time

    Brunel is a global provider of flexible workforce solutions and expertise, connecting specialists with clients across the globe; - We deliver innovative services like Recruitment (people, talent, and training), Logistics (global mobility and travel), Technical Services (project support and setup) and Consultancy to our clients both globally and locally; -...

  • Systems Engineer

    7 days ago


    Doha, Qatar Qatar Airways Full time

    **About the role**: Systems Engineer - Middleware & Data Engineering is required as part of the HIA IT Data Science & AI team to: - Expand and optimize our data and data pipeline architecture using middleware and cloud technologies - Experiment with new technologies and concepts to deliver a real positive impact on the airport and its stakeholders. - Enable...

  • Azure Data Engineer

    5 hours ago


    Doha, Qatar KBC Technologies Full time

    Data Engineer (Cloud)


  • Doha, Qatar Candidzone Full time

    Urgent Hiring for IT Position -Data Engineer Work Location: Doha - Availability : Immediate. Duration - 10 Months (Extendable) **Preferred Experience**: - 7+ Years of experience as Data Engineer/ETL Developer - 3+ Years in ADF - 3+ Years of experience in Banking Domain - SAP BODS Experience is a Plus - Advanced knowledge in creating pipelines and...

  • Data Engineer

    6 hours ago


    Doha, Qatar Candidzone Full time

    We are Hiring !!! **Data Engineer / ETL Developer** **Duration - 10 months** - 7+ Years of experience as Data Engineer/ETL Developer - 3+ Years in ADF - 3+ Years of experience in Banking Domain - SAP BODS Experience is a Plus - Advanced knowledge in creating pipelines and dataflows. - Managing Org wide ADF platform (Security, Containers etc.) - Good...

  • Big Data Engineer

    5 days ago


    Doha, Qatar Vodafone Full time

    As a bold global technology leader, our products and services touch the lives of millions, as well as lending a huge helping hand to some of the country’s most crucial organisations. From contactless payments to connecting emergency services, our technology delivers some truly exciting initiatives, not to mention the incredible connections we make on a...


  • Doha, Qatar Qatar National Bank Full time

    Job Purpose Summary: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming, database,...

  • Senior Data Controller

    19 hours ago


    Doha, Qatar Wood PLC Full time

    Wood is currently hiring a Senior IM Engineer to join our team in Qatar on the Shell GTL project. - Thoroughly understand Shell Information Management standards, requirements, and contractual deliverables. - Meeting requirements and completing deliverables per the IMIT Scope of Work, Contract Information Specification and project Design and Engineering...

  • Job Opportunity: Ai

    6 days ago


    Doha, Qatar Qatar Mobility Innovations Center (QMIC) Full time

    **Job Status**: One Year Contract Position (renewable based on mutual interest) **Target Start Date**: Immediately **JOB RESPONS**I**BILITIES**: The main responsibilities of the AI & Data Engineer include but not limited to: - Collaborate with data scientists and business stakeholders to understand project requirements and define **predictive** or...


  • Doha, Qatar Career Maker Full time

    We have an open role for Position Title -**Data Security Engineer** with a well Established Group in **Doha,Qatar**. **Key Responsibilities**: - HSM Integration & Management: Design, deploy, configure, and maintain Utimaco HSMs for cryptographic key storage and processing. Ensure secure generation, storage, and usage of cryptographic keys in line with...

  • Data Architect

    6 hours ago


    Doha, Qatar Candidzone Full time

    We are Hiring !!! **Data Architect** **Duration - 10 months** - Bachelor’s or Master’s degree in Computer Science, Information Technology or related field. - Experience working with credit rating agencies is preferred - Proven experience as a Data Architect, Data Engineer or similar role in the banking or financial services industry. - Strong knowledge...


  • Doha, Qatar Vodafone Full time

    As a bold global technology leader, our products and services touch the lives of millions, as well as lending a huge helping hand to some of the country’s most crucial organisations. From contactless payments to connecting emergency services, our technology delivers some truly exciting initiatives, not to mention the incredible connections we make on a...


  • Doha, Qatar Mindstream Full time

    Data Engineer-Azure-Power BI-locally available in Qatar Duration:6 months & extendable Location:Qatar Budget:16000 QAR Full Package End to End Data Engineering implementation experience including but not limited to Data Ingestion framework, Data Quality Framework, Data processing and governance frameworks. - Create and maintain optimum data pipeline...

  • Systems Engineer

    3 days ago


    Doha, Qatar Qatar Airways Full time

    **About the role**: As Systems Engineer - BI & Data Analyst, you will be required as part of the Information Architecture, Analytics & AI team to: - Unlock business value of data from systems, devices and sensors. - Perform analysis to assess quality, meaning and value of data sets. - Use statistical tools and techniques to identify, analyze, and interpret...

  • Head, Data Management

    6 hours ago


    Doha, Qatar QatarEnergy Full time

    **Primary Purpose of the Job**: Create data management team and practice in collaboration with the business and the Digital team to allow capturing data driven value, ensuring the highest standards of data quality, integrity, and security across the organization. **Principle Accountabilities**: - Recruits and manage skilled data team to build robust data...

  • Sr. Data Architect

    6 hours ago


    Doha, Qatar QatarEnergy Full time

    **Primary Purpose of the Job**: Design data architecture and lead platform implementation, considering scalability, security, and integration with existing systems. Leading the implementation, and overall optimization of data flows related activities. Capturing QatarEnergy Enterprise data model with conceptual logical and physical...