Data Engineer

7 days ago

Doha, Qatar Nair System Full time

**Nair Systems **is currently looking for **Data Engineer **for our **Qatar o**perations with the following terms & conditions.

**Technical Skills required**:

- Must have Cloudera Hadoop cluster deployment experience, including but not limited to deploying a Hadoop cluster, maintaining a Hadoop cluster, adding and removing nodes using cluster monitoring tool Cloudera Manager, configuring and upgrading the Cloudera Manager, CDH, CDSW and Kafka etc.
- Experience with relational SQL and NoSQL databases, including Teradata, Postgres and Cassandra.
- Hands-on experience with data delivery teams to setup new Hadoop users, including but not limited to setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Impala and Spark access for the new users.
- Perform installations, configurations, troubleshoot, performance tune, upgrade, backup and recovery of various Bigdata/Hadoop services such as HDFS, Hive, Impala, HBase, Spark, Kerberos.
- Must have Experience on Nifi in cluster deployment, including but not limited to maintaining, administrating, perform configuration change, perform upgrade, design & development of new data flows.
- Experience with big data tools: Hadoop, Hive, Spark, Kafka, etc.
- Strong hands on experience in implementation of Security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation.
- Experience in Cloudera platforms and workloads migration from On-premise to On-premise or On-premise to Cloud (Azure).
- Experience with data pipeline and workflow management tools: Nifi, Airflow, etc.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Scala, etc.
- Experience with Data modeling, create CDM,LDM and PDM using different methodology - Dimensional, 3nf, DataVault etc.
- Strong understanding and experience on Teradata CLDM.
- Strong Experience with design and development of ETL/ELT solution using Informatica Powercenter and Teradata( SQL, Utilities).
- Good understanding of DWH and BI platforms.
- Gathering and processing raw data and translating analyses.
- Evaluating new data sources for acquisition and integration.
- Working directly with the technology and engineering teams to integrate data processing and business objectives.
- Create and maintain optimal data pipeline architecture.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Strong analytic skills related to working with structured and unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- Perform Maintenance and administration activities on DWH and Datalake Platform.
- Evaluate and access new platform/solution to fulfil business/technology requirement. Lead E2E POC and do technical evaluation.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Analyzes designs, creates and implements Cloudera infrastructures, including access methods, device allocations, validation checks, organization and security. Documents and maintain work-instructions, complete audit required tasks

**Domain: Telecom**

**Terms and conditions**
**Joining time frame: 2 weeks (maximum 1 month)**

Ability to commute/relocate:

- Doha: Reliably commute or planning to relocate before starting work (preferred)

  • Data Engineer

    1 week ago

    Doha, Qatar PanData Tech Full time

    **Job description** **_About the job: _** We are looking for a **Data Engineer** with practical experience in developing data systems and pipelines. **_Requirements: _** - At least 3 years of experience in data engineering or related fields. - Strong English-language communication skills. - Professional experience with Python. - Experience in designing,...

  • Data Engineer

    2 weeks ago

    Doha, Qatar Qatar Airways Full time

    **About Your Job**: In this role, you will create reliable architectures for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. You will design, implement, maintain a full suite of real-time and batch jobs that fuels our cutting edge data analytics platform to...

  • Data Engineering Specialist

    6 days ago

    Doha, Baladīyat ad Dawḩah, Qatar Anotech Full time

    Anotech is seeking a highly skilled Data Engineering Specialist to join our team. The successful candidate will have a minimum of five years of experience in data engineering, with expertise in the Informatica suite.As a Data Engineering Specialist, you will be responsible for designing, developing, and optimizing data integration workflows, ensuring...

  • Big Data Engineer

    6 days ago

    Doha, Baladīyat ad Dawḩah, Qatar Anotech Full time

    We are looking for a Big Data Engineer to join our team at Anotech. As a key member of our data engineering team, you will be responsible for designing, developing, and optimizing data integration workflows using the Informatica suite.Your primary responsibilities will include:Designing and developing ETL processes using Informatica PowerCenter and other...

  • Data Engineer

    7 days ago

    Doha, Qatar Qatar Airways Full time

    **About the role** Responsible for creating reliable software programs for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. Responsibilities include building real-time and batch data ingestion pipelines, setting up of data catalogues, data warehouses, data...

  • BI Data Engineer

    2 days ago

    Doha, Qatar Candidzone Full time

    LOOKING FOR POWER BI DATA ENGINEER - Must have at least 3 years’ experience - Contract period: 6 months - Arabic speaker is preferred - End to End Data Engineering implementation experience including but not limited to Data Ingestion framework, Data Quality Framework, Data processing and governance frameworks. - Create and maintain optimum data pipeline...

  • Data Communications Engineer

    5 days ago

    Doha, Baladīyat ad Dawḩah, Qatar Ministry of Public Health - Qatar Full time

    Job SummaryWe are seeking a highly skilled Data Communications Engineer to join our team at the Ministry of Public Health - Qatar. As a key member of our IT department, you will be responsible for the planning, design, and implementation of our data communications infrastructure.The successful candidate will have a strong background in computer/IT...

  • Data Management Engineer

    2 weeks ago

    Doha, Qatar NES FIRCROFT Full time

    Ensure that Contractors comply at all times with safety rules, taking actions as required in case of disregards. Promote safety culture within NOC personnel and contractors as well as reporting of anomalies. Ensure and monitor the safety of personnel and installations as well as protection of the environment in his activities. Organize, specify, and...

  • Data Management Engineer

    1 week ago

    Doha, Qatar Brunel Full time

    Brunel is a global provider of flexible workforce solutions and expertise, connecting specialists with clients across the globe; - We deliver innovative services like Recruitment (people, talent, and training), Logistics (global mobility and travel), Technical Services (project support and setup) and Consultancy to our clients both globally and locally; -...

  • Systems Engineer

    2 weeks ago

    Doha, Qatar Qatar Airways Full time

    **About the role**: Systems Engineer - Middleware & Data Engineering is required as part of the HIA IT Data Science & AI team to: - Expand and optimize our data and data pipeline architecture using middleware and cloud technologies - Experiment with new technologies and concepts to deliver a real positive impact on the airport and its stakeholders. - Enable...

  • Azure Data Engineer

    7 days ago

    Doha, Qatar KBC Technologies Full time

    Data Engineer (Cloud)

  • Data Engineer

    7 days ago

    Doha, Qatar Candidzone Full time

    We are Hiring !!! **Data Engineer / ETL Developer** **Duration - 10 months** - 7+ Years of experience as Data Engineer/ETL Developer - 3+ Years in ADF - 3+ Years of experience in Banking Domain - SAP BODS Experience is a Plus - Advanced knowledge in creating pipelines and dataflows. - Managing Org wide ADF platform (Security, Containers etc.) - Good...

  • Urgent Hiring for Data Engineer

    7 days ago

    Doha, Qatar Candidzone Full time

    Urgent Hiring for IT Position -Data Engineer Work Location: Doha - Availability : Immediate. Duration - 10 Months (Extendable) **Preferred Experience**: - 7+ Years of experience as Data Engineer/ETL Developer - 3+ Years in ADF - 3+ Years of experience in Banking Domain - SAP BODS Experience is a Plus - Advanced knowledge in creating pipelines and...

  • Data Governance Engineer

    5 days ago

    Doha, Qatar PROZ TECHNOLOGIES Full time

    we are excited to extend a job opportunity to you for the position Please find the job description outlining the responsibilities and qualifications for the role below. Data Governance Engineer Location: Qatar Role: Full-time Key Responsibilities: - Implementation: Implement data governance frameworks and practices within the organization. - Data...

  • Power BI Data Engineer

    5 days ago

    Doha, Qatar Candidzone Full time

    LOOKING FOR POWER BI DATA ENGINEER - Must have at least 3 years’ experience - Contract period: 6 months - Arabic speaker is preferred - End to End Data Engineering implementation experience including but not limited to Data Ingestion framework, Data Quality Framework, Data processing and governance frameworks. - Create and maintain optimum data pipeline...

  • Big Data Engineer

    2 weeks ago

    Doha, Qatar Vodafone Full time

    As a bold global technology leader, our products and services touch the lives of millions, as well as lending a huge helping hand to some of the country’s most crucial organisations. From contactless payments to connecting emergency services, our technology delivers some truly exciting initiatives, not to mention the incredible connections we make on a...

  • Power BI Data Engineer

    3 days ago

    Doha, Qatar Candidzone Full time

    Must have relevant experience as BI Data engineer Must have a valid QID Bilingual (Arabic-English) **Job Type**: Temporary Contract length: 6 months Application Question(s): - Your salary expectation **Experience**: - BI Data Engineer: 3 years (preferred) **Language**: - Arabic And English (preferred) License/Certification: - QID (preferred)

  • Senior Manager, Data Engineering

    1 week ago

    Doha, Qatar Qatar National Bank Full time

    Job Purpose Summary: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming, database,...

  • Data Engineer for Informatica Solutions

    13 hours ago

    Doha, Baladīyat ad Dawḩah, Qatar ALPHI FORMWORK AND SOLUTIONS Full time

    **Job Overview**ALPHI FORMWORK AND SOLUTIONS is seeking an experienced Data Engineer to design, develop, and optimize data integration workflows using the Informatica suite.

  • Senior Data Engineer

    2 days ago

    Doha, Qatar Mindstream Full time

    We are hiring for Senior Data Engineer (Focus on Data Pipelines and LLM Support) Location: Qatar Education: BS or MS in Computer Science, Data Engineering, or a related field. Experience: 5+ years of experience in building and managing large-scale data pipelines **Salary**: Based on Merit - Proven experience with ETL processes, data warehousing, and data...