Middle Data Engineer
5 months ago
Main responsibilities will include creating pipelines with complex ETL logic, making performance optimizations, investigating cases in collaboration with BI and Data Science team Our workflow emphasizes adaptability, collaboration, and focus on delivering value to customers and teammates We look at the entire development process and optimize it as a whole, involving a culture of continuous platform and personal improvement Skills Required Python programming skills, with a focus on code reuse, parallelization, and ensuring reliable pipeline functionality Skills in workflow management frameworks (Airflow) with the ability to define and run complex DAGs Extensive SQL skills, including DML and DDL (ALTER TABLE, GENERATE_ARRAY, LEAD, ) and query performance optimization Py Spark knowledge for ad-hoc Spark jobs, window functions, and Spark SQL for aggregate and join operations Understanding of Data Warehousing and Data Lake concepts, dimensional approach, ability to follow appropriate indexing, partitioning, and other optimizations to support efficient data retrieval 2+ years of experience with cloud providers or proficiency in using Databases/Cloud Storage APIs Responsibilities Create new batch/streaming pipelines for newly appearing databases Participating in integrated storage layer creation, investigating linkage between services Improve/expand pipelines with new tables or fields according to business requests Participate in technical debt management, redefine tables partitioning, create summarised tables and proceed migration, create metadata Use SQL and business context understanding skills to help engineers, BI analysts, and product managers get insights Our Stack GCP platform Big Query Databricks AWS streaming services Tableau, Redash Benefits 100% remote work with ability to work from office in the countries where we have offices - Qatar, Kazakhstan, Tajikistan Free courses and and personal growth activities The opportunity for growth in a mission-driven, well-funded and already profitable start-up Cultural enrichment interacting with Teammates from more than 50+ countries
This job has been sourced from an external job board.
-
Data Engineer
6 months ago
Qatar Talent Pal Full time**Data Engineer**: This job has been sourced from an external job board.
-
Staff Data Engineer
5 months ago
Qatar Talent Pal Full timeAbout Agoda Agoda is an online travel booking platform for accommodations, flights, and more. We build and deploy cutting-edge technology that connects travelers with more than 3.6 million accommodations globally. Based in Asia and part of Booking Holdings, our 6,000+ employees representing 90+ nationalities foster a work environment rich in diversity,...
-
Senior Manager, Data Analysis
6 months ago
Qatar Talent Pal Full time**About QNB**: Established in 1964 as the country's first Qatari-owned commercial bank, QNB Group has steadily grown to become the largest bank in the Middle East and Africa (MEA) region. QNB Group's presence through its subsidiaries and associate companies extends to more than 31 countries across three continents providing a comprehensive range of advanced...
-
Senior Manager, Data Analysis
5 months ago
Qatar Talent Pal Full timeAbout QNB Established in 1964 as the country s first Qatari-owned commercial bank, QNB Group has steadily grown to become the largest bank in the Middle East and Africa (MEA) region. QNB Group s presence through its subsidiaries and associate companies extends to more than 31 countries across three continents providing a comprehensive range of advanced...
-
Data Cloud Engineer Azure
6 months ago
Qatar Talent Pal Full time**Data Cloud Engineer Azure**: Job Location: Qatar Job Details: Bachelors / Masters or equivalent degree in Computer Science, Engineering. Below are the required skills for this Data Engineer Role (cloud), Minimum 6-9 years relevant experience in object-oriented/object function scripting languages: Python, Scala, etc and in Python programming and libraries...
-
Data Cloud Engineer Azure
5 months ago
Qatar Talent Pal Full timeData Cloud Engineer Azure **Job Location**: Qatar **Job Details**: Bachelors / Masters or equivalent degree in Computer Science, Engineering. Below are the required skills for this Data Engineer Role (cloud), Minimum 6-9 years relevant experience in object-oriented/object function scripting languages: Python, Scala, etc and in Python programming and...
-
Senior Manager, Data Engineering
6 months ago
Qatar Talent Pal Full time**Job Purpose Summary**: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming,...
-
Senior Manager, Data Engineering
5 months ago
Qatar Talent Pal Full timeJob Purpose Summary: The incumbent is responsible for building and maintaining the data infrastructure that enables data analysis and data science. They design, construct, test, and optimize data pipelines, databases, data warehouses, and other data systems. They also ensure data quality, reliability, and performance, through strong programming, database,...
-
Service Engineer
2 weeks ago
Qatar Atlas Copco Services Middle East SPC Full time**Service Engineer**: - Functional area: Service- Country: Qatar- City: Qatar- Company name: Atlas Copco Services Middle East SPC- Date of posting: Nov 7, 2024 Our solutions are a key part of most industries - electronics, medical research, renewable energy, food production, infrastructure and many more. Working with us means working with the latest...
-
Senior Associate
3 weeks ago
Qatar QNB Full time**Business Unit** - QNB - Qatar- **Division** - Compliance- **Department** - Audit & Compliance- **Country** - Qatar- **Closing Date** - 01-Feb-2026**About QNB**: Established in 1964 as the country’s first Qatari-owned commercial bank, QNB Group has steadily grown to become the largest bank in the Middle East and Africa (MEA) region. QNB Group’s...
-
Data Engineer
5 months ago
Qatar Talent Pal Full timeRole & responsibilities: - Exp - 5+ yrs - Location - Doha, Qatar - Experience with object-oriented/object function scripting languages: Python, Scala, etc Experience in Python programming and libraries like Pandas, NumPy, SciPy Experience in shell script and simple Linux comman Strong analytic skills related to working with semi-structured datasets like...
-
Consulting Sales Engineer
5 months ago
Qatar Daikin Europe N.V. Full timeDaikin Middle East & Africa (DAME) is a subsidiary of Daikin Industries Limited, a Japanese outstanding company and worldwide the biggest developer, producer and supplier of HVAC-R (heating, ventilation, air conditioning and refrigeration) solutions, including heating pumps and cooling technology. DAME is Daikin’s Middle East and Africa regional HQ. The...
-
Lead Instrumentation Engineer
5 months ago
Qatar MPH Global Services Full timeCategory: Oil and Gas Industry: Oil & Gas City/Country: west bay, Qatar Location: Qatar We are currently recruiting for a Lead Instrumentation Engineer for one of client located in the middle east. Location : Qatar,West Bay Duration : 2 years Attractive package Minimum 15 years Instrumentation & Control engineering experience in oil and gas for offshore...
-
Senior Data Analyst
5 months ago
Qatar Beinex Full time**Highlights**: - Experience **3-5 Years** - Joining Date Immediate or max 30 days’ Notice Period - Qualification Preferably a bachelor’s degree or a master's degree in Engineering, Statistics or Mathematics. **Responsibilities**: - Translating business user stories to technical requirements - Identifying challenges in day-to-day business...
-
Senior Developer Advocate
3 weeks ago
Qatar Prisma Data, Inc. Full time**What does a Senior Developer Advocate do at Prisma?**: Here are some of the most typical responsibilities of a Senior Developer Advocate at Prisma: - ** Creating technical content across mediums**: Write blogs, technical documentation, and tutorials, and produce engaging videos to explain and demonstrate Prisma’s core use cases. - ** Managing social...
-
Snr Project Engineer
5 months ago
Qatar Ably Resources Limited Full timePermanent Qatar Posted 2 hours ago Our leading client, a major operator in the O&G sector, are looking for a Snr Project Engineer to join them on a permanent basis at their HQ in the Middle East. **To be considered, applicants must have the following**: - minimum 12 years’ relevant experience in engineering, project management and execution of Oil & Gas...
-
Snr Project Engineer
6 months ago
Qatar Ably Resources Limited Full timePermanent Qatar Posted 13 mins ago Our leading client, a major operator in the O&G sector, are looking for a Snr Project Engineer to join them on a permanent basis at their HQ in the Middle East. **To be considered, applicants must have the following**: - minimum 12 years’ relevant experience in engineering, project management and execution of Oil & Gas...
-
Snr Project Engineer
5 months ago
Qatar Ably Resources Limited Full timePermanent Qatar Posted 3 hours ago Our leading client, a major operator in the O&G sector, are looking for a Snr Project Engineer to join them on a permanent basis at their HQ in the Middle East. **To be considered, applicants must have the following**: - minimum 12 years’ relevant experience in engineering, project management and execution of Oil & Gas...
-
Refrigeration Sales Engineer
5 months ago
Qatar Daikin Europe N.V. Full timeDaikin Middle East & Africa (DAME) is a subsidiary of Daikin Industries Limited, a Japanese outstanding company and worldwide the biggest developer, producer and supplier of HVAC-R (heating, ventilation, air conditioning and refrigeration) solutions, including heating pumps and cooling technology. DAME is Daikin’s Middle East and Africa regional HQ. The...
-
Service Sales Engineer
5 months ago
Qatar Daikin Europe N.V. Full timeDaikin Middle East & Africa (DAME) is a subsidiary of Daikin Industries Limited, a Japanese outstanding company and worldwide the biggest developer, producer and supplier of HVAC-R (heating, ventilation, air conditioning and refrigeration) solutions, including heating pumps and cooling technology. DAME is Daikin’s Middle East and Africa regional HQ. The...