Azure Data Engineer
18 hours ago
Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.--Must
Implement data integration and ETL processes to transform raw data--Must
Familiarity with data visualization tools (e.g., Power BI) for creating insighƞ ul dashboards--Must
Background
Client is seeking a skilled and experienced Azure Data Engineer to contribute to the development of a Labor Market Information on System(LMIS). The LMIS will serve as a critical
web-based platform for data entry, data retrieval, and data visualization and also a tool to manage labor-related data, streamline processes, and provide valuable insights for policymaking and
decision-making purposes. The selected candidate will play a key role in designing, implementing,
and maintaining the LMIS.
Objectives
The ideal candidate should have a minimum of 3 to 4 years of hands-on experience working with Microsoft Azure data services, data pipelines, and data integration. As a key member of our data
engineering team, you will play a crucial role in designing, implementing, and optimizing data solutions that empower our organization to derive actionable insights from large and complex
datasets.
The main objectives of the Data Engineer are as follows:
Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.
Collaborate with data scientists, analysts, and stakeholders to understand data requirements, business needs, and use cases.
Implement data integration and ETL processes to transform raw data into usable formats for analysis and reporting.
Optimize and tune data pipelines for performance and efficiency, ensuring reliability and data quality.
Implement data security and privacy best practices, ensuring compliance with industry standards and regulations.
Troubleshoot data-related issues, perform root cause analysis, and implement solutions in a mely manner.
Stay current with emerging trends, tools, and technologies in the data engineering and Azure ecosystem.
Document data pipelines, data flows, and processes for knowledge sharing and future reference.
Expertise in Neo4j Graph Tool is mandatory.
Preferred Qualifications:
Azure certifications, such as Microsoft Certified: Azure Data Engineer.
Experience with data streaming technologies (e.g., Azure Stream Analytics).
Familiarity with data visualization tools (e.g., Power BI) for creating insighƞ ul dashboards and reports.
Knowledge of DevOps practices for CI/CD in data engineering pipelines.
Bachelor's degree in Computer Science, Information Technology, or a related field.
Minimum of 3 to 4 years of hands-on experience as a data engineer, with a focus on Azure data services.
Proficiency in Azure Data Factory, Azure Databricks, and other relevant Azure services.
Strong expertise in data modeling, data integration, and ETL processes.
Experience with SQL, NoSQL, and data warehousing concepts.
Programming skills in languages such as Python, Spark, or Scala.
Knowledge of data security, privacy, and compliance best practices.
Excellent problem-solving skills and the ability to work collaboratively in a fast-paced
environment.
Strong communicate on skills to work effectively with cross-functional teams and
stakeholders.
-
Azure Data Engineer
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar Mindstream Full timeWe are seeking a highly skilled Azure Data Engineer with extensive experience in building, optimizing, and managing scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise in Azure Databricks, Data Factory, Data Lake Storage, and Event Hub, along with strong programming and data engineering skills.Required Skills and...
-
Azure Data Engineer
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar TAT IT Technolgies Full timeWe have an urgent requirement for Azure Data Engineer for our client based in QatarDesign, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and other Azure services.--MustImplement data integration and ETL processes to transform raw data--MustFamiliarity with data visualization tools (e.g., Power BI) for creating insighƞ...
-
Azure Data Engineer
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar emagine Full timeSummary:The Azure Data Engineer will be pivotal in shaping the data-driven culture of the organization by designing, developing, and maintaining the data architecture necessary for effective storage, processing, and analysis of data. This role focuses on ensuring data is available, clean, and compliant for various business needs.Main Responsibilities:Design,...
-
Azure Data Engineer
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar Madre Integrated Engineering Full timeAbout the RoleThe Azure Data Engineer will play a critical role in designing and implementing data solutions that drive business insights and decision-making.Responsibilities8+ years of experience as an Azure Data Engineer or similar role.Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub.Proficiency...
-
Azure DevOps Engineer – Data Platforms
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar Starlink Qatar Full time𝗗𝗲𝘀𝗰𝗿𝗶𝗽𝘁𝗶𝗼𝗻:We are seeking an experienced Azure DevOps Engineer to join our data platform team. In this role, you will be pivotal in designing, building, and maintaining robust CI/CD pipelines for our Azure-based data solutions. You will leverage your expertise in Azure DevOps, Azure Databricks, and Azure Data Factory to...
-
Data & AI Architect – Microsoft Azure
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar COZMALABS Full timeWe are seeking an experienced Data & AI Architect – Microsoft Azure to design, architect, and lead the implementation of scalable, secure, and high-performing data and artificial intelligence solutions on the Azure platform. The ideal candidate will work closely with business stakeholders, data engineers, data scientists, and application teams to translate...
-
Data & BI Engineer
2 weeks ago
Doha, Baladīyat ad Dawḩah, Qatar K20S Information Technology Est Full timeJob Title: Data & BI EngineerExperience: 4+ yearsLocation: Qatar OnsiteJob Summary:We're seeking an experienced Data & BI Engineer to design, develop, and maintain robust data pipelines, data models, and analytics solutions. The ideal candidate will have expertise in data engineering, database administration, and business intelligence. You will collaborate...
-
Azure DevOps
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar Madre Integrated Engineering Full timeAbout the RoleProven experience with Azure DevOps and implementing CI/CD pipelines. Strong knowledge of Azure data services, specifically Azure Databricks and Azure Data Factory. Proficiency in Databricks Asset Bundle for Databricks Ci/CD.Experience with scripting and automation tools (e.g., PowerShell, Python). Experience in implementing selective...
-
Azure DevOps
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar Mindstream Full timeProven experience with Azure DevOps and implementing CI/CD pipelines.Strong knowledge of Azure data services, specifically Azure Databricks and Azure Data Factory.Proficiency in Databricks Asset Bundle for Databricks Ci/CD.Experience with scripting and automation tools (e.g., PowerShell, Python).Experience in implementing selective deployment for ADF data...
-
Azure DevOps
18 hours ago
Doha, Baladīyat ad Dawḩah, Qatar Mindstream Full timeProven experience with Azure DevOps and implementing CI/CD pipelines.Strong knowledge of Azure data services, specifically Azure Databricks and Azure Data Factory.Proficiency in Databricks Asset Bundle for Databricks Ci/CD.Experience with scripting and automation tools (e.g., PowerShell, Python).Experience in implementing selective deployment for ADF data...