Databricks Engineer

1 week ago

Doha, Qatar Codvo.ai Full time

**Data Engineer - Databricks**

**About Us**

At Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us to be part of a team that solves complex data challenges with creativity and cutting-edge technology.

**Role Overview**

We are looking for a highly skilled Data Engineer a deep understanding of asset-heavy industries such as oil & gas, manufacturing, or utilities and expertise in Databricks to design, develop, and optimize end-to-end data pipelines, data platforms, and analytics solutions. This role combines strong data engineering, cloud platform expertise, and software engineering skills to deliver scalable, production-grade solutions.

**Key Responsibilities**
- Design and develop ETL/ELT pipelines on Databricks (PySpark, Delta Lake, SQL).
- Architect data models (batch and streaming) for analytics, ML, and reporting.
- Optimize performance of large-scale distributed data processing jobs.
- Implement CI/CD pipelines for Databricks workflows using GitHub Actions, Azure DevOps, or similar.
- Collaborate with data scientists, analysts, and business stakeholders to deliver solutions.
- Ensure data quality, lineage, governance, and security compliance.

**Required Skills & Qualifications**
- Core Databricks Skills:

- Strong in PySpark, Delta Lake, Databricks SQL.
- Experience with Databricks Workflows, Unity Catalog, and Delta Live Tables.
- Programming & Full Stack:

- Python (mandatory), SQL (expert).
- Exposure to Java/Scala (for Spark jobs).
- Knowledge of APIs, microservices (FastAPI/Flask), or basic front-end (React/Angular) is a plus.
- Cloud Platforms:

- Proficiency with at least one: Azure Databricks, AWS Databricks, or GCP Databricks.
- Knowledge of cloud storage (ADLS, S3, GCS), IAM, networking.
- DevOps & CI/CD:

- Git, CI/CD tools (GitHub Actions, Azure DevOps, Jenkins).
- Containerization (Docker, Kubernetes is a plus).
- Data Engineering Foundations:

- Data modeling (OLTP/OLAP).
- Batch & streaming data processing (Kafka, Event Hub, Kinesis).
- Data governance & compliance (Unity Catalog, Lakehouse security).

**Nice-to-Have**
- Experience with machine learning pipelines (MLflow, Feature Store).
- Knowledge of data visualization tools (Power BI, Tableau, Looker).
- Exposure to Graph databases (Neo4j) or RAG/LLM pipelines.

**Qualifications**
- Bachelor’s or Master’s in Computer Science, Data Engineering, or related field.
- 4-7 years of experience in data engineering, with at least 2 years on Databricks.
- 2+ years of experience in asset-heavy industries (e.g., oil & gas, utilities, manufacturing).

**Soft Skills**
- Strong problem-solving and analytical skills.
- Ability to work in fusion teams (business + engineering + AI/ML).
- Clear communication and documentation abilities.

Domain - Oil & Gas

Location - Doha, Qatar

  • Azure DevOps

    4 days ago

    Doha, Qatar Mindstream Full time

    Role: Azure DevOps (Data) Engineer Location: Qatar Duration: 1 Year and extendable **Salary**: Best in market Experience: 5+ Years Education: Bachelor's degree in Computer Science, Information Technology, or related field. - Proven experience with Azure DevOps and implementing CI/CD pipelines. - Strong knowledge of Azure data services, specifically...

  • Azure Data Engineer

    3 days ago

    Doha, Baladīyat ad Dawḩah, Qatar Mindstream Full time 120,000 - 180,000 per year

    We are seeking a highly skilled Azure Data Engineer with extensive experience in building, optimizing, and managing scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise in Azure Databricks, Data Factory, Data Lake Storage, and Event Hub, along with strong programming and data engineering skills.Required Skills and...

  • Azure Data Engineer

    4 days ago

    Doha, Qatar Mindstream Full time

    Required Skills and Qualifications: - 8+ years of experience as an Azure Data Engineer or similar role. - Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub. - Proficiency in programming languages such as PySpark, Scala, or SQL. - Experience with data modeling, data warehousing, and big data...

  • Azure DevOps

    4 days ago

    Doha, Qatar Mindstream Full time

    Proven experience with Azure DevOps and implementing CI/CD pipelines. - Strong knowledge of Azure data services, specifically Azure Databricks and Azure Data Factory. - Proficiency in Databricks Asset Bundle for Databricks Ci/CD. - Experience with scripting and automation tools (e.g., PowerShell, Python). - Experience in implementing selective deployment for...

  • Azure DevOps Engineer

    3 days ago

    Doha, Baladīyat ad Dawḩah, Qatar Skillspark Full time 90,000 - 120,000 per year

    We are looking for an Azure DevOps Engineer for a 6-month extendable contract based in Doha, Qatar. This is an urgent requirement, so candidates available on short notice will be prioritized.Key Responsibilities:Design, develop, and manage CI/CD pipelines for Azure Databricks and Azure Data Factory.Work closely with data engineering and software development...

  • Principal Engineer

    1 day ago

    Doha, Baladīyat ad Dawḩah, Qatar Codvo Full time 120,000 - 180,000 per year

    Senior Technical Lead (Data & AI)(Category – Principal Engineer / Technical Lead)Sector: Oil and GasLocation: Doha, QatarAbout UsAt Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join us...

  • Principal Engineer

    1 day ago

    Doha, Baladīyat ad Dawḩah, Qatar Codvo Full time 120,000 - 250,000 per year

    Senior Technical Lead (Data & AI)(Category – Principal Engineer / Technical Lead)Sector: Oil and GasLocation: Doha, Qatar About UsAt Codvo, we are committed to building scalable, future-ready data platforms that power business impact. We believe in a culture of innovation, collaboration, and growth, where engineers can experiment, learn, and thrive. Join...

  • Azure DevOps

    3 days ago

    Doha, Baladīyat ad Dawḩah, Qatar Mindstream Full time 90,000 - 120,000 per year

    We are looking for an experienced Azure DevOps (Data) Engineer to design, implement, and maintain CI/CD pipelines for data solutions in Azure environments, focusing on automation, quality, and reliability.Key Requirements:Proven experience with Azure DevOps and implementing CI/CD pipelines.Strong knowledge of Azure data services, specifically Azure...

  • Azure Data Engineer

    4 days ago

    Doha, Qatar Mindstream Full time

    Role: Azure Data Engineer Location: Qatar Duration: 1 Year and extendable **Salary**: Best in market Experience: 8+ Years Education: Bachelor’s degree in Computer Science, Information Technology, or a related field. - Strong expertise in Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Event Hub - Proficiency in...

  • Azure Data Engineer

    1 day ago

    Doha, Baladīyat ad Dawḩah, Qatar Connect Vision International Full time 60,000 - 120,000 per year

    Job Title:Azure Data EngineerLocation:Doha, Qatar (Onsite)Employment Type:Permanent – Full-time or Contract (Open to both)Compensation:Competitive salary / rate (open and negotiable based on experience)Job DescriptionWe are seeking an experiencedAzure Data Engineerto join our team inDoha, Qatar. The ideal candidate will have deep technical expertise...