Data Engineer, Modelling

2 weeks ago

Doha, Baladīyat ad Dawḩah, Qatar tlnt Full time
The Role

Required

We are looking for a Data Engineer with 6-10 years of experience. Proficient in ETL and Data Modeling, responsible for developing databases and provisioning data to support organizational data analytics and insights initiatives. Day-to-day management of data pipelines, loading, and provisioning. Duties include designing, building, and maintaining batch or real-time data pipelines in production, optimizing data infrastructure, developing ETL processes for data extraction, and preparing raw data for consumption. Experience with on-premises and Cloud-based solutions, data modeling, and workflow management tools. Advanced SQL skills and expertise in building and optimizing 'big data' data pipelines. ails working closely with business users, gathering feedback, and providing technical support as required. The ideal person will:
  • Designing, constructing, and ensuring the ongoing operation of batch or real-time data pipelines in a production environment.
  • Managing and fine-tuning the essential data infrastructure to facilitate accurate data extraction, transformation, and loading from a wide range of data sources.
  • Crafting ETL (Extract, Transform, Load) processes to facilitate data extraction and manipulation from multiple sources, including the automation of data workflows like data ingestion, aggregation, and ETL processing.
  • Converting raw data stored in Data Warehouses into accessible datasets suitable for both technical and non-technical stakeholders. Collaborating with data scientists and key functional leaders in sales, marketing, and product to implement machine learning models for production use.
  • Possessing a comprehensive understanding of both on-premise and Cloud-based solutions (e.g., AWS, Azure, GCP), and demonstrating strong proficiency in the creation of data pipelines, data modeling, and the management of workflow tools such as Airflow and Azkaban.
  • Demonstrating a proven ability to work effectively both as an independent contributor and as a team player.
  • Showcasing advanced knowledge of SQL and extensive experience in working with relational databases, including query authoring (SQL), along with familiarity with various database systems.
  • Displaying a track record of building and optimizing data pipelines, architectural structures, and datasets associated with 'big data' environments.

The Person

  • Bachelor's degree in a relevant field, preferably in Computer Science or Information Technology.
  • A solid track record of 6-10 years of professional experience in data engineering and data modeling.
  • Proficiency in the design, construction, and maintenance of data pipelines for batch and real-time processing in production.
  • Proven expertise in managing and optimizing data infrastructure to enable accurate data extraction, transformation, and loading from a diverse range of data sources.
  • Demonstrated ability to design and implement ETL (Extract, Transform, Load) processes, including the automation of data workflows, such as data ingestion, aggregation, and ETL processing.
  • Strong data transformation skills and the capacity to convert raw data in Data Warehouses into consumable datasets for technical and non-technical stakeholders.
  • Collaborative skills to partner with data scientists and functional leaders in sales, marketing, and product to deploy machine learning models in production.
  • A comprehensive understanding of both on-premise and Cloud-based solutions (e.g., AWS, Azure, GCP).
  • Proficiency in creating data pipelines, data modeling, and managing workflow tools like Airflow and Azkaban.
  • Proven ability to work effectively both as an independent contributor and as part of a team.
  • Advanced SQL knowledge and extensive experience working with relational databases, including query authoring (SQL), and familiarity with a variety of database systems.
  • A strong track record in building and optimizing 'big data' data pipelines, architectural structures, and datasets.

Note: Preferred candidates will be in Doha or currently working in Qatar

Our client is an equal opportunity employer, and we celebrate diversity and are committed to creating an inclusive environment for all.

Note: This job description is intended to convey information essential to understanding the scope of the position and is not an exhaustive list of skills, efforts, duties, responsibilities, or working conditions associated with it.

Skills: gcp,azkaban,aws,sql,etl,data extraction,azure,data warehouses,data modeling,airflow,machine learning
#J-18808-Ljbffr

  • Enterprise Data Modeler

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Brunel Full time

    Works directly with the Data Architect to capture the Enterprise Data Model; Create data models upon need for support a use case or a requirement; Exposure to all COMPANY data.About this role Understand, analysing and translating business requirements into longterm solution data models; Evaluating existing data systems and generate Physical data model,...

  • Data Modelling Architect

    4 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Qatar Airways Full time

    About Your Job:You will be responsible for designing data models and standards across different data domain within the organisation, promoting data consistency and accessibility for data analytics throughout the organisation. You will be leading the development, validating, publishing, and maintaining of conceptual, logical and physical data models required...

  • Data Modelling Architect

    2 months ago

    Doha, Baladīyat ad Dawḩah, Qatar Qatar Airways Full time

    About Your Job:You will be responsible for designing data models and standards across different data domain within the organisation, promoting data consistency and accessibility for data analytics throughout the organisation. You will be leading the development, validating, publishing, and maintaining of conceptual, logical and physical data models required...

  • Data Engineer

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Falcon Services Full time

    Provide technical and thought leadership forData Engineering and Business Intelligence Create, implement andoperate the strategy for robust and scalable data pipelines forbusiness intelligence and machine learning Develop and maintaincore data framework and key infrastructures Data Warehouse designand data modeling for efficient and cost effective reporting...

  • Data Engineer

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Falcon Services Full time

    Provide technical and thought leadership for Data Engineering and Business Intelligence Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning Develop and maintain core data framework and key infrastructures Data Warehouse design and data modeling for efficient and cost effective...

  • Data Scientist

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Talent Pal Full time

    About Your Job:In this role as Data Scientist you will play a critical role in helping to extract valuable insights from vast data sets and use those insights to make informed business decisions. You will be responsible for designing and implementing data mining algorithms developing predictive models and communicating your findings to both technical and...

  • AI amp Data Engineer

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Talent Pal Full time

    Apply NowJob Opportunity: AI & Data EngineerJob Status: One Year Contract Position (renewable based on mutual interest)Target Start Date : ImmediatelyThe Qatar Mobility Innovations Center (QMIC confidential ) Doha Qatar invites applications for AI & Data Engineer to join our technology & applied research department and work on cuttingedge AI projects.JOB...

  • E3D Modeler

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Drawlines Consult WLL Full time

    Drawlines is among the leading BIM & CAD design solution firms. We build success and reputation for our clients with high-quality and cost-effective BIM modeling, CAD drafting, Design Support, Interior design, and Engineering Workforce solutions. Over the years, we have partnered in delivering numerous small, medium, and mega projects across GCC and...

  • Data Engineer

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Precision Hire Solution Full time

    As a Data Engineer you will be responsible for the development of PowerBI dashboards and data pipelines in the Azure cloud environment. The ideal candidate will support in transforming raw data into actionable insights enabling informed decisionmaking and collaborate closely with data analysts business stakeholders and other team members to design develop...

  • Data Engineer, Data

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar UBS Full time

    Qatar Information Technology (IT) Group FunctionsJob Reference #BRCity DohaJob Type Full TimeYour role Are you an analytic thinker? Do you enjoy creating valuable insights with data that enhance client experience and support business growth? Do you want to play a key role in transforming our firm into an agile organization? We're looking for a Data Engineer...

  • Data Engineer

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Anotech Energy Full time

    Responsibilities: Design, develop, and maintain PowerBI dashboards to visualize complex data sets and key performance indicators. Develop and optimize data pipelines using Azure services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics for efficient data ingestion, transformation, and storage. Collaborate with business stakeholders...

  • BIM Modeler

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Candidzone Full time

    Responsiblity:Analyzing and translating business needs into long-term solution data models.Evaluating existing data systems.Working with the development team to create conceptual data models and data flows.Developing best practices for data coding to ensure consistency within the system.Reviewing modifications of existing systems for...

  • Data Scientist

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Talent Pal Full time

    About YourJob:In this role as Data Scientist you will playa critical role in helping to extract valuable insights from vastdata sets and use those insights to make informed businessdecisions. You will be responsible for designing and implementingdata mining algorithms developing predictive models andcommunicating your findings to both technical and...

  • Data Engineer

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Qatar Airways Full time

    About Your Job:In this role, you will create reliable architectures for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. You will design, implement, maintain a full suite of real-time and batch jobs that fuels our cutting edge data analytics platform to...

  • Mep Modelers

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Switzel International Full time

    URGENT REQUIREMENT TO JOIN IMMEDIATELY for MEP BIM ModelersJob Description:MEP BIM Modelers with very good expertise in Revit, Navisworks & AutoCAD(HVAC, Plumbing, fire fighting and Electrical disciplines)Responsibilities: Develop the BIM model in the Revit platform for MEP disciplines. Ensure that the model aligns with the standards and goals set in the BIM...

  • Manager Data Engineering

    4 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Qatar Airways Full time

    About Your Job:In this role, you will be responsible for leading and managing a team of data engineers to design, build, maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with cross-functional teams across the organization to ensure that the data products are accessible, reliable and...

  • Manager Data Engineering

    2 months ago

    Doha, Baladīyat ad Dawḩah, Qatar Qatar Airways Full time

    About Your Job:In this role, you will be responsible for leading and managing a team of data engineers to design, build, maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with cross-functional teams across the organization to ensure that the data products are accessible, reliable and...

  • Senior Infrastructure Engineering Modelers

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar OilExec Full time

    We have urgent openings with one of our reputed client for the position of Senior infrastructure Engineering Modelers.Senior Infrastructure Engineer Modelers (Hourly)Qualifications/Experience:10 Years' Experience in designing and/or modeling infrastructure networks using Infraworks & Civil 3d.Degree in civil engineeringWorked on infra projects in Qatar and...

  • Data Ingestion Engineer mfd

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Siemens Full time

    As a Data Ingestion Engineer, your main responsibilities include developing, managing, and monitoring data pipelines and ensuring the smooth execution and scalability of the data integration service for our customers.In this role, you will actively contribute to strategic programs and projects aimed at driving Siemens towards becoming a data-driven...

  • Data Scientist

    2 weeks ago

    Doha, Baladīyat ad Dawḩah, Qatar Boeing Full time

    Job Responsibilities Conduct Exploratory Data Analysis (EDA) on tabular data or time-series data focused on autonomous flight, aircraft manufacturing, or factory digitalization using machine learning, data/text mining, or statisticsWorks with Data Engineers and MLOps Engineers to derive crucial features from the data processed in ML modelsWorks with a...