Senior Data Engineer

we are excited to extend a job opportunity to you for the position

Please find the job description outlining the responsibilities and qualifications for the role below.

**Job Title: Senior Data Engineer**
Position Type: Full-Time
Location: Doha, Qatar
- **Role Objective**:

- The Senior Data Engineer will be responsible for maintaining, improving, cleaning, and manipulating data within the organization’s operational and analytics databases. The role involves collaborating with software engineers, data analytics teams, data scientists, and data warehouse engineers to meet database requirements, design ELT/ETL pipelines, and troubleshoot data-related issues. Additionally, the Senior Data Engineer will drive improvements in data reliability and quality, ensuring seamless data extraction, transformation, and processing to support advanced analytics and predictive modeling initiatives.
- **Key Responsibilities**:

- **Operational Responsibilities**:

- Create and maintain scalable and optimized data pipeline architecture.
- Assemble large, complex datasets that meet business requirements.
- Identify, design, and implement internal process improvements (e.g., automation, optimization of data delivery, infrastructure redesign for scalability).
- Build infrastructure for efficient data extraction, transformation, and loading (ETL) from various data sources.
- Drive the design, modeling, implementation, and operation of large datasets (structured and unstructured).
- Evaluate and implement distributed storage and querying techniques for data systems.
- Design and implement monitoring systems for data service platforms.
- Design and implement Data Lakes and Data Warehouses.
- Stay current with industry trends and best practices, leveraging knowledge for process and system improvements.
- Develop and maintain technical documentation and operational procedures related to data engineering responsibilities.
- **Key Interactions**:

- Internal:

- Practice Managers
- PMO and Project Teams
- Delivery Team
- Architects
- External:

- Vendors and Suppliers
- Customers
- Sales
- Consultants
- **Educational Qualifications**:

- Bachelor’s Degree in Computer Science or Engineering.
- Azure Certified Data Engineer.
- Databricks Certified Data Engineer (Associate/Professional).
- **Skills & Experience**:

- Proven experience in building, optimizing, and monitoring big data pipelines and architectures.
- Production experience in building metadata-driven ELT/ETL frameworks for data ingestion and processing.
- Extensive hands-on experience with Data Lakehousing, Data Warehousing, Data Processing using Databricks, Azure ADLS Gen2, Azure Data Factory, and Azure Functions.
- Experience with streaming data processing using Spark Structured Streaming, Azure Stream Analytics, Event Hubs, Azure Data Explorer.
- Skilled in debugging data pipelines and improving data observability.
- Experience working with relational and NoSQL databases (e.g., Azure SQL Database, Cosmos DB), and data lakes.
- Knowledge of data management and governance tools like Azure Purview.
- Proficiency in programming and scripting languages: Python, Scala, Bash, Azure CLI, PowerShell.
- Strong understanding of CI/CD practices and technologies, particularly Azure DevOps.
- Experience with big data tools such as Hadoop, Spark, Kafka, Storm, Hive, and Hbase is a plus.
- **Behavioral Skills**:

- Strong communication skills, capable of interacting effectively with Architects and stakeholders.
- Excellent project management and organizational abilities.
- Ability to prioritize and work under pressure with mínimal supervision.
- Exceptional attention to detail and multi-tasking capabilities.
- A collaborative team player with the ability to work cross-functionally.
- **About Proztec**:
Proz Technologies (PROZTEC) is a leading specialist and a reputed firm in Information and Communications Technology (ICT) with a headcount of 300+ employees based in Doha, Qatar (A Tax-Free Country). We are excited about the possibility of welcoming you to our team. Please share your resume at your earliest convenience.

**Job Type**: Contract
Contract length: 12 months