Big Data Engineer

Lead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production MetrologyLead System Engineer (big data) - Druid + ElasticSearch + Nifi - admin of tools, devops & cloud Ownership and Production Metrology

2to 4 years of Programming experience in Hadoop, Spark, Scala PythonCritical Thinking and passion to learn deliverHands on experience of Big Data and Cloud TechnologiesHadoop, Spark, Scala, Unix, SQL, Python, Python Flask API, Hive, HQL Basic understanding of Cloud Computing fundamentals AWSBasic understanding of SQL or NoSQL DBsGood written and spoken...

About the jobPosition: Big data developerPrimary skills: Hadoop, hive, spark, awsLocation: BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing...

Analyze the Authoritys data needs and document the requirements.Refine data collection / consumption by migrating data collection to more efficient channels.Plan design and implement data engineering jobs and reporting solutions to meet the analytical needs.Develop test plan and scripts for system testing support user acceptance testing.Work with the...

Analyze the Authoritys data needsand document the requirements.Refinedata collection / consumption by migrating data collection to moreefficient channels.Plan design and implementdata engineering jobs and reporting solutions to meet theanalytical needs.Develop test plan and scriptsfor system testing support user acceptancetesting.Work with the Authoritys...

Analyze the Authority'sdata needs and document therequirements.Refine datacollection/consumption by migrating data collection to moreefficient channels.Plan, design and implementdata engineering jobs and reporting solutions to meet theanalytical needs.Develop test plan and scriptsfor system testing, support user acceptancetesting.Work with the...

Must-havesBachelor's degree (computer science, IT/IS, engineering, statistics, supply chain, business, or related field)3+ years of experience in data engineering or related field (software engineering, data analytics, business intelligence, data science)Expert in SQL, with extensive experience writing DML and DDL statementsStrong Python skills, including...

About Your Job:You will be responsible for designing data models and standards across different data domain within the organisation, promoting data consistency and accessibility for data analytics throughout the organisation. You will be leading the development, validating, publishing, and maintaining of conceptual, logical and physical data models required...

About Your Job:You will be responsible for designing data models and standards across different data domain within the organisation, promoting data consistency and accessibility for data analytics throughout the organisation. You will be leading the development, validating, publishing, and maintaining of conceptual, logical and physical data models required...

The RoleRequiredWe are looking for a Data Engineer with 6-10 years of experience. Proficient in ETL and Data Modeling, responsible for developing databases and provisioning data to support organizational data analytics and insights initiatives. Day-to-day management of data pipelines, loading, and provisioning. Duties include designing, building, and...

About Your Job:In this role, you will be responsible for leading and managing a team of data engineers to design, build, maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with cross-functional teams across the organization to ensure that the data products are accessible, reliable and...

About Your Job:In this role, you will be responsible for leading and managing a team of data engineers to design, build, maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with cross-functional teams across the organization to ensure that the data products are accessible, reliable and...

One of our prestigious client is hiring an Data Architect / Senior Data Developer to join its dynamic team. The role requires strong experience in data analytics and RedHat/CentOS 6. ​Role DescriptionStrong SQL/data analysis and analytic skills background, experience with Business Intelligence, Data Warehousing, Big Data environment. Excellent...

About Your Job:In this role, you are responsible designing, implementing and maintaining enterprise self-service cloud data platform and architecture. You will design and build reference architectures, technical blueprints, accelerators for data product team to build data products. You will work closely with cross-functional teams to understand business...

About Your Job:In this role, you are responsible designing, implementing and maintaining enterprise self-service cloud data platform and architecture. You will design and build reference architectures, technical blueprints, accelerators for data product team to build data products. You will work closely with cross-functional teams to understand business...

About Your Job: In this role you will be responsible for leading andmanaging a team of data engineers to design build maintain scalableand secure data products for multiple business divisions withinQatar Airways. You will collaborate closely with crossfunctionalteams across the organization to ensure that the data products areaccessible reliable and secure....

About Your Job: In this role you will be responsible for leading and managing a team of data engineers to design build maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with crossfunctional teams across the organization to ensure that the data products are accessible reliable and...

About Your Job:In this role, you will create reliable architectures for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis. You will design, implement, maintain a full suite of real-time and batch jobs that fuels our cutting edge data analytics platform to...

About Your Job:In this role, you will be responsible for leading and managing a team of data engineers to design, build, maintain scalable and secure data products for multiple business divisions within Qatar Airways. You will collaborate closely with cross-functional teams across the organization to ensure that the data products are accessible, reliable and...

Nair Systems is currently looking for Data Scientist for our Qatar operations with the following terms & conditions.Requirements: Minimum of 5 years of professional experience as a Data Scientist, with a focus on machine learning, AI, and data analysis in the banking sector, specifically in mobile banking and internet banking. Strong expertise in developing...