ai evaluation engineer

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.What this opportunity involvesWe're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.You'll create...

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.We are building a dataset to evaluate AI coding agents by creating tasks and evaluation criteria within realistic simulated environments. Tasks involve...

Mindrift is building a dataset to evaluate AI coding agents by creating challenging tasks and evaluation criteria within realistic simulated environments. You will design tasks from intermediate states, craft prompts, and define what constitutes a solvable solution.As part of this project-based opportunity, you will write tests, review agent solutions, and...

Mindrift builds datasets to evaluate AI coding agents in realistic, simulated environments. You will craft tasks, evaluation criteria, and tests to ensure robust assessments of model performance across a believable development history.We seek developers with 5+ years in software, strong Python/JS stacks, Docker and data tooling, plus English proficiency...

Mindrift is seeking a seasoned backend-focused developer task designer. You will craft realistic coding challenges in Docker, assemble self-contained task packages, and write deterministic pytest-based tests to verify fixes. Deliverables include broken code, tests, instructions, and a reference solution.This is project-based, not permanent employment. You...

About This RoleYou will review AI-generated Arabic and English responses and/or generate high-quality bilingual training content, evaluating reasoning quality and step-by-step problem-solving while providing expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for accuracy, clarity,...

Overview: One of our clients based in California, USA is building a new team and looking for 7 highly skilled and motivated AI Engineers globally to join their dynamic team. As an AI Engineer, you will be pivotal in designing, developing, and deploying state-of-the-art AI solutions that enhance the capabilities of our products and services, driving...

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. About The Role You'll design coding tasks that challenge frontier AI coding agents. Each task is a self-contained Docker environment with a broken...

Innodata Inc. seeks detail-oriented Content Evaluators to support an enterprise AI customer support product. You will evaluate AI-generated interactions in Arabic, benchmarking responses against quality rubrics and approved sources.The role is freelance, with a 2-month engagement and an expected commitment of 6 hours per day. You will work with web-based...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. We're building a dataset to evaluate AI coding agents - how well a...

We're looking for a Lead AI Engineer to join our team in Doha, Qatar, in an onsite working mode. In this role, you will lead the design and implementation of AI-driven strategies, architectures and operating models, enabling engineering teams to transition to spec-driven and agentic AI delivery methods. This is a critical position to influence and drive...

Job SummaryThe AI Ops Engineer manages the deployment, monitoring, and maintenance of AI models. This role involves ensuring the reliability, scalability, and performance of AI systems, collaborating with cross-functional teams to optimize AI operations, and troubleshooting issues as they arise.Responsibilities and DutiesDeploy, monitor, and maintain AI...

We are currently looking AI Prompt Engineer our Qatar operations. **Skills**:Design prompts, test outputs, define grounding documents, validate responses Joining time frame: 2 weeks (maximum 1 month)

Nair Systems is seeking an AI Solutions Engineer for its UAE operations, Offshore/Onsite. The role requires 6 to 8 years of experience in AI, ML, and solution architecture, with hands-on work on Azure-based platforms, data processing, and systems integration.You will design and deploy AI solutions and drive governance and regulatory compliance in highly...

Qataryello is undergoing a major data and AI transformation, partnering with senior leadership to embed advanced analytics into core decision-making. The role focuses on identifying and prioritising AI use cases, translating business problems into analytics designs, and defining ROI and success metrics for AI initiatives.You will design data marts and...

Nair Systems is seeking an AI Solutions Engineer for its UAE operations, Offshore/Onsite. The role requires 6 to 8 years of experience in AI, ML, and solution architecture, with hands-on work on Azure-based platforms, data processing, and systems integration.You will design and deploy AI solutions and drive governance and regulatory compliance in highly...

Laotop recherche un Ingénieur Data & AI Senior pour développer des infrastructures AI intégrées et des workflows LLM-powréd. Ce poste nécessite une expertise en GCP et Vertex AI, ainsi qu'une expérience avec les systèmes ML de production.Le candidat idéal sera capable de créer des solutions datées adaptées aux besoins variés. Cette position est...

Laotop recherche un Ingénieur Data & AI Senior pour développer des infrastructures AI intégrées et des workflows LLM-powréd. Ce poste nécessite une expertise en GCP et Vertex AI, ainsi qu'une expérience avec les systèmes ML de production.Le candidat idéal sera capable de créer des solutions datées adaptées aux besoins variés. Cette position est...

Laotop recherche un Ingénieur Data & AI Senior pour développer des infrastructures AI intégrées et des workflows LLM-powréd. Ce poste nécessite une expertise en GCP et Vertex AI, ainsi qu'une expérience avec les systèmes ML de production.Le candidat idéal sera capable de créer des solutions datées adaptées aux besoins variés. Cette position est...

Laotop recherche un Ingénieur Data & AI Senior pour développer des infrastructures AI intégrées et des workflows LLM-powréd. Ce poste nécessite une expertise en GCP et Vertex AI, ainsi qu'une expérience avec les systèmes ML de production.Le candidat idéal sera capable de créer des solutions datées adaptées aux besoins variés. Cette position est...