300 jobs found

Newest first

Filters

AI Evaluation Engineer (Python, QA or Security)Mindrift · BahrainPlease submit your CV in English and indicate your level of English proficiency2 days agoPart TimeRemote
AI Evaluation Engineer (Python, QA or Security)Mindrift · KuwaitPlease submit your CV in English and indicate your level of English proficiency2 days agoPart TimeRemote
AI Evaluation Engineer (Python, QA or Security)Mindrift · United Arab EmiratesPlease submit your CV in English and indicate your level of English proficiency2 days agoPart TimeRemote
AI Evaluation Engineer (Python, QA or Security)Mindrift · QatarPlease submit your CV in English and indicate your level of English proficiency2 days agoPart TimeRemote
AI Evaluation Engineer (Python, QA or Security)Mindrift · Saudi ArabiaPlease submit your CV in English and indicate your level of English proficiency2 days agoPart TimeRemote
Aesthetic Dermatologist kuwait immediate hiringTalentspoc · Kuwait City, Al Asimah Governate, KuwaitTalentspoc is urgently seeking a skilled Aesthetic Dermatologist for immediate hiring in Kuwait2 days agoOnsite
Sales Development Representative (Finance & Tax Specialist)Huzzle · EgyptAt Huzzle, we connect exceptional talent with top opportunities at leading companies across the UK, US, Canada, Europe, and Australia2 days agoFull TimeRemote
Sales Development Representative (Finance & Tax Specialist)Huzzle · MoroccoAt Huzzle, we connect exceptional talent with top opportunities at leading companies across the UK, US, Canada, Europe, and Australia2 days agoFull TimeRemote
Sales Development Representative (Insurance Tech)Huzzle · PakistanAt Huzzle, we connect exceptional talent with top opportunities at leading companies across the UK, US, Canada, Europe, and Australia2 days agoFull TimeRemote
Freelance Brand DesignerMindrift · JordanMindrift is looking for a highly skilled Brand Designer to join the Tendem project ( ** https://tendem2 days agoPart TimeRemote
Freelance Brand DesignerMindrift · KuwaitMindrift is looking for a highly skilled Brand Designer to join the Tendem project ( ** https://tendem2 days agoPart TimeRemote
Freelance Brand DesignerMindrift · QatarMindrift is looking for a highly skilled Brand Designer to join the Tendem project ( ** https://tendem2 days agoPart TimeRemote
Freelance Brand DesignerMindrift · Saudi ArabiaMindrift is looking for a highly skilled Brand Designer to join the Tendem project ( ** https://tendem2 days agoPart TimeRemote
Cloud Security & Encryption SpecialistCCDS · Riyadh, Riyadh Province, Saudi ArabiaLocation: On-site – Riyadh, Saudi Arabia2 days agoFull TimeOnsite
Cybersecurity Architecture SpecialistCCDS · Riyadh, Riyadh Province, Saudi ArabiaLocation: On-site – Riyadh, Saudi Arabia2 days agoFull TimeOnsite
Cybersecurity Assurance SpecialistCCDS · Riyadh, Riyadh Province, Saudi ArabiaLocation: On-site – Riyadh, Saudi Arabia2 days agoFull TimeOnsite
Senior Sales Agent - Real Estate (Remote)Namou · Beirut, Beirut Governorate, LebanonAbout Namou Properties2 days agoFull TimeOnsite
Cyber Defense Specialist - Detection & MonitoringCCDS · Riyadh, Riyadh Province, Saudi ArabiaLocation: On-site – Riyadh, Saudi Arabia2 days agoFull TimeOnsite
Junior Legal Operations Specialist -APACRemotePass · PakistanRemotePass is a leading global platform transforming the way businesses access and manage top talent2 days agoFull TimeRemote
Software Engineer (Backend)SHIELD · Bengaluru, Karnataka, IndiaSHIELD is a device-first fraud intelligence platform built on the world’s most persistent device identification technology across applications and platforms2 days agoFull TimeOnsite

AI Evaluation Engineer (Python, QA or Security)

Mindrift

BahrainPart TimeRemote2 days ago

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment. What this opportunity involves We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.

You'll create challenging tasks and evaluation criteria within realistic simulated environments:

Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history
Design tasks from intermediate states of these environments - craft the prompt, define what "solved" means, and ensure the task is solvable by an AI agent
Write tests that verify agent solutions - accept all valid approaches and reject incorrect ones, neither too strict nor too lenient
Iterate on tasks and tests based on QA feedback - review agent solutions, analyze failures, and refine until the evaluation is fair and robust

What this is NOT

Not data labeling
Not prompt engineering
Not writing code from scratch - the agent writes most of the code; you guide and evaluate

What we look for

5+ years in software development
Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
Experience writing tests (functional, integration)
English proficiency - B2+

Why this is hard Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.

How it works Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid

Compensation Up to $50/hr equivalent , depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.

Browse open jobs by market and role

Each link opens a live listing. A market or role is only listed here once it holds a full page of open jobs, so none of them lead to an empty result.

By city and country

Jobs in the UAE148 open jobs
Jobs in Saudi Arabia116 open jobs
Jobs in Dubai102 open jobs
Jobs in Riyadh67 open jobs
Jobs in Abu Dhabi51 open jobs
Jobs in Makkah22 open jobs

By role

Engineering jobs102 open jobs
Consulting jobs87 open jobs
Sales jobs62 open jobs
Nursing jobs41 open jobs
Procurement jobs28 open jobs
Project manager jobs23 open jobs
Customer service jobs22 open jobs

300 jobs found

Browse open jobs by market and role

By city and country

By role

Claim your tabbio link
before it's taken

Ask AI about Tabbio

Product

Platforms

Company

Legal

Jobs by country

Jobs by profession

Ask AI about Tabbio

300 jobs found

Browse open jobs by market and role

By city and country

By role

Claim your tabbio linkbefore it's taken

Ask AI about Tabbio

Product

Platforms

Company

Legal

Jobs by country

Jobs by profession

Ask AI about Tabbio

Claim your tabbio link
before it's taken