This one is closed
Live roles like this one
-
B
2h ago
Cybersecurity Engineering & Operations Director
Onit United States $150k - $190k/yr
-
B
2h ago
Urrly United States $225k - $275k/yr
-
B
4h ago
Banza United States $155k - $185k/yr
-
B
4h ago
Program Manager, Cybersecurity
Kobalt.io Canada CA$85k - CA$95k/yr
See every "AI Response Evaluator" role →
Get new “AI Response Evaluator” roles by email
One email a day with what is new in "AI Response Evaluator". Nothing new, no email.
We confirm the address first, and every mail carries an unsubscribe link. Alerts are ours, not a third party's.
Why this grade This listing scored 66/100, which is a C. It lost the most ground on freshness. See the breakdown
- Pay transparency 25 / 25 A published salary range, worth more than any other single factor because it is what a candidate cannot find out without applying.
- Description depth 14 / 20 How much the posting actually says about the work, measured in characters of real text.
- Corroboration 10 / 10 Whether more than one source carries this listing.
- Freshness 8 / 15 How recently it was posted. Older postings are likelier to be filled or abandoned.
- Remote clarity 8 / 15 Whether "remote" means anywhere, or is quietly restricted to one country.
- Role specificity 6 / 10 Whether the listing is tagged well enough to tell what the role actually is.
-5 Ghost-job penalty — Deducted for signals that this posting may not be a real, currently-open role — staleness, repeated relisting, or talent-pool language.
Every figure above is arithmetic over the posting itself — its salary field, its text, its age, its tags and how many sources carry it. How the grades work →
AI/ML research SOLID
iMerit is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you will do
-
Interpret conversational context and identify what the user really wanted
-
Rate and rank responses against defined quality criteria
-
Compare multiple answers and explain in writing why one wins
-
Verify factual claims using approved research sources
-
Flag tasks that cannot be reliably assessed rather than guessing
What you bring:
-
Strong critical thinking and sound judgment in ambiguous cases
-
Solid research skills and attention to detail
-
Excellent reading comprehension
-
Self direction and the discipline to hit deadlines without supervision
Good to know
-
Independent contractor engagement for the length of the project.
-
Fully remote and flexible.
-
You choose your hours as long as volume and deadlines are met.
-
Task volume varies with project demand.
Apply for this role Opens remotive.com — the link as listed; we have not yet verified it is the employer's own page
Quick question · anonymous · one tap
Would you apply to this job?
Answer to see what other job seekers said.
Your turn · no account needed
Help the next applicant
You may know something about this listing that we cannot see from here. One tap. No account needed. Signed-in reports earn points once the evidence agrees with you.
I know what it pays
Sign in with Google to earn points for reports — 100 confirmed points buy a week of Early Access.
Where this listing came from
- 08 Sep 2026 NoDesk first sighting
- 12 Sep 2026 Remotive also listed, 3 days later
Seen on 2 boards over 30 days.