This one is closed
Live roles like this one
-
B
3h ago
VivSoft Technologies United States $135k - $140k/yr
-
C
3h ago
Construction Compliance Analyst
Acumenian (now Consertus) United States
-
B
5h ago
Complex Claims Director - Insurance Expert - AI Trainer
mercor United States $80/hr
- C 5h ago
See every "AI Response Evaluator" role →
Get new “AI Response Evaluator” roles by email
One email a day with what is new in "AI Response Evaluator". Nothing new, no email.
We confirm the address first, and every mail carries an unsubscribe link. Alerts are ours, not a third party's.
Why this grade This listing scored 42/100, which is a D. It lost the most ground on pay transparency. See the breakdown
- Remote clarity 15 / 15 Whether "remote" means anywhere, or is quietly restricted to one country.
- Description depth 14 / 20 How much the posting actually says about the work, measured in characters of real text.
- Corroboration 10 / 10 Whether more than one source carries this listing.
- Freshness 8 / 15 How recently it was posted. Older postings are likelier to be filled or abandoned.
- Role specificity 0 / 10 Whether the listing is tagged well enough to tell what the role actually is.
- Pay transparency 0 / 25 A published salary range, worth more than any other single factor because it is what a candidate cannot find out without applying.
-5 Ghost-job penalty — Deducted for signals that this posting may not be a real, currently-open role — staleness, repeated relisting, or talent-pool language.
Every figure above is arithmetic over the posting itself — its salary field, its text, its age, its tags and how many sources carry it. How the grades work →
Headquarters: California
URL: https://imerit.ai/
iMerit is looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts. You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
What you will do
- Interpret conversational context and identify what the user really wanted
- Rate and rank responses against defined quality criteria
- Compare multiple answers and explain in writing why one wins
- Verify factual claims using approved research sources
- Flag tasks that cannot be reliably assessed rather than guessing
What you bring:
- Strong critical thinking and sound judgment in ambiguous cases
- Solid research skills and attention to detail
- Excellent reading comprehension
- Self direction and the discipline to hit deadlines without supervision
Good to know
- Independent contractor engagement for the length of the project.
- Fully remote and flexible.
- You choose your hours as long as volume and deadlines are met.
- Task volume varies with project demand.
To apply: https://weworkremotely.com/remote-jobs/imerit-ai-response-evaluator
Apply for this role Opens weworkremotely.com — the link as listed; we have not yet verified it is the employer's own page
Quick question · anonymous · one tap
Would you apply to this job?
Answer to see what other job seekers said.
Your turn · no account needed
Help the next applicant
You may know something about this listing that we cannot see from here. One tap. No account needed. Signed-in reports earn points once the evidence agrees with you.
I know what it pays
Sign in with Google to earn points for reports — 100 confirmed points buy a week of Early Access.
Where this listing came from
- 08 Sep 2026 We Work Remotely first sighting
- 09 Sep 2026 Company careers page employer ATS also listed the same day
Seen on 2 boards over 30 days.