This one is closed
Live roles like this one
-
B
4h ago
Clinical Research Associate (CRA) - Immunology
MSD United States $96k - $151k/yr
- B 3h ago
-
B
3h ago
Associate Creative Director, Art
EVERSANA United States $123k - $176k/yr
-
C
8h ago
Toptal Canada
See every "Professionals Designing Challenging" role →
Get new “Professionals Designing Challenging” roles by email
One email a day with what is new in "Professionals Designing Challenging". Nothing new, no email.
We confirm the address first, and every mail carries an unsubscribe link. Alerts are ours, not a third party's.
Why this grade This listing scored 48/100, which is a D. It lost the most ground on pay transparency. See the breakdown
- Description depth 20 / 20 How much the posting actually says about the work, measured in characters of real text.
- Pay transparency 12 / 25 A published salary range, worth more than any other single factor because it is what a candidate cannot find out without applying.
- Freshness 8 / 15 How recently it was posted. Older postings are likelier to be filled or abandoned.
- Remote clarity 8 / 15 Whether "remote" means anywhere, or is quietly restricted to one country.
- Corroboration 5 / 10 Whether more than one source carries this listing.
- Role specificity 0 / 10 Whether the listing is tagged well enough to tell what the role actually is.
-5 Ghost-job penalty — Deducted for signals that this posting may not be a real, currently-open role — staleness, repeated relisting, or talent-pool language.
Every figure above is arithmetic over the posting itself — its salary field, its text, its age, its tags and how many sources carry it. How the grades work →
What We're Researching
We're running a paid study to build a bench of people who are exceptionally good at designing tasks that expose AI model limitations. By turning real-world workflows into demanding requests, we can better evaluate where current models break down. This initial trial helps us identify individuals suited for ongoing prompt engineering and evaluation work.
How It Works
You will spend about an hour translating a complex workflow from your job or personal life into a demanding prompt that requires reasoning and real-world lookup. After running it in ChatGPT to identify where the model fails, you will refine the prompt until it breaks the system. Finally, you will write a clear grading rubric that a stranger could use to evaluate any AI's attempt at your task. This entire process is screen-recorded, as we are assessing your thought process just as much as the final submitted files.
Who This Is For
We welcome professionals, domain experts, and power users who have deep knowledge of specific workflows. You need to be capable of evaluating an AI's output within seconds and comfortable working on a laptop or desktop with a ChatGPT account. Candidates who excel at this trial will be considered for a long-term bench of evaluators.
What You'll Do
Pick a familiar workflow and convert it into a demanding AI prompt
Test your prompt in ChatGPT to find failure points, making it harder if the AI succeeds
Write a comprehensive rubric for grading the AI's performance
Share your screen, camera, and microphone while completing the task
Submit your prompt, failure notes, rubric, and the generated output file
Who Should Apply
Deep familiarity with a specific professional or personal workflow
Ability to quickly evaluate the accuracy and quality of AI outputs
Access to a laptop or desktop computer
An active ChatGPT account
Comfortable being screen-recorded while thinking through complex tasks
Compensation
$20 one-time
Ready to participate?
Start your paid interview now
About Terac
Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at or on YouTube at @jointerac.
Originally posted on Himalayas
Apply for this role Opens jobs.ashbyhq.com — verified as the employer's own application page
Quick question · anonymous · one tap
Would you apply to this job?
Answer to see what other job seekers said.
Your turn · no account needed
Help the next applicant
You may know something about this listing that we cannot see from here. One tap. No account needed. Signed-in reports earn points once the evidence agrees with you.
I know what it pays
Sign in with Google to earn points for reports — 100 confirmed points buy a week of Early Access.
Where this listing came from
- 28 Aug 2026 Himalayas first sighting
Seen on 1 board over 0 days.