Archived listing. This role was posted over 30 days ago and is no longer accepting applications. We keep it for reference, but the employer may have already filled it. See today's verified listings.

Gmail & Google Calendar AI Assistant Evaluator

micro1 United States

See live roles like this Save · sign in Alert me to jobs like this

This one is closed

Live roles like this one

See every "Gmail Google Calendar" role →

Salary $15 - $30/hr
Posted 26 Sep 2026
Last seen 26 Sep 2026
Location United States
Lifecycle fresh
Grade B
This listing scored 79/100, which is a B. It lost the most ground on remote clarity. See the breakdown

Every figure above is arithmetic over the posting itself — its salary field, its text, its age, its tags and how many sources carry it. How the grades work →

Data Science Entry level Contractor

Role Title: Gmail & Google Calendar AI Assistant Evaluator

Role Type: Contractor, Remote

Location: United States only

micro1 is engaging Gmail & Google Calendar AI Assistant Evaluators to collaborate on a customer-driven project enhancing AI assistant quality through real-world task evaluation. In this role, you'll use your everyday experience managing your digital life — email, calendars, bookings, and coordination — to help train and evaluate next-generation AI assistants. Your work will shape how AI models handle the real tasks people delegate every day.

Key Responsibilities:

  1. Complete realistic, everyday digital tasks (emailing, scheduling, booking, coordinating) using AI assistant tools under standardized, repeatable conditions.
  2. Give an AI assistant clear instructions for real-world tasks, then carefully review and verify its work for accuracy and completeness.
  3. Apply detailed grading guidelines to evaluate, rank, and annotate assistant responses, providing structured feedback that improves model performance.
  4. Test scenarios involving email threads, calendar invites, online bookings, and multi-person coordination, ensuring coverage of diverse situations and edge cases.
  5. Utilize AI training tools and platforms to record findings and submit evaluation data in alignment with project standards and milestones.
  6. Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
  7. Participate in ongoing quality reviews, incorporating feedback to maintain rigorous evaluation standards.

Required Skills and Qualifications:

  1. Are based in the US, have an iPhone with iMessage, and have a Facebook or Instagram account.
  2. Daily, hands-on use of Gmail and Google Calendar to run your own life: sending emails, accepting invites, scheduling, and rearranging plans.
  3. Regular experience coordinating with others over email or text — setting up meetups, following up on threads, or confirming shared plans and payments.
  4. Comfort booking things online independently, such as restaurants, appointments, travel, or deliveries.
  5. Experience using AI tools for real, practical tasks, with comfort giving an AI assistant instructions and checking its work.
  6. Exceptional attention to detail and accuracy when reviewing AI-generated output.
  7. Strong written communication skills for clear reporting and timely updates on progress and challenges.
  8. Demonstrated time management and self-organization for independent, remote project participation.

Preferred Qualifications:

  1. Prior experience with AI evaluation, data labeling, user testing, or similar feedback-driven projects.
  2. Familiarity with prompt writing and a practical understanding of AI assistant behaviors and limitations.
  3. Experience grading or reviewing AI outputs for accuracy, helpfulness, and safety.

Originally posted on Himalayas

Apply for this role Opens himalayas.app — the link as listed; we have not yet verified it is the employer's own page

Quick question · anonymous · one tap

Would you apply to this job?

Answer to see what other job seekers said.

Description review

63/100 HR standards 62/100 Title ↔ description 45/100 Fit to the official role
Read the marked-up listing →

Your turn · no account needed

Help the next applicant

You may know something about this listing that we cannot see from here. One tap. No account needed. Signed-in reports earn points once the evidence agrees with you.

I know what it pays

What you were offered, quoted in an interview, or paid in this role. A range is fine.

Sign in with Google to earn points for reports — 100 confirmed points buy a week of Early Access.

Where this listing came from

  1. 26 Sep 2026 Himalayas first sighting

Seen on 1 board over 0 days.