AI work directory Red Pen Jobs

Generalist Expert

New

Listed pay: $35to 40 / hr

What the posting lists, in US dollars an hour.

Apply on Mercor

If you're hired through a link here and start paid work, Mercor pays this site a referral fee. Your pay is unaffected.

What happens after you click
Location
Remote, no country stated
Terms
Contract, part-time
Posted
· Today

What the work is

The research teams behind the best-known AI models come to Mercor for careful human judgment they can't generate on their own. Your standards and attention become the rubric that frontier AI is graded against.

This is a standing listing for generalists who want AI training and evaluation work, not a specific job opening. It stays open whether or not a matching project is running this week.

New projects start on short notice, so instead of posting and pulling a listing each time, we keep one open per field and draw from it when one begins.

What the work looks like

We match generalists in the network to projects like:

  • Writing prompts and reference answers on everyday questions that have a right answer, with the context a good response has to account for

  • Grading model output on general reasoning: whether the answer is correct, whether it follows the instruction actually given, whether it is complete without padding

  • Flagging where a model is confidently wrong, contradicts itself earlier in the same answer, or answers a question that was not asked

Listings in this field on Mercor have posted at $35 to $40 an hour, set per project by scope and depth.

What we're looking for

  • Careful reading and sound judgment, from a professional or academic background in any field

  • Clear written communication, since most of the work involves explaining your reasoning

  • Comfort with ambiguous tasks, and willingness to flag unclear instructions

Who this is for

This pool is for people whose work does not fit neatly into one of our specialist networks, or who work across several of them. If you looked through our other listings and none of them quite described you, this is the one.

No particular credential is required. What matters is that you read carefully and can say precisely why an answer is wrong.

How it works

Apply here with your resume and confirm where you work from, then take a short AI interview, about 20 minutes total.

We verify your background and add you to the generalist pool.

When a project needs general reasoning work, we invite matching people from the pool to that specific listing. It names the rate, the hours, and the client, and any hiring decision is made there.

What to expect

This listing does not accept or reject candidates, so you will not get a decision on it. We reach out when a project matches your background. Depending on what our clients are running, that can be within a week or several months.

Finishing the domain expert interview and joining every network you qualify for both improve your odds of being matched. You only need to sign up once to be eligible across all of them.

From the Mercor posting.

Applying on Mercor

What happens after you click

  1. The link opens this role on Mercor. Sign up and apply from there.
  2. Upload a resume, complete the assessments the role asks for and verify your work authorisation.
  3. An AI interview of about 20 minutes. Mercor says it usually takes 2 to 4 weeks to hear back.
  4. If Mercor hires you, you are paid weekly, on the Wednesday after each work week, via Stripe. Mercor says first payouts are held for 7 days.
  5. The work is paid by the hour, at the $35–40 this posting lists.
  6. Remote. The posting names no country, so we have not assumed one applies.
Apply on Mercor

If you're hired through a link here and start paid work, Mercor pays this site a referral fee. Your pay is unaffected.

Red Pen Jobs is independent. We are not affiliated with, endorsed by, or acting for Mercor in any way, and we do not recruit on its behalf.

More roles for generalists

Every role we hold for generalists