Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
Role details
Skills the posting asks for
- Research & source triangulation
- Attention to detail
- Written precision
- Self-direction & reliability
- Analytical thinking
- Research mastery
micro1 is engaging Research Evaluation Specialists (PhD or Masters / Researcher) to contribute expert insight in developing rigorous test material for advanced AI model evaluation as part of a customer's project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Prior experience in AI is required while your domain knowledge brings high value.
Scope of Work
- Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
- Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
- Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
- Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
- Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
- Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.
Preferred Qualifications
- Masters or PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, assistant professor or professor in your domain.
- Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.
- Exceptional analytical thinking, close attention to detail, and strong written communication skills in English.
- Experience sourcing and triangulating information from authoritative references.
- Proven self-direction and reliability in delivering expert-level work independently within remote engagements.
- Skill in composing challenging, original, and methodologically sound questions.
- Prior experience in AI training, data labeling, or model evaluation is required.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.
From the micro1 posting.
Applying on micro1
What happens after you click
- The link opens this role on micro1. Sign up and apply from there.
- An AI interview, 20 to 40 minutes.
- If micro1 hires you, they match you to a project.
- Remote — open to United States, Canada, United Kingdom, Ireland, Australia, New Zealand, Germany, France, Netherlands, Belgium, Austria, Switzerland, Denmark, Sweden, Norway, Finland, Iceland, Italy, Spain, Portugal, Greece, Luxembourg, Malta, Cyprus, Liechtenstein and Monaco.
If you're hired and complete 10 hours, micro1 pays this site a referral fee. Your pay is unaffected.
Red Pen Jobs is independent. We are not affiliated with, endorsed by, or acting for micro1 in any way, and we do not recruit on its behalf.
More about micro1: how it pays, what it does not say, and its referral terms.
Already have a micro1 account?
Tell us, and we'll show you where else this kind of work is open, on platforms you may not have tried yet.
The same kind of work on platforms you may not have tried
You can still apply on micro1 below.
New roles for researchers and academics every Monday
What the email looks like
Bilingual Cantonese Psychologist (PhD)
$100–200 an hour · micro1
Bilingual Japanese Psychologist (PhD)
$100–200 an hour · micro1
Bilingual Vietnamese Psychologist (PhD)
$100–200 an hour · micro1
The same work on another platform
Already have a micro1 account? A platform you have not signed up to yet is where this kind of work is still open to you. Each one screens and pays on its own terms, so check theirs before applying.
More roles for researchers and academics
Pays $30–60 an hour, below the $70 median top rate of the 177 other open hourly researchers and academics roles listed here. 20 openings, among the largest in this profession here. Posted 9 days ago.
We read this listing on micro1 on 23 Oct 2026 and checked it again on 29 Oct 2026. We clean its formatting for readability and safety. View on micro1
Filed under Researchers and academics, Generalists Compare pay rates across professions