The Occupation-Specific Reviewer evaluates task submissions requiring deep expertise in specialized fields such as healthcare, law, education, engineering, finance, or software development. This role ensures content is guideline-compliant, professionally accurate, and aligned with real-world standards. As a trusted subject matter expert, you will balance formal evaluation criteria with professional judgment while maintaining strict adherence to safety and scope boundaries.
Key Responsibilities
Technical Review: Evaluate submissions requiring professional or technical domain knowledge.
Validation: Verify factual accuracy, terminology, and real-world applicability.
Compliance & Safety: Ensure outputs remain within scope and avoid unsafe, misleading, or non-compliant guidance.
Quality Assurance: Assess alignment with professional standards, norms, and best practices.
Guideline Adherence: Apply platform rules consistently, prioritizing guidelines over personal preference or industry shortcuts.
Feedback: Provide precise, educational, and corrective feedback grounded in expertise.
Risk Management: Identify high-risk errors related to safety, ethics, or misuse and escalate ambiguous issues.
Documentation: Maintain clear records of review decisions and reasoning.
Required Qualifications
Education: Advanced degree, professional certification, or equivalent experience in a relevant field.
Experience: 5+ years of professional practice in the specific domain.
Proven Track Record: Experience in evaluation, auditing, or supervision, OR a background in teaching, mentoring, and assessing professional work.
Regulatory Knowledge: Strong understanding of professional boundaries, risk, and compliance.
Communication: Excellent written skills suitable for formal, technical feedback.
Preferred Qualifications
Experience reviewing AI-generated content or training data.
Familiarity with domain-specific regulatory or ethical standards.
Ability to translate complex expert knowledge into structured, clear explanations.
Adaptability to evolving guidelines and iterative feedback cycles.
Key Competencies
Risk awareness and safety judgment
Clear, corrective feedback
Maintain strict confidentiality and data protection.
Ensure unbiased and respectful communication.
Apply guidelines consistently across all reviews.
Update evaluation approaches as industry standards evolve.
Compensation & Logistics
Rate: $70–$85 per hour (based on expertise), plus bonuses for key contributions.
Trial: Position begins with a paid trial period.
Payment: Bi-weekly based on tracked and approved hours.
Flexibility: Fully remote and asynchronous; work at your own pace with flexible deadlines.
Employment Type: Contract (Part-time and Full-time options).
Location: Must be based in the United States or Canada.