Consumer Services Specialist | $45/hr Remote

Position: Rubrics-Trained Generalist Expert

Type: Hourly contract

Compensation: $40–$45/hour

Location: Remote

Commitment: 10–40 hours/week

Role Responsibilities

• Create and evaluate structured rubrics for user-generated shopping and consumer decision-making tasks.
• Design prompts that simulate realistic consumer behavior and shopping scenarios.
• Ensure rubric outputs meet defined quality standards and align with task objectives.
• Assess nuanced task performance and consistency using rubric-based evaluation methods.
• Collaborate asynchronously with AI research teams to refine rubric coverage and effectiveness.

Requirements

• Prior experience designing, applying, or evaluating structured rubrics.
• Familiarity with AI training, evaluation workflows, or prompt engineering tasks.
• Strong attention to detail and ability to evaluate nuanced task quality.
• Excellent written communication and organizational skills.
• Comfortable working independently in a remote, deliverables-driven environment.

Application Process (Takes 20 Min)

• Upload resume
• Interview (15 min)
• Submit form