Response Evaluator - Independent Contractor (6 week project)

Learn more about Appen
Appen

Appen

Response Evaluator - Independent Contractor (6 week project)

Remote
Part Time
Paid
  • Responsibilities

    Join the Appen team as an Independent Contractor for Project Aralia, contributing to the advancement of AI technology. In this 6-8 week project, you will play a crucial role in evaluating model responses to various commands, aiding in the refinement and improvement of AI algorithms.

    Responsibilities:

    Read a prompt and evaluate two model responses to each. Use the criteria provided to judge each answer based on three things: whether it's harmless, honest, and helpful. Rate responses based on predetermined criteria by answering several questions. Compare the answers to see which one is better overall and by how much. Maintain a high level of accuracy and consistency in evaluations.

    Key Details:

    • Each unit (command and model responses) takes approximately 5 minutes to evaluate.

    • Contractors have the flexibility to work on an unlimited number of units.

    • Compensation is based on the hours spent actively working in the evaluation tool.

    We're seeking individuals with a strong work ethic, commitment to quality, and attention to detail. Ideally, you can commit to 25+ hours per week over a 6-8 week period. Enjoy the benefits of remote and independent work, offering schedule flexibility.

    Apply to the project today, access available resources to guide, educate, and test your task proficiency.

    Join us in shaping the future of AI technology. Apply now to become a vital part of the Aralia project!

  • Qualifications

    Requirements:

    • Fluent/native speaker of English.

    • Residing in the United States.

    • Age 18 or above.

    • Access to a laptop or PC.

    Qualifications:

    • Sign relevant project contracts and/ or agreements.

    • Complete a short 5-minute survey.

    • Complete a Guidelines Quiz (approx. 15mins) to ensure you understand LLM based modelling.

    • Complete a Task Test (approx. 30 minutes) to ensure you understand the project and the work that will need to be done.

    • Complete an identity check to validate your identity.

  • Compensation
    $22/ hour
  • Industry
    Information Technology and Services
  • About Us

    Appen is a leader in AI enablement for critical tasks such as model improvement, supervision, and evaluation. To do this we leverage our global crowd of over one million skilled contractors, speaking over 180 languages and dialects, representing 130 countries. In addition, we utilize the industry's most advanced AI-assisted data annotation platform to collect and label various types of data like images, text, speech, audio, and video.

    Our data is crucial for building and continuously improving the world's most innovative artificial intelligence systems and Appen is already trusted by the world's largest technology companies. Now with the explosion of interest in generative AI, Appen is helping leaders in automotive, financial services, retail, healthcare, and governments the confidence to deploy world-class AI products.

    At Appen, we are purpose driven. Our fundamental role in AI is to ensure all models are helpful, honest, and harmless, so we firmly believe in unlocking the power of AI to build a better world. We have a learn-it-all culture that values perspective, growth, and innovation. We are customer-obsessed, action-oriented, and celebrate winning together.

    At Appen, we are committed to creating an inclusive and diverse workplace. We are an equal opportunity employer that does not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.