Remote Part-Time Conversational Data Evaluator

Outlier is a leading AI training platform, powered by Scale AI. As an Outlier Expert, you will engage in diverse projects, contributing to the generation of training data and evaluating AI model performance. About the Opportunity: We are looking for detail-oriented English speakers to review and interact with AI-generated media. In this role, you will conduct live conversations with AI voice models, assess the quality of these exchanges, compare AI-generated images and videos, and provide written insights on any discrepancies you notice. You'll be working remotely and can set your own schedule. Your contributions are vital in shaping how advanced AI systems learn and improve. Through your feedback, we strive to enhance AI's real-world performance. Responsibilities: • Engage in live, scenario-based conversations in English with AI voice models, evaluating their naturalness, usefulness, and clarity. • Compare pairs of AI-generated images and videos to determine which better adheres to the prompts. • Conduct detailed inspections of outputs, including zooming in and replaying, to identify issues like distorted visuals, audio-visual mismatches, and errors. • Rate each output across criteria such as adherence, quality, and realism, followed by a written explanation of your observations. Common Tasks: • Image Evaluations: Analyze and compare two AI-generated images based on a text prompt, judging fidelity to instructions, quality, and apparent AI artifacts. • Video Evaluations: Assess AI-generated videos against specific prompts, or edited videos against their original clips. • Video Caption Labeling: Break down first-person video clips into individual actions, creating precise captions that enhance AI drafts. • Audio and Voice Evaluations: Evaluate AI-generated speech for its naturalness and pronunciation, occasionally recording brief explanations of your assessments. Ideal Qualifications: • Fluent in English with strong written communication skills and a comfortable speaking style. • Exceptional attention to detail with the patience to analyze discrepancies closely. • Ability to conversate in a natural manner and think on your feet during realistic scenarios. • Experience in writing concise, evidence-based evaluations or reviews. • Comfortable making decisions when both options contain flaws. • Bonus: Currently pursuing or holding a Bachelor’s degree or higher. Requirements to Sign Up: • A valid ID and mobile phone from your residence country. • An updated resume highlighting your qualifications. • A LinkedIn profile detailing your educational and work history. Payment: • Project Work: Earn up to $15 per hour. • Additional Incentives: Members earn, on average, an extra 7.5% through Missions, with top performers boosting earnings by an average of 11%. • Payment Schedule: Payments are processed weekly on Tuesdays for tasks completed from the previous week (Tuesday to Monday at midnight UTC), through PayPal, AirTM, or ACH transfer. • Rates vary based on expertise, skills assessment, location, project requirements, and more. Why Join Outlier? • Enjoy flexible work hours without a minimum requirement; set your own work schedule from five to 40+ hours each week. • Gain free access to leading LLMs valued at over $200/month. • Join a community of over 900K Outlier Experts across 52 countries, with over $600M paid to contributors. • Collaborate with industry experts to push the limits of AI models before their public release. How to Apply: • Create an account on Outlier. • Upload your resume. • Upload your valid ID. • Start earning by completing tasks. Currently Accepting Applicants From: Australia, Canada, Ireland, New Zealand, United Kingdom, and United States. Please Note: This is a 1099 contract opportunity on the Outlier.ai platform. You will join Outlier as a freelancer/independent contractor and not as an employee. As this is a freelance role, internships, sponsorship, or employment are not offered. You must be authorized to work in your country of residence. If you are an international student, you may be able to sign up for Outlier if on a visa. Please consult your tax and/or immigration advisor regarding your circumstances.