Chatbot AAVE Dialect Evaluation

We are seeking native speakers of African American Vernacular English (AAVE) to participate in a research study evaluating chatbot interactions. Please fill out this form if you want to apply for this job.

Eligibility Requirements

• Native AAVE speaker who regularly uses the dialect
• Available starting November 25th, 2024
• Able to commit to a two-week project period

Project Details

Participants will evaluate conversations between chatbots and users, where chatbots assume various professional roles (e.g., Teacher, Nurse). Each evaluation task involves:  

• Reading a 10-turn conversation
• Answering approximately 10 questions about the chatbot's responses
• Using our web-based evaluation platform
• Estimated time per task: 1-2 minutes

Workload and Compensation

All assigned tasks must be completed within the two-week period to receive compensation:

• Total project tasks: 2,000 (distributed evenly among participants)
• Expected individual workload: 100-400 tasks
• Compensation rate: $0.30 per completed task
• Example: 200 tasks = $60 compensation

Final task distribution will depend on the number of participants. You will be notified of your specific task allocation upon acceptance into the study.

Apply Now!