We are conducting a study (IRB protocol #STUDY00005074) to understand how AI models perform on visual question answering in the wild. Participate in a 2-4 hours survey and receive a $75 Amazon Gift Card for your time.

Are you Eligible? 

To participate in this study, you must:

1. have a Master's degree or above (master students or PhD students are eligible) in one of the following or related fields:

• Biology/Botany
• Materials
• Geography and the Environment Science
• Medicine/Health
• Music/Art
• Physics
• Astronomy
• Chemistry.

2. be an English-speaking individual (doesn’t have to be a native speaker).

Procedure

The process will be conducted online. You will rate the quality of algorithm-generated answers to questions about images. You will be asked to:

-      Read the instruction document. We will have a 10-minute training process via a phone call or Zoom call to help you get familiar with the procedure. You are NOT required to open the camera. The phone call or Zoom call will NOT be recorded.

-      A link to a website built by the researcher team will be provided to you. You will rate the quality of algorithm-generated answers to questions about images. The amount of time you spent on each sample will be recorded.

-      Record the assessment of each algorithm-generated answer in a provided spreadsheet template.

Compensation:

As compensation for participating in the study, participants will receive a $75 Amazon Gift Card via email.

Location and Duration of Research Activities:

The study will take place remotely. The task is estimated to take 2-4 hours in total and the participant will be given 5 days to finish the study.

How to participate:

If you're interested in contributing to this exciting research, please click the Qualtrics URL below to access our survey: https://utexas.qualtrics.com/jfe/form/SV_0SMgfT9gEhBwnfE

If you have any further questions regarding the study, please feel free to contact chongyanchen_hci@utexas.edu