Study on Human vs. AI Guidance in Programming
Please read the information below carefully before starting. The study takes approximately 60 minutes and must be completed on a laptop or PC (not a phone or tablet).
After clicking Start Study, you will be taken to a browser-based programming environment (VSCode). The environment may take some time to start, so please do not close or refresh the tab while it is loading.
A terminal will open automatically on the right side of the screen. Wait there until you are connected to the Teaching Assistant (TA) or AI Bot before starting the tasks. This may take a moment.
Once connected, follow the step-by-step instructions shown in the terminal:
- Fill out the survey at the beginning.
- Complete two short programming tasks.
- For each task, you will be connected to either a Teaching Assistant (TA) or an AI Bot. You will be informed which one at the start of each task.
- Ask at least 5 questions per task. Since this study is conducted across multiple institutions, several teaching assistants based in different countries (including India, Austria, Germany, and Australia) are available throughout the day.
For successful participation, you need to ask at least 5 questions and submit both programming tasks.
- Participation is completely anonymous.
- Data is used solely for research purposes.
- Your results have no effect on your course grade or assessment.
- Please ask many questions to the TA and the AI, don't be shy! :-)