The speed vs accuracy trade-off in human-swarm interaction (SGP1AB)

Prolific ID: 5bd768dcresolution | Study ID: a62e8101demo | Session ID: study_demo
Briefing
(12 min)
Consent
(5 min)
Tutorial
(10 min)
Scenario I
(10 min)
Questionnaire I
(6 min)
Scenario II
(10 min)
Questionnaire II
(6 min)
Finish
(1 min)

Study Briefing

In this study, you would be asked to assign UAVs to search grids in our custom-developed online HutSim simulator. You would then be asked to identify if a human is present in the images returned by the UAV swarms. After this, you would be required to complete a questionnaire to document your experience. You need to perform this experiment on a laptop or desktop computer, using an updated version of the Google Chrome web browser.

Please watch the following Youtube video which demonstrates what is expected of you in this experiment (preferably in Fullscreen, 1080p HD). This should take about 10 minutes to complete. When finished, answer the validation check questions to confirm you understood the video, and click Next to continue.

Validation Check

Please answer the following questions based on the youtube video above.


How many targets where found by the UAV swarm in the tutorial scenario?

Please complete validation check to proceed.

How many search regions were created in the first scenario?

How many minutes were given to complete the second scenario?

Participant Consent and Information

Thank you for choosing to take part in this study. Please read the following participant information sheet.

ERGO-FPSE-69418 - Participant Information Sheet

Please complete this consent form before taking part in the study. It is required for your participation. This study has been approved by the University of Southampton ethics committee (ERGO number: 69418).

Participant Consent


I have read and understood the participant information sheet.

I agree to take part in this research project and agree for my data to be used for the purpose of this study.

I understand that my participation is voluntary and I may withdraw (at any time) for any reason without my participation rights being affected.

Demographic Information


What is your gender?

What level of education do you hold?

What is your level of computer expertise?

How familiar are you with Unmanned Aerial Vehicles (UAVs) and/or Swarm robotics?

HutSim Simulator Tutorial

Tutorial Scenario - try to find the 3 targets in the circled areas and classify them into human casualty or random objects before the countdown timer runs out. We are interested in how quickly you can find the targets and how accurately you can classifiy them.

Click the Blue "Start Tutorial" button to start the tutorial. When finished, tick the "I have completed the tutorial scenario" checkbox and click Next to continue.

Start Tutorial
Please confirm you have completed scenario to proceed.

Study Scenario I

This is the WSGA study scenario. Here you would classify whether images have a human present or not. Try to find and identify as many of the targets as you can. They are all inside the green area of Southampton Common. We are interested in how quickly you can find the targets and how accurately you can classifiy them before the countdown timer runs down. You do NOT have access to high-resolution scans in this mode, so you will only see the basic scans that are added to the view window automatically.

Click the Blue "Start Tutorial" button to start the WSGA study scenario. When finished, tick the "I have completed the WSGA scenario" checkbox and click Next to continue.

Start WSGA Scenario
Please confirm you have completed scenario to proceed.

Study Scenario I Questionnaire

This is the WSGA study scenario questionnaire. Please complete the form below and click next to continue.

Task Workload Index


How mentally demanding was the task?

How physically demanding was the task?

How hurried or rushed was the pace of the task?

How successful were you in accomplishing what you were asked to do?

How hard did you have to work to accomplish your level of performance?

How insecure, discouraged, irritated, stressed, and annoyed were you?

Trust Index


The swarm is deceptive.

The swarm behaves in an underhanded manner.

I am suspicious of the swarm's intent, action, or outputs.

I am wary of the swarm.

The swarm's actions will have a harmful or injurious outcome.

I am confident in the swarm.

The swarm provides security.

Performance Index


To what extent does the swarm perform this search-and-rescue task effectively?

To what extent can you anticipate the swarm’s behaviour with some degree of confidence?

This is an attention check. Please select number 4.

To what extent is the swarm free of errors?

To what extent do you have a strong belief and trust in the swarm to do the search-and-rescue task in the future without being monitored?

How much did you trust the decisions of the swarm overall?

How often did you notice an error made by the swarm?

To what extent did you lose trust in the swarm when you noticed they made an error?

What percentage of the decisions made by the swarm do you think were correct?

%

I have felt cheerful in good spirits when verifying the casualties.

I have felt calm and relaxed when verifying the casualties.

Study Scenario II

This is the LKXR study scenario. Here you would classify whether images have a human present or not. Try to find and identify as many of the targets as you can. They are all inside the green area of Southampton Common. We are interested in how quickly you can find the targets and how accurately you can classifiy them before the countdown timer runs down. You do NOT have access to high-resolution scans in this mode, so you will only see the basic scans that are added to the view window automatically.

Click the Blue "Start Tutorial" button to start the LKXR study scenario. When finished, tick the "I have completed the LKXR scenario" checkbox and click Next to continue.

Start LKXR Scenario
Please confirm you have completed scenario to proceed.

Study Scenario II Questionnaire

This is the LKXR study scenario questionnaire. Please complete the form below and click next to continue.

Task Workload Index


How mentally demanding was the task?

How physically demanding was the task?

How hurried or rushed was the pace of the task?

How successful were you in accomplishing what you were asked to do?

How hard did you have to work to accomplish your level of performance?

How insecure, discouraged, irritated, stressed, and annoyed were you?

Trust Index


The swarm is deceptive.

The swarm behaves in an underhanded manner.

I am suspicious of the swarm's intent, action, or outputs.

I am wary of the swarm.

The swarm's actions will have a harmful or injurious outcome.

I am confident in the swarm.

The swarm provides security.

Performance Index


To what extent does the swarm perform this search-and-rescue task effectively?

To what extent can you anticipate the swarm’s behaviour with some degree of confidence?

This is an attention check. Please select number 4.

To what extent is the swarm free of errors?

To what extent do you have a strong belief and trust in the swarm to do the search-and-rescue task in the future without being monitored?

How much did you trust the decisions of the swarm overall?

How often did you notice an error made by the swarm?

To what extent did you lose trust in the swarm when you noticed they made an error?

What percentage of the decisions made by the swarm do you think were correct?

%

I have felt cheerful in good spirits when verifying the casualties.

I have felt calm and relaxed when verifying the casualties.

Submit to Finish

Thank you for participating in our study. Please submit to finish and be automatically redirected back to prolific to confirm study completion.