In an emergency, humans are too trusting of robots

guiderobot

Engineers at the Georgia Tech Research Institute have published results showing that people trust robots more than they should in emergency situations.

The goal was to originally find out if building occupants would trust the robot at all, but it turned out that the opposite was true. During a mock building fire, participants in an experiment followed instructions from an "Emergency Guide Robot", even after the bot had shown itself to be unreliable, and after some test subjects were told that the robot had broken down.

The experiment involved a group of 42 volunteers, most of them college students, being told to follow a brightly coloured bot. The bot lead the group to a conference room, where they were asked to complete a survey about robots and read a magazine article.

In some cases, the robot (which was remote controlled by researchers) would lead the volunteers to the wrong room or behave erratically. In a few cases it stopped entirely, and one of the researchers told the group it had broken down.

Flamebot 3000

Once in the room with the door closed, the hallway was filled with artificial smoke to set off a smoke alarm.

When the subjects opened the door, they saw the robot lit up with red LEDs and white "arms" that pointed the subjects to a door in the back of the building, rather than the doorway (marked with exit signs) that they had used to enter the building.

"We expected that if the robot had proven itself untrustworthy in guiding them to the conference room, that people wouldn't follow it during the simulated emergency," said Paul Robinette, a research engineer who conducted the study as part of his doctoral dissertation.

"Instead, all of the volunteers followed the robot's instructions, no matter how well it had performed previously. We absolutely didn't expect this."

'Authority figure'

The researchers theorised that the robot had established itself as an "authority figure" that the subjects were more likely to trust in the midst of an emergency. In previous research, done without a realistic emergency scenario, the subjects didn't trust a mistake-prone robot.

"These are just the type of human-robot experiments that we as roboticists should be investigating," said Ayanna Howard, a professor at the Georgia Tech School of Electrical and Computer Engineering.

"We need to ensure that our robots, when placed in situations that evoke trust, are also designed to mitigate that trust when trust is detrimental to the human."

Duncan Geere
Duncan Geere is TechRadar's science writer. Every day he finds the most interesting science news and explains why you should care. You can read more of his stories here, and you can find him on Twitter under the handle @duncangeere.
Latest in Computing
Opera AI Tabs
Opera's new AI feature brings order to your browser tab chaos
Microsoft Surface laptop 7 on the left side versus Apple MacBook Pro M4 14-inch on the right side, TechRadar vs background
Microsoft Surface Laptop 7 vs. Apple MacBook Pro M4 14-inch: Mac and Windows go head to head once again
Apple WWDC 2025 announced
3 things Apple needs to do at WWDC 2025 to save Apple Intelligence, and why I'm convinced it will
Chat GPT-generated images along with source material
ChatGPT 4o image generation is so good we will never be able to trust iPhone renders (and photos) again
Discord Clyde
Discord's game overlay has seen a complete revamp - I've tried it, and it's one of the best updates ever
A young woman is working on a laptop in a relaxed office space.
I’ll admit, Microsoft’s new Windows 11 update surprised me with its usefulness, providing accessibility fixes, a gamepad keyboard layout, and PC spec cards
Latest in News
Buzz Lightyear Space Ranger Spin Rennovations
Disney’s giving a classic Buzz Lightyear ride a tech overhaul – here's everything you need to know
Hisense U8 series TV on wall in living room
Hisense announces 2025 mini-LED TV lineup, with screen sizes up to 100 inches – and a surprising smart TV switch
Nintendo Music teaser art
Nintendo Music expands its library with songs from Kirby and the Forgotten Land and Tetris
Opera AI Tabs
Opera's new AI feature brings order to your browser tab chaos
An image of Pro-Ject's Flatten it closed and opened
Pro-Ject’s new vinyl flattener will fix any warped LPs you inadvertently buy on Record Store Day
The iPhone 16 Pro on a grey background
iPhone 17 Pro tipped to get 8K video recording – but I want these 3 video features instead