Menus Subscribe Search

Quick Studies

robo eyes

(Photo: ARTEMENKO VALENTYN/Shutterstock

Computers See Human Pain Better Than You

• March 21, 2014 • 1:20 PM

(Photo: ARTEMENKO VALENTYN/Shutterstock

A new study reveals that expression recognition software performs way better than humans at discriminating between real and fake emotion.

Computers can kick our butts at math, logic, and chess—by now, that’s a given. But reading emotions, most of us probably would like to believe, is a skill reserved for humans. Isn’t that a big part of what separates us from machines in the first place?

Well, not anymore. In a study published this week in Current Biology, researchers led by the University of California-San Diego’s Marian Bartlett pitted humans against computers in a battle to see who could best distinguish between genuine and faked facial expressions of pain. We lost, by a lot.

In the experiment, more than 150 participants were shown short videos of the faces of people who either dunked their arms in ice water or pretended to dunk their arms in ice water. The group was asked to gauge the authenticity of each pained reaction, and succeeded in weeding out the fakers from the true sufferers only 51.9 percent of the time—no more accurate than if they simply had left their guess to chance.

Faked-Pain-imageWhich video screenshot shows this woman experiencing actual pain? (Photo: University of California-San Diego) (Answer: B)

Next, the researchers showed the same videos to computers with special expression recognition software. The computers’ accuracy? Eighty-five percent.

That the humans performed so poorly actually is no surprise. Scientists have known for a while that even trained physicians can’t reliably differentiate between real and faked pain expressions.

But the computers’ results were unprecedented. Bartlett and her colleagues call the success of the recognition software “a significant milestone for machine vision systems.” While computers’ logical prowess has been demonstrated for decades, the machines “have significantly underperformed compared to humans at perceptual processes, rarely reaching even the level of a human child.”

The secret to computers’ improvement, the researchers explain, is their newly refined ability to exploit one of our own physiological quirks. Two distinct motor pathways control our facial movements, one for the expressions we choose to make and the other for expressions we make spontaneously in reaction to something. When we attempt to mimic an emotion like pain, the former pathway directs our features based on what it estimates that emotion is supposed to look like, without any definitive blueprint to follow. Inevitably, small differences crop up that are too subtle for the naked eye, but not the digital lens.

“The single most predictive feature of falsified expressions of pain is the dynamics of the mouth opening,” which alone can account for 72 percent of the accuracy, the researchers write.

It’s not hard to spin the computers’ emotional savviness as a harbinger of machine domination, but Bartlett and her colleagues prefer to look at more practical applications. These include preventing insurance fraud by catching patients who lie to their doctors, improving homeland security, and exposing students who only pretend to pay attention in class.

Heightened surveillance of our expressions could have big costs, too, of course. The software, like many new technologies, leaves us with a big question: How much do we really want computers to know?

Paul Bisceglio
Editorial Fellow Paul Bisceglio was previously an editorial intern at Smithsonian magazine and a staff reporter at Manhattan Media. He is a graduate of Haverford College and completed a Fulbright scholarship at the University of Warwick in Coventry, United Kingdom. Follow him on Twitter @PaulBisceglio.

More From Paul Bisceglio

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

July 24 • 4:00 PM

Overweight Americans Have the Lowest Risk of Premature Death

Why do we use the term “normal weight” when talking about BMI? What’s presented as normal certainly isn’t the norm, and it may not even be what’s most healthy.


July 24 • 2:00 PM

California’s Lax Policing of the Fracking Industry Has Put the Drought-Stricken State in a Terrible Situation

The state’s drought has forced farmers to rely on groundwater, even as aquifers have been intentionally polluted due to exemptions for the oil industry.


July 24 • 12:00 PM

What’s in a Name? The Problem With Washington’s Football Team

A senior advisor to the National Congress of American Indians once threw an embarrassing themed party that involved headdresses. He regrets that costume now, but knows his experience is one many others can relate to.


July 24 • 11:00 AM

How Wildlife Declines Are Leading to Slavery and Terrorism

As wildlife numbers dwindle, wildlife crimes are rising—and that’s fueling a raft of heinous crimes committed against humans.


July 24 • 10:58 AM

How the Supremes Pick Their Cases—and Why Obamacare Is Safe for Now

The opponents of Obamacare who went one for two in circuit court rulings earlier this week are unlikely to see their cases reach the Supreme Court.



July 24 • 9:48 AM

The People Who Are Scared of Dogs

While more people fear snakes or spiders, with dogs everywhere, cynophobia makes everyday public life a constant challenge.


July 24 • 8:00 AM

Newton’s Needle: On Scientific Self-Experimentation

It is all too easy to treat science as a platform that allows the observer to hover over the messiness of life, unobserved and untouched. But by remembering the role of the body in science, perhaps we humanize it as well.


July 24 • 6:00 AM

Commercializing the Counterculture: How the Summer Music Festival Went Mainstream

With painted Volkswagen buses, talk of “free love,” and other reminders of the Woodstock era replaced by advertising and corporate sponsorships, hippie culture may be dying, but a new subculture—a sort of purgatory between hipster and hippie—is on the rise.


July 24 • 5:00 AM

In Praise of Our Short Attention Spans

Maybe there’s a good reason why it seems like there’s been a decline in our our ability to concentrate for a prolonged period of time.


July 24 • 4:00 AM

How Stereotypes Take Shape

New research from Scotland finds they’re an unfortunate product of the way we process and share information.


July 23 • 4:00 PM

Who Doesn’t Like Atheists?

The Pew Research Center asked Americans of varying religious affiliations how they felt about each other.


July 23 • 2:00 PM

We Need to Start Tracking Patient Harm and Medical Mistakes Now

Top patient-safety experts call on Congress to step in and, among other steps, give the Centers for Disease Control and Prevention wider responsibility for measuring medical mistakes.


July 23 • 12:19 PM

How a CEO’s Fiery Battle Speeches Can Shape Ethical Behavior

CEO war speech might inspire ethical decisions internally and unethical ones among competing companies.


July 23 • 12:00 PM

Why Do We Love the ‘Kim Kardashian: Hollywood’ Game?

It’s easy enough to turn yourself into a virtual celebrity, complete with fame and mansions—but it will likely cost you.


July 23 • 11:49 AM

Modern Technology Still Doesn’t Protect Americans From Deadly Landslides

No landslide monitoring or warning systems are being used to protect vulnerable communities.


July 23 • 10:00 AM

Outing the Death-Drug Distributors

Calling all hackers: It’s time to go Assange on capital punishment.


July 23 • 8:00 AM

The Surprising Appeal of Products That Require Effort to Use

New research finds they enable consumers to re-establish a feeling that they’re in control of their lives.



July 23 • 6:00 AM

How the Other Half Lifts: What Your Workout Says About Your Social Class

Why can’t triathletes and weightlifters get along?


July 23 • 5:02 AM

Battle of the Public Intellectuals: Edward Glaeser vs. Richard Florida

On gentrification and housing costs.


July 23 • 4:00 AM

Our Fear of Immigrants

Why did a group of fourth graders rally in support of an undocumented classmate while the citizens of Murrieta, California, tried to stop immigrant children from entering their town?


July 22 • 4:00 PM

Can Meditation Really Slow Aging?

Is there real science in the spiritualism of meditation? Jo Marchant meets a Nobel Prize-winner who thinks so.



July 22 • 2:00 PM

The Alabama Judge Who Refuses to Let Desegregation Orders Go Ignored

A federal judge in Alabama says a local school board has failed to meet legal mandate to integrate.


Follow us


Subscribe Now

How Wildlife Declines Are Leading to Slavery and Terrorism

As wildlife numbers dwindle, wildlife crimes are rising—and that's fueling a raft of heinous crimes committed against humans.

How a CEO’s Fiery Battle Speeches Can Shape Ethical Behavior

CEO war speech might inspire ethical decisions internally and unethical ones among competing companies.

Modern Technology Still Doesn’t Protect Americans From Deadly Landslides

No landslide monitoring or warning systems are being used to protect vulnerable communities.

The Link Between Carbs, Gut Microbes, and Colon Cancer

Reduced carb intake among mice protected them from colon cancer.

The New Weapon Against Disease-Spreading Insects Is Big Data

Computer models that pinpoint the likely locations of mosquitoes and tsetse flies are helping officials target vector control efforts.

The Big One

Today, the United States produces less than two percent of the clothing purchased by Americans. In 1990, it produced nearly 50 percent. July/August 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.