Menus Subscribe Search

Follow us


Quick Studies

robo eyes

(Photo: ARTEMENKO VALENTYN/Shutterstock

Computers See Human Pain Better Than You

• March 21, 2014 • 1:20 PM

(Photo: ARTEMENKO VALENTYN/Shutterstock

A new study reveals that expression recognition software performs way better than humans at discriminating between real and fake emotion.

Computers can kick our butts at math, logic, and chess—by now, that’s a given. But reading emotions, most of us probably would like to believe, is a skill reserved for humans. Isn’t that a big part of what separates us from machines in the first place?

Well, not anymore. In a study published this week in Current Biology, researchers led by the University of California-San Diego’s Marian Bartlett pitted humans against computers in a battle to see who could best distinguish between genuine and faked facial expressions of pain. We lost, by a lot.

In the experiment, more than 150 participants were shown short videos of the faces of people who either dunked their arms in ice water or pretended to dunk their arms in ice water. The group was asked to gauge the authenticity of each pained reaction, and succeeded in weeding out the fakers from the true sufferers only 51.9 percent of the time—no more accurate than if they simply had left their guess to chance.

Faked-Pain-imageWhich video screenshot shows this woman experiencing actual pain? (Photo: University of California-San Diego) (Answer: B)

Next, the researchers showed the same videos to computers with special expression recognition software. The computers’ accuracy? Eighty-five percent.

That the humans performed so poorly actually is no surprise. Scientists have known for a while that even trained physicians can’t reliably differentiate between real and faked pain expressions.

But the computers’ results were unprecedented. Bartlett and her colleagues call the success of the recognition software “a significant milestone for machine vision systems.” While computers’ logical prowess has been demonstrated for decades, the machines “have significantly underperformed compared to humans at perceptual processes, rarely reaching even the level of a human child.”

The secret to computers’ improvement, the researchers explain, is their newly refined ability to exploit one of our own physiological quirks. Two distinct motor pathways control our facial movements, one for the expressions we choose to make and the other for expressions we make spontaneously in reaction to something. When we attempt to mimic an emotion like pain, the former pathway directs our features based on what it estimates that emotion is supposed to look like, without any definitive blueprint to follow. Inevitably, small differences crop up that are too subtle for the naked eye, but not the digital lens.

“The single most predictive feature of falsified expressions of pain is the dynamics of the mouth opening,” which alone can account for 72 percent of the accuracy, the researchers write.

It’s not hard to spin the computers’ emotional savviness as a harbinger of machine domination, but Bartlett and her colleagues prefer to look at more practical applications. These include preventing insurance fraud by catching patients who lie to their doctors, improving homeland security, and exposing students who only pretend to pay attention in class.

Heightened surveillance of our expressions could have big costs, too, of course. The software, like many new technologies, leaves us with a big question: How much do we really want computers to know?

Paul Bisceglio
Editorial Fellow Paul Bisceglio was previously an editorial intern at Smithsonian magazine and a staff reporter at Manhattan Media. He is a graduate of Haverford College and completed a Fulbright scholarship at the University of Warwick in Coventry, United Kingdom. Follow him on Twitter @PaulBisceglio.

More From Paul Bisceglio

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

November 26 • 4:00 PM

Turmoil at JPMorgan

Examiners are reportedly blocked from doing their job as “London Whale” trades blow up.


November 26 • 2:00 PM

Rich Kids Are More Likely to Be Working for Dad

Nepotism is alive and well, especially for the well-off.


November 26 • 12:00 PM

How Do You Make a Living, Taxidermist?

Taxidermist Katie Innamorato talks to Noah Davis about learning her craft, seeing it become trendy, and the going-rate for a “Moss Fox.”


November 26 • 10:28 AM

Attitudes About Race Affect Actions, Even When They Don’t

Tiny effects of attitudes on individuals’ actions pile up quickly.


November 26 • 10:13 AM

Honeybees Touring America


November 26 • 10:00 AM

Understanding Money

In How to Speak Money, John Lanchester explains how the monied people talk about their mountains of cash.


November 26 • 8:00 AM

The Exponential Benefits of Eating Less

Eating less food—whole food and junk food, meat and plants, organic and conventional, GMO and non-GMO—would do a lot more than just better our personal health.


November 26 • 6:00 AM

The Incorruptible Bodies of Saints

Their figures were helped along by embalming, but, somehow, everyone forgot that part.


November 26 • 4:00 AM

The Geography of Real Estate Markets Is Shifting Under Our Feet

Policies aimed at unleashing supply in order to make housing more affordable are relying on outdated models.



November 25 • 4:00 PM

Is the Federal Reserve Bank of New York Doing Enough to Monitor Wall Street?

Bank President William Dudley says supervision is stronger than ever, but Democratic senators are unconvinced: “You need to fix it, Mr. Dudley, or we need to get someone who will.”


November 25 • 3:30 PM

Cultural Activities Help Seniors Retain Health Literacy

New research finds a link between the ability to process health-related information and regular attendance at movies, plays, and concerts.


November 25 • 12:00 PM

Why Did Doctors Stop Giving Women Orgasms?

You can thank the rise of the vibrator for that, according to technology historian Rachel Maines.


November 25 • 10:08 AM

Geography, Race, and LOLs

The online lexicon spreads through racial and ethnic groups as much as it does through geography and other traditional linguistic measures.


November 25 • 10:00 AM

If It’s Yellow, Seriously, Let It Mellow

If you actually care about water and the future of the species, you’ll think twice about flushing.


November 25 • 8:00 AM

Sometimes You Should Just Say No to Surgery

The introduction of national thyroid cancer screening in South Korea led to a 15-fold increase in diagnoses and a corresponding explosion of operations—but no difference in mortality rates. This is a prime example of over-diagnosis that’s contributing to bloated health care costs.



November 25 • 6:00 AM

The Long War Between Highbrow and Lowbrow

Despise The Avengers? Loathe the snobs who despise The Avengers? You’re not the first.


November 25 • 4:00 AM

Are Women More Open to Sex Than They Admit?

New research questions the conventional wisdom that men overestimate women’s level of sexual interest in them.


November 25 • 2:00 AM

The Geography of Innovation, or, Why Almost All Japanese People Hate Root Beer

Innovation is not a product of population density, but of something else entirely.


November 24 • 4:00 PM

Federal Reserve Announces Sweeping Review of Its Big Bank Oversight

The Federal Reserve Board wants to look at whether the views of examiners are being heard by higher-ups.



November 24 • 2:00 PM

That Catcalling Video Is a Reminder of Why Research Methods Are So Important

If your methods aren’t sound then neither are your findings.


November 24 • 12:00 PM

Yes, Republicans Can Still Win the White House

If the economy in 2016 is where it was in 2012 or better, Democrats will likely retain the White House. If not, well….


November 24 • 11:36 AM

Feeling—Not Being—Wealthy Cuts Support for Economic Redistribution

A new study suggests it’s relative wealth that leads people to oppose taxing the rich and giving to the poor.


Follow us


Attitudes About Race Affect Actions, Even When They Don’t

Tiny effects of attitudes on individuals' actions pile up quickly.

Geography, Race, and LOLs

The online lexicon spreads through racial and ethnic groups as much as it does through geography and other traditional linguistic measures.

Feeling—Not Being—Wealthy Cuts Support for Economic Redistribution

A new study suggests it's relative wealth that leads people to oppose taxing the rich and giving to the poor.

Sufferers of Social Anxiety Disorder, Your Friends Like You

The first study of friends' perceptions suggest they know something's off with their pals but like them just the same.

Standing Up for My Group by Kicking Yours

Members of a minority ethnic group are less likely to express support for gay equality if they believe their own group suffers from discrimination.

The Big One

One in two United States senators and two in five House members who left office between 1998 and 2004 became lobbyists. November/December 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.