Menus Subscribe Search

Follow us


Quick Studies

robo eyes

(Photo: ARTEMENKO VALENTYN/Shutterstock

Computers See Human Pain Better Than You

• March 21, 2014 • 1:20 PM

(Photo: ARTEMENKO VALENTYN/Shutterstock

A new study reveals that expression recognition software performs way better than humans at discriminating between real and fake emotion.

Computers can kick our butts at math, logic, and chess—by now, that’s a given. But reading emotions, most of us probably would like to believe, is a skill reserved for humans. Isn’t that a big part of what separates us from machines in the first place?

Well, not anymore. In a study published this week in Current Biology, researchers led by the University of California-San Diego’s Marian Bartlett pitted humans against computers in a battle to see who could best distinguish between genuine and faked facial expressions of pain. We lost, by a lot.

In the experiment, more than 150 participants were shown short videos of the faces of people who either dunked their arms in ice water or pretended to dunk their arms in ice water. The group was asked to gauge the authenticity of each pained reaction, and succeeded in weeding out the fakers from the true sufferers only 51.9 percent of the time—no more accurate than if they simply had left their guess to chance.

Faked-Pain-imageWhich video screenshot shows this woman experiencing actual pain? (Photo: University of California-San Diego) (Answer: B)

Next, the researchers showed the same videos to computers with special expression recognition software. The computers’ accuracy? Eighty-five percent.

That the humans performed so poorly actually is no surprise. Scientists have known for a while that even trained physicians can’t reliably differentiate between real and faked pain expressions.

But the computers’ results were unprecedented. Bartlett and her colleagues call the success of the recognition software “a significant milestone for machine vision systems.” While computers’ logical prowess has been demonstrated for decades, the machines “have significantly underperformed compared to humans at perceptual processes, rarely reaching even the level of a human child.”

The secret to computers’ improvement, the researchers explain, is their newly refined ability to exploit one of our own physiological quirks. Two distinct motor pathways control our facial movements, one for the expressions we choose to make and the other for expressions we make spontaneously in reaction to something. When we attempt to mimic an emotion like pain, the former pathway directs our features based on what it estimates that emotion is supposed to look like, without any definitive blueprint to follow. Inevitably, small differences crop up that are too subtle for the naked eye, but not the digital lens.

“The single most predictive feature of falsified expressions of pain is the dynamics of the mouth opening,” which alone can account for 72 percent of the accuracy, the researchers write.

It’s not hard to spin the computers’ emotional savviness as a harbinger of machine domination, but Bartlett and her colleagues prefer to look at more practical applications. These include preventing insurance fraud by catching patients who lie to their doctors, improving homeland security, and exposing students who only pretend to pay attention in class.

Heightened surveillance of our expressions could have big costs, too, of course. The software, like many new technologies, leaves us with a big question: How much do we really want computers to know?

Paul Bisceglio
Editorial Fellow Paul Bisceglio was previously an editorial intern at Smithsonian magazine and a staff reporter at Manhattan Media. He is a graduate of Haverford College and completed a Fulbright scholarship at the University of Warwick in Coventry, United Kingdom. Follow him on Twitter @PaulBisceglio.

More From Paul Bisceglio

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

December 18 • 7:06 AM

Apparently You Can Bring Your Religion to Work

New research says offices that encourage talk of religion actually make for happier workplaces.


December 18 • 6:00 AM

The Very Weak and Complicated Links Between Mental Illness and Gun Violence

Vanderbilt University’s Jonathan Metzl and Kenneth MacLeish address our anxieties and correct our assumptions.


December 18 • 4:00 AM

Should Movies Be Rated RD for Reckless Driving?

A new study finds a link between watching films featuring reckless driving and engaging in similar behavior years later.


December 17 • 4:00 PM

How to Run a Drug Dealing Network in Prison

People tend not to hear about the prison drug dealing operations that succeed. Substance.com asks a veteran of the game to explain his system.


December 17 • 2:00 PM

Gender Segregation of Toys Is on the Rise

Charting the use of “toys for boys” and “toys for girls” in American English.


December 17 • 12:41 PM

Why the College Football Playoff Is Terrible But Better Than Before

The sample size is still embarrassingly small, but at least there’s less room for the availability cascade.


December 17 • 11:06 AM

Canadian Kids Have a Serious Smoking Problem

Bootleg cigarette sales could be leading Canadian teens to more serious drugs, a recent study finds.


December 17 • 10:37 AM

A Public Lynching in Sproul Plaza

When photographs of lynching victims showed up on a hallowed site of democracy in action, a provocation was issued—but to whom, by whom, and why?


December 17 • 8:00 AM

What Was the Job?

This was the year the job broke, the year we accepted a re-interpretation of its fundamental bargain and bought in to the push to get us to all work for ourselves rather than each other.


December 17 • 6:00 AM

White Kids Will Be Kids

Even the “good” kids—bound for college, upwardly mobile—sometimes break the law. The difference? They don’t have much to fear. A professor of race and social movements reflects on her teenage years and faces some uncomfortable realities.



December 16 • 4:00 PM

How Fear of Occupy Wall Street Undermined the Red Cross’ Sandy Relief Effort

Red Cross responders say there was a ban on working with the widely praised Occupy Sandy relief group because it was seen as politically unpalatable.


December 16 • 3:30 PM

Murder! Mayhem! And That’s Just the Cartoons!

New research suggests deaths are common features of animated features aimed at children.


December 16 • 1:43 PM

In Tragedy, Empathy Still Dependent on Proximity

In spite of an increasingly connected world, in the face of adversity, a personal touch is most effective.


December 16 • 12:00 PM

The ‘New York Times’ Is Hooked on Drug du Jour Journalism

For the paper of record, addiction is always about this drug or that drug rather than the real causes.


December 16 • 10:00 AM

What Is the Point of Academic Books?

Ultimately, they’re meant to disseminate knowledge. But their narrow appeal makes them expensive to produce and harder to sell.


December 16 • 8:00 AM

Unjust and Unwell: The Racial Issues That Could Be Affecting Your Health Care

Physicians and medical students have the same problems with implicit bias as the rest of us.


December 16 • 6:00 AM

If You Get Confused Just Listen to the Music Play

Healing the brain with the Grateful Dead.


December 16 • 4:00 AM

Another Casualty of the Great Recession: Trust

Research from Britain finds people who were laid off from their jobs expressed lower levels of generalized trust.


December 15 • 4:00 PM

When Charter Schools Are Non-Profit in Name Only

Some charters pass along nearly all their money to for-profit companies hired to manage the schools. It’s an arrangement that’s raising eyebrows.


December 15 • 2:00 PM

No More Space Race

A far cry from the fierce Cold War Space Race between the U.S. and the Soviet Union, exploration in the 21st century is likely to be a much more globally collaborative project.


December 15 • 12:32 PM

The Hidden Psychology of the Home Ref

That old myth of home field bias isn’t a myth at all; it’s a statistical fact.


December 15 • 12:00 PM

Gluttony and Global Warming: We’re Eating Ourselves to a Warmer Planet

Forget your car. Our obsession with beef and dairy has a far more devastating effect on the climate.


December 15 • 10:00 AM

The 2016 Presidential Race Has Already Started

And this is the most exciting part.


December 15 • 8:00 AM

The Second Life of Old iPods

Why is it that old iPods are suddenly cool—and pricey again?


Follow us


Apparently You Can Bring Your Religion to Work

New research says offices that encourage talk of religion actually make for happier workplaces.

Canadian Kids Have a Serious Smoking Problem

Bootleg cigarette sales could be leading Canadian teens to more serious drugs, a recent study finds.

The Hidden Psychology of the Home Ref

That old myth of home field bias isn’t a myth at all; it’s a statistical fact.

A Word of Caution to the Holiday Deal-Makers

Repeat customers—with higher return rates and real bargain-hunting prowess—can have negative effects on a company’s net earnings.

Crowdfunding Works for Science

Scientists just need to put forth some effort.

The Big One

One in two United States senators and two in five House members who left office between 1998 and 2004 became lobbyists. November/December 2014

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.