Menus Subscribe Search

Follow us


rorschach

Can a Test Tell If You’re a Good Entrepreneur?

• December 05, 2012 • 4:00 AM

How psychometrics are helping loan officers weed out the bad risks from the good.

Bankers around the world know there are profits to be reaped by making loans to promising small businesses that fall just short of traditional definitions of “creditworthy.” Ever since Nobel Prize winner Muhammad Yunus’ Grameen Bank pioneered “microfinance” by making tiny loans to single mothers in Bangladesh, development policymakers also have believed that getting credit to small businesses—those too large for Grameen-style microloans but still lacking collateral or credit history—is not only possible, but the key to helping a nation’s economic growth. So how to figure out who’s a good risk for a loan—and who isn’t?

Now, some banks think a simple, 40-minute questionnaire for entrepreneurs can tell them a lot about whether a company is worth the risk. Two public policy researchers at Harvard, Bailey Klinger and Asim Khwaja, first adapted the questionnaire from psychometric evaluations— a tool psychologists, child custody lawyers, executive recruiters, retail employers, and even the NFL have used since the concept  emerged from academia in 1918, when the U.S. Army started mentally testing potential doughboys.

Psychometric evaluations typically include brief, open-ended questions related to ethics, attitudes, skills, and intelligence. In Klinger and Khwaja’s model for testing how likely an entrepreneur is to make good on a loan, that means questions like “Do you like to attend parties?,” “Do you enjoy taking things apart to see how they work?” or “Do you believe that luck is a big part of success?” as well as cognitive problems like “Look at this sequence of numbers for five seconds, then try to recite as many digits as you can.”

The researchers launched pilot programs in South Africa, Kenya, Rwanda, Colombia, and Peru in 2008, and spent two years administering evaluations and following the success rate of test-takers. They discovered an unusually high correlation in the answers submitted by successful entrepreneurs who were also good borrowers.

“[Psychometrics] aren’t perfect; everyone who does very well on [the] SAT [test] doesn’t end up with a 4.0 in college,” says Brian Hoffman, professor of psychology at the University of Georgia. “But it’s a cost-effective predictor.” That is, psychometrics appear to be a cheaper, more accurate way to predict human behavior in many fields that have been using them to evaluate people.

The Harvard team’s innovative application of psychometric tools earned a stream of grants and plaudits, and eventually a prize for innovation in development finance sponsored by the G-20. Boosting growth among small and medium-sized enterprises, from second-hand-clothing sellers to light manufacturers, has long been seen by development experts as crucial for job creation and ultimately poverty alleviation in low-income countries. In countries like Yunus’s home of Bangladesh, the economy is dominated by a few large, established corporations or industries, and innumerable, and informal, micro-enterprises. Meanwhile, mid-sized operations average only 15 percent of low-income countries’ GDP, compared to roughly 50 percent of high-income nations’ GDP. Research finds that neither the really big nor the really small businesses have the growth potential—or unmet credit needs—of those mid-sized operations with 10 to 250 employees. But lenders tend to see this segment, generally lacking collateral or extensive financial records in the developing world, as too risky a bet. They aren’t the charity cases that foundations and policymakers itch to assist, either.

“These business owners might be poor, but not poorest of poor. Not the kinds you can put on a glossy brochure to pull people’s heart strings about helping them make money,” says Klinger.

To expand the use of their questionnaire, Kwhaja and Klinger created a company called the Entrepreneurial Finance Lab (EFL) in 2010, and signed up one of the largest banks in Africa, Standard Bank of South Africa. The next step has been to send loan officers into bazaars, street markets, and main streets with laptops or cell phones loaded with the questionnaire.

The bank found that when an entrepreneur qualified for a loan using both the bank’s traditional credit scoring methods and EFL’s questionnaire, delinquency rates were 2.8 percent. Applicants who qualified for a loan based only on the banks’ traditional credit scoring methods had a delinquency rate of 14.5 percent. And in 677 of 913 applications, where the bank said no but psychometrics said yes (and therefore a loan was granted), the delinquency rate was 9.7 percent. Psychometric evaluations were helping Standard access, albeit on a small scale, a huge new pool of fairly successful borrowers that it otherwise would have turned down. Those 677 businesses now had access to growth capital, enabling them to hire new employees.

“The whole point of the development finance business in the last 15 or 20 years was to get around [the credit] problem,” according to Nicholas Hope, director of Stanford’s Center for International Development and a veteran of World Bank programs in China and Indonesia. He was referring to a problem known as the “missing middle,” in which small and medium-sized enterprises were overlooked by lending institutions and charitable organizations.

Roughly 45,000 applicants have answered some version of EFL’s questions as part of their loan application process. Banks like Standard in South Africa but also others such as Mexico’s BBVA Bancomer and EFL’s newest client in Indonesia, Bank BPTA (pending formal central bank approval, though they’re already using the tool more widely than any other bank), have made $156 million in loans—generally from $800 to $100,000—to entrepreneurs based at least partly on their psychometric responses.

The loans are going out at a pace of roughly $8 million a month, according to Klinger. In early November, the Inter Development Bank in Washington, a sort of World Bank for Latin America, announced $25 million in loan guarantees for Latin American banks that incorporate psychometrics in lending decisions for micro- to medium-sized enterprises. Some banks are even considering using psychometrics to re-evaluate terms on loans they have already made, Klinger said.

This rapid rate of adoption globally could do a lot to spur growth in a huge, long-neglected segment of small businesses. But, with large corporations using sophisticated new tools to engage borrowers with little institutional support or financial savvy, there are potential pitfalls. Critics of psychometrics in hiring have claimed that the tests can reinforce gender and racial stereotypes. Seth Kaplan, professor of psychology at the University of Georgia, described the dynamic this way: “A test is a sample of behavior, and anytime you’re trying to make inferences about future behavior, it’s always kind of a deterministic model.”

Klinger agreed that, in the lending context, it would be ethically dubious to judge creditworthiness based on latent personality traits but argued that this mischaracterizes the method being applied by EFL.

“We walk a very careful line,” he says. “We work with some of the top people in the field, but we are not psychologists. We’re not measuring whether somebody is smart or has a certain level of ambition, but asking some questions from that context, and relating those answers to statistical history of default rates. It may sound like a fine-print legal distinction, but it’s a substantive difference.”

Jared Miller, Latin America director for Klinger’s company, summed it this way: “We don’t measure who [entrepreneurs] are really, we measure who they present themselves to be.”

Critics of micro-finance also contend that the high interest rates that for-profit players like HSBC offered borrowers canceled out the potential to lower poverty rates. Francisco Rojo, project manager for the IDB’s Multilateral Investment Fund, which focuses on smaller-scale, market-based development projects for the IDB and has helped EFL enter the Latin American market, allows, “We are not setting out criteria in terms of interest rates; banks decide that.” In his view, though, that would likely prove unnecessary. “The idea is, if they charge very high interest rates, and they see it successful with profit, then they will begin to lend to that same segment and then they will compete and interest rates will get lower.” EFL executives echoed this point.

Given the rapid rate at which banks are adopting tools from psychometrics to expand the reach of their loan officers, and small businesses’ estimated $2 trillion in unmet credit needs in the developing world, we’ll find out soon whether Rojo’s prediction about interest rates comes to pass.

Michael Fitzgerald
Michael Fitzgerald is an associate editor at Pacific Standard. He has previously worked at The New Republic and Oxford American Magazine.

More From Michael Fitzgerald

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 24 • 4:00 PM

We Need to Normalize Drug Use in Our Society

After the disastrous misconceptions of the 20th century, we’re returning to the idea that drugs are an ordinary part of life experience and no more cause addiction than do other behaviors. This is rational and welcome.


October 24 • 2:00 PM

A Letter to the Next Attorney General: Fix Presidential Pardons

More than two years ago, a series showed that white applicants were far more likely to receive clemency than comparable applicants who were black. Since then, the government has spent hundreds of thousands of dollars on a study, but the pardons system remains unchanged.


October 24 • 12:00 PM

What Makes You So Smart, Middle School Math Teacher?

Noah Davis talks to Vern Williams about what makes middle school—yes, middle school—so great.


October 24 • 10:00 AM

Why DNA Is One of Humanity’s Greatest Inventions

How we’ve co-opted our genetic material to change our world.


October 24 • 8:00 AM

What Do Clowns Think of Clowns?

Three major players weigh in on the current state of the clown.


October 24 • 7:13 AM

There Is No Surge in Illegal Immigration

The overall rate of illegal immigration has actually decreased significantly in the last 10 years. The time is ripe for immigration reform.


October 24 • 6:15 AM

Politicians Really Aren’t Better Decision Makers

Politicians took part in a classic choice experiment but failed to do better than the rest of us.


October 24 • 5:00 AM

Why We Gossip: It’s Really All About Ourselves

New research from the Netherlands finds stories we hear about others help us determine how we’re doing.


October 24 • 2:00 AM

Congratulations, Your City Is Dying!

Don’t take population numbers at face value.


October 23 • 4:00 PM

Of Course Marijuana Addiction Exists

The polarized legalization debate leads to exaggerated claims and denials about pot’s potential harms. The truth lies somewhere in between.


October 23 • 2:00 PM

American Companies Are Getting Way Too Cozy With the National Security Agency

Newly released documents describe “contractual relationships” between the NSA and U.S. companies, as well as undercover operatives.


October 23 • 12:00 PM

The Man Who’s Quantifying New York City

Noah Davis talks to the proprietor of I Quant NY. His methodology: a little something called “addition.”


October 23 • 11:02 AM

Earliest High-Altitude Settlements Found in Peru

Discovery suggests humans adapted to high altitude faster than previously thought.


October 23 • 10:00 AM

The Psychology of Bribery and Corruption

An FBI agent offered up confidential information about a political operative’s enemy in exchange for cash—and they both got caught. What were they thinking?


October 23 • 8:00 AM

Ebola News Gives Me a Guilty Thrill. Am I Crazy?

What it means to feel a little excited about the prospect of a horrific event.


October 23 • 7:04 AM

Why Don’t Men Read Romance Novels?

A lot of men just don’t read fiction, and if they do, structural misogyny drives them away from the genre.


October 23 • 6:00 AM

Why Do Americans Pray?

It depends on how you ask.


October 23 • 4:00 AM

Musicians Are Better Multitaskers

New research from Canada finds trained musicians more efficiently switch from one mental task to another.


October 22 • 4:00 PM

The Last Thing the Women’s Movement Needs Is a Heroic Male Takeover

Is the United Nations’ #HeForShe campaign helping feminism?


October 22 • 2:00 PM

Turning Public Education Into Private Profits

Baker Mitchell is a politically connected North Carolina businessman who celebrates the power of the free market. Every year, millions of public education dollars flow through Mitchell’s chain of four non-profit charter schools to for-profit companies he controls.


October 22 • 12:00 PM

Will the End of a Tax Loophole Kill Off Irish Business and Force Google and Apple to Pay Up?

U.S. technology giants have constructed international offices in Dublin in order to take advantage of favorable tax policies that are now changing. But Ireland might have enough other draws to keep them there even when costs climb.


October 22 • 10:00 AM

Veterans in the Ivory Tower

Why there aren’t enough veterans at America’s top schools—and what some people are trying to do to change that.


October 22 • 8:00 AM

Our Language Prejudices Don’t Make No Sense

We should embrace the fact that there’s no single recipe for English. Making fun of people for replacing “ask” with “aks,” or for frequently using double negatives just makes you look like the unsophisticated one.


October 22 • 7:04 AM

My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.


October 22 • 6:00 AM

How We Form Our Routines

Whether it’s a morning cup of coffee or a glass of warm milk before bed, we all have our habitual processions. The way they become engrained, though, varies from person to person.


Follow us


Politicians Really Aren’t Better Decision Makers

Politicians took part in a classic choice experiment but failed to do better than the rest of us.

Earliest High-Altitude Settlements Found in Peru

Discovery suggests humans adapted to high altitude faster than previously thought.

My Politicians Are Better Looking Than Yours

A new study finds we judge the cover by the book—or at least the party.

That Cigarette Would Make a Great Water Filter

Clean out the ashtray, add some aluminum oxide, and you've (almost) got yourself a low-cost way to remove arsenic from drinking water.

Love and Hate in Israel and Palestine

Psychologists find that parties to a conflict think they're motivated by love while their enemies are motivated by hate.

The Big One

One company, Amazon, controls 67 percent of the e-book market in the United States—down from 90 percent five years ago. September/October 2014 new-big-one-5

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.