Menus Subscribe Search

Follow us


software

(PHOTO: ISAK55/SHUTTERSTOCK)

Should All Software Engineers Be Required to Take an Ethics Course?

• September 06, 2013 • 8:00 AM

(PHOTO: ISAK55/SHUTTERSTOCK)

Facebook outing students. Google collecting personal information from wireless networks. A dating app used for stalking. The creators of a new three-day ethics program believe these incidents could have been avoided.

When Irina Raicu first read about a new software program designed to take just a few details about a person, such as gender and hair color, whether or not the person has tattoos, and the number of minor offenses they’ve committed, and accurately predict how likely he or she would be to commit a felony, she got worried.

Not because Raicu, the Internet ethics program manager at Santa Clara University’s Markkula Center for Applied Ethics, is planning to switch to a career outside the law. She was troubled by something Jim Adler, the program’s creator, told a Bloomberg News reporter:

It’s important that geeks and suits and wonks get together and talk about these things … because geeks like me can do stuff like this, we can make stuff work—it’s not our job to figure out if it’s right or not. We often don’t know.

All too often, Raicu said, the geeks and suits and wonks simply don’t get together—at least not until the damage has already been done.

Like when Facebook inadvertently outed a few University of Texas students who had joined Queer Chorus, a student choir group. The president of the chorus added students to the group’s Facebook page, not realizing it would automatically notify all of their Facebook friends—some of whom the students hadn’t yet come out to, including family members who didn’t take the news well, to put it mildly.

Facebook added additional explanations in the Help Center and has since added additional privacy controls, but for at least those students, it was too late.

That’s part of the reason why Raicu thinks the geeks need an education in professional ethics, and worked with the Markkula Center to create a three-day crash course meant to be taken before creating new programs that could potentially affect the lives of consumers.

“You really have to think to get beyond the most obvious kinds of possible harm—failures in systems that are critical to public safety,” Irina Raicu said. But that doesn’t mean they’re not there.

Software engineers used to work in big companies where they had checks on the choices they made. “Now, we’re talking about two guys in hoodies in a garage,” Raicu said. They deploy the code now and fix it later. “That’s why we need to get them thinking about this early.”

Software engineering students are required to take the same engineering ethics course any engineering student would, said Shannon Vallor, the software ethics curriculum’s primary author and an associate professor of philosophy at Santa Clara.

In 2000, ABET, the organization that accredits university engineering programs, started formally requiring that every program teach engineering ethics. But Raicu said she doesn’t know of a single engineering ethics course that’s targeted to the challenges specific to software engineering. The classic case studies in engineering textbooks­—such as the Challenger explosion, or the fire-prone Ford Pintos—deal with catastrophic human injuries and deaths that might have been prevented.

That makes sense given the National Society for Professional Engineers’ First Fundamental Canon, which states that an engineer’s most basic ethical duty is “to hold paramount the safety, health, and welfare of the public.” But for software engineers, who build lines of code, not rockets and cars, it’s not so obvious what that duty means. Coders who studied computer science or an entirely unrelated field might never have seen an ethics course at all.

“You really have to think to get beyond the most obvious kinds of possible harm—failures in systems that are critical to public safety,” Raicu said. But that doesn’t mean they’re not there. Programmers’ work can also have much greater reach than that of other kinds of engineers, making consequences even more difficult to anticipate, Vallor added.

There’s no ethics checklist, and there probably never will be. Instead, Vallor and Raicu hope to make ethics part of the software development process, something engineers constantly return to as they see how their work is being used.

In other words, they don’t think that if Mark Zuckerberg and company had sat down and had an intellectual discussion about privacy rights when Facebook was in its dorm room infancy, all of our problems—past, present, and future—would be solved.

“Users will always do things with technology that we didn’t anticipate,” Vallor said. “Ethics isn’t a due diligence where you check off the boxes and you’re done.”

Sometimes ethical issues prompt action. After the outcry when Google revealed that Street View vehicles had been “wardriving”—collecting and storing personal information from unsecured wireless networks—in 2010, the company temporarily grounded Street View cars, appointed a director of privacy to monitor engineering, trained employees on responsible data collection and use, and added stronger privacy protections for its projects. But often there’s simply an apologetic acknowledgement coupled with a resigned sigh to the effect that technology simply moves faster than laws and social norms. Eventually people will adapt.

That struck Raicu as odd. “At some point, it became acceptable that instead of technology meeting our needs, it creates needs and we’ll catch up.” she said. “Why not make technology that’s responsive to what we need and want?”

Any technology creates disruption. Just ask the horse and buggy industry. The difference, Raicu said, is that with software, most people don’t understand the changes under way. It’s hard for people to discuss privacy and the Internet when they don’t really know what’s being collected, or how. She hopes programmers eventually get better at communicating with non-geeks, and take more responsibility for ethical choices before problems get to the lawyers.

The Markkula Center’s course module was released earlier this month and so far seven schools have signed on. Vallor is already working on a follow-up edition, including more case studies.

For example, there’s the Girls Around Me app, which picked up personal data from nearby phones to identify and message single women in the users’ vicinity. It was pulled from Apple’s App Store, but only after an outcry from smartphone users who saw it as less a tool for dating than stalking.

Or Twitter’s new in-tweet “report abuse” button. How can programmers promote free speech without making it so users have no remedy for harassment?

What do Vallor and Raicu hope for? For starters, a more carefully considered approach to development—just because coders can do something doesn’t necessarily mean that they should—combined with more dialogue between the geeks and, well, everybody else.

“These kids are smart, but they’re not used to thinking about ethics in the context of their profession,” Raicu said. “We’re hoping that if we can get professors to talk about this, at least for a day, students will take it from there.”

Lauren Zumbach
Lauren Zumbach is a freelance journalist based in Chicago. She has written for Hemispheres, Forbes India, and the Jakarta Globe. Follow her on Twitter @laurenzumbach.

More From Lauren Zumbach

A weekly roundup of the best of Pacific Standard and PSmag.com, delivered straight to your inbox.

Recent Posts

October 1 • 2:00 PM

Most People With Addiction Simply Grow Out of It. Why Is This Widely Denied?

The idea that addiction is typically a chronic, progressive disease that requires treatment is false, the evidence shows. Yet the “aging out” experience of the majority is ignored by treatment providers and journalists.


October 1 • 1:00 PM

Midlife Neuroticism Linked to Alzheimer’s Disease in Old Age

New research from Sweden suggests that the personality dimension is connected to who ultimately suffers from late-in-life dementia.



October 1 • 11:11 AM

The Creative Class Boondoggle in Downtown Las Vegas

On Tony Hsieh and the pseudoscience of “collisions.”


October 1 • 9:14 AM

Mysterious Resting State Networks Might Be What Allow Different Brain Therapies to Work

Deep brain stimulation and similar treatments target the hubs of larger resting-state networks in the brain, researchers find.


October 1 • 6:00 AM

Would You Like a Subscription with Your Coffee?

A new app hopes to unite local coffee shops while helping you find a cheap cup of good coffee.


October 1 • 4:00 AM

How to Plant a Library

Somewhere outside of Oslo, there are 1,000 newly-planted spruce trees. One hundred years from now, if everything goes to plan, they’ll be published together as 100 pieces of art.



September 30 • 10:09 AM

Trust Is Waning, and Inequality May Be to Blame

Trust in others and confidence in institutions is declining, while economic inequality creeps up, a new study shows.


September 30 • 8:00 AM

The Psychology of Penmanship

Graphology: It’s all (probably) bunk.



September 30 • 6:00 AM

The Medium Is the Message, 50 Years Later

Five decades on, what can Marshall McLuhan’s Understanding Media tell us about today?


September 30 • 4:00 AM

Grad School’s Mental Health Problem

Navigating the emotional stress of doctoral programs in a down market.


September 29 • 1:21 PM

Conference Call: Free Will Conference


September 29 • 12:00 PM

How Copyright Law Protects Art From Criticism

A case for allowing the copyright on Gone With the Wind to expire.


September 29 • 10:00 AM

Should We Be Told Who Funds Political Attack Ads?

On the value of campaign finance disclosure.


September 29 • 8:00 AM

Searching for a Man Named Penis

A quest to track down a real Penis proves difficult.


September 29 • 6:00 AM

Why Do So Many People Watch HGTV?

The same reason so many people watch NCIS or Law and Order: It’s all a procedural.


September 29 • 4:00 AM

The Link Between Depression and Terrorism

A new study from the United Kingdom finds a connection between depression and radicalization.


September 26 • 4:00 PM

Fast Track to a Spill?

Oil pipeline projects across America are speeding forward without environmental review.


September 26 • 2:00 PM

Why Liberals Love the Disease Theory of Addiction, by a Liberal Who Hates It

The disease model is convenient to liberals because it spares them having to say negative things about poor communities. But this conception of addiction harms the very people we wish to help.


September 26 • 1:21 PM

Race, Trust, and Split-Second Judgments


September 26 • 9:47 AM

Dopamine Might Be Behind Impulsive Behavior

A monkey study suggests the brain chemical makes what’s new and different more attractive.


September 26 • 8:00 AM

A Letter Becomes a Book Becomes a Play

Sarah Ruhl’s Dear Elizabeth: A Play in Letters From Elizabeth Bishop to Robert Lowell and Back Again takes 900 pages of correspondence between the two poets and turns them into an on-stage performance.


September 26 • 7:00 AM

Sonic Hedgehog, DICER, and the Problem With Naming Genes

Wait, why is there a Pokemon gene?


Follow us


Mysterious Resting State Networks Might Be What Allow Different Brain Therapies to Work

Deep brain stimulation and similar treatments target the hubs of larger resting-state networks in the brain, researchers find.

Trust Is Waning, and Inequality May Be to Blame

Trust in others and confidence in institutions is declining, while economic inequality creeps up, a new study shows.

Dopamine Might Be Behind Impulsive Behavior

A monkey study suggests the brain chemical makes what's new and different more attractive.

School Counselors Do More Than You’d Think

Adding just one counselor to a school has an enormous impact on discipline and test scores, according to a new study.

How a Second Language Trains Your Brain for Math

Second languages strengthen the brain's executive control circuits, with benefits beyond words.

The Big One

One company, Amazon, controls 67 percent of the e-book market in the United States—down from 90 percent five years ago. September/October 2014 new-big-one-5

Copyright © 2014 by Pacific Standard and The Miller-McCune Center for Research, Media, and Public Policy. All Rights Reserved.