While NIST doesn't speculate as to why, it did find that the performance of 189 facial recognition algorithms from 89 different vendors varied by "race, sex and age" -- that is, the systems performed significantly worse when asked to recognize people who weren't young, white and male. Read the rest

Every year, the AI Now Institute (previously) publishes a deep, thoughtful, important overview of where AI research is and the ethical gaps in AI's use, and makes a list of a dozen urgent recommendations for the industry, the research community, and regulators and governments. Read the rest

For ten years, activists and theorists have been developing a critique of "algorithms" (which have undergone numerous renamings over the same time, e.g. "filter bubbles"), with the early critiques focusing on the way that these can misfire with dreadful (or sometimes humorous) consequences, from discrimination in which employment and financial ads get served to the "dark patterns" that "maximized engagement" with services that occupied your attention but didn't bring you pleasure. Read the rest

Ring is Amazon's surveillance doorbell division, and a big part of their sales strategy involves terrifying people about the possibility of crime, partnering with police to assist in terrorizing Ring owners, and to provide police with warrantless, permanent, shareable access to surveillance doorbell footage (something the company has repeatedly lied about). Hundred of police departments have now partnered with Ring and they act as buzz-marketing teams for the company in exchange for freebies and access. Read the rest

In my latest podcast (MP3), I read my short story "Affordances," which was commissioned for Slate/ASU's Future Tense Fiction. it's a tale exploring my theory of "the shitty technology adoption curve," in which terrible technological ideas are first imposed on poor and powerless people, and then refined and normalized until they are spread over all the rest of us. Read the rest

"Affordances" is my new science fiction story for Slate/ASU's Future Tense project; it's a tale exploring my theory of "the shitty technology adoption curve," in which terrible technological ideas are first imposed on poor and powerless people, and then refined and normalized until they are spread over all the rest of us. Read the rest

Researchers at the University of Copenhagen analyzed 3.5 million English language books published between 1900 to 2008 to identify the adjectives most frequently applied to men and women. Unsurprisingly, women were described by their bodies and appearance and men were described by their thoughts and behavior. The World Economic Forum points out that computer algorithms that make important decisions about people's lives were trained using much of the same data.

“We are clearly able to see that the words used for women refer much more to their appearances than the words used to describe men. Thus, we have been able to confirm a widespread perception, only now at a statistical level,” says computer scientist and assistant professor Isabelle Augenstein of the University of Copenhagen’s computer science department.

The researchers extracted adjectives and verbs associated with gender-specific nouns (e.g. “daughter” and “stewardess”). For example, in combinations such as “sexy stewardess” or “girls gossiping.” They then analyzed whether the words had a positive, negative, or neutral sentiment, and then categorized the words into semantic categories such as “behavior,” “body,” “feeling,” and “mind.”

The dataset is based on the Google Ngram Corpus.

Their analysis demonstrates that negative verbs associated with body and appearance appear five times as often for female figures as male ones. The analysis also demonstrates that positive and neutral adjectives relating to the body and appearance occur approximately twice as often in descriptions of female figures, while male ones are most frequently described using adjectives that refer to their behavior and personal qualities.

A lot of companies struggle with bias in the workplace, but for many big tech companies, the problem is a bit more extreme. Why, because it's not just the human beings that are racist, a lot of their algorithms are biased too. This is the problem that Google reportedly was trying to solve when they got themselves into their latest privacy scandal, tricking black and brown “volunteers” to submit to 3D face scans. Read the rest

Jonathan Zittrain (previously) is consistently a source of interesting insights that often arrive years ahead of their wider acceptance in tech, law, ethics and culture (2008's The Future of the Internet (and how to stop it) is surprisingly relevant 11 years later); in a new long essay on Medium (shorter version in the New Yorker), Zittrain examines the perils of the "intellectual debt" that we incur when we allow machine learning systems that make predictions whose rationale we don't understand, because without an underlying theory of those predictions, we can't know their limitations. Read the rest

I used to be on the program committee for the O'Reilly Emerging Technology conferences; one year we decided to make the theme "magic" -- all the ways that new technologies were doing things that baffled us and blew us away. Read the rest

Rob Smith is an eminent computer scientist and machine learning pioneer whose work on genetic algorithms has been influential in both industry and the academy; now, in his first book for a general audience, Rage Inside the Machine: The Prejudice of Algorithms, and How to Stop the Internet Making Bigots of Us All, Smith expertly draws connections between AI, neoliberalism, human bias, eugenics and far-right populism, and shows how the biases of computer science and the corporate paymasters have distorted our whole society. Read the rest

A new study from Facebook AI Research evaluates common machine-learning classifiers' ability to label photos of objects found in households in rich countries versus household objects from poor countries and finds that the models' performance lags significantly when being asked to classify the possessions of poor people. Read the rest

Every year, the Mozilla Foundation releases a massive "Internet Health Report" summarizing the ways in which the internet is being used to both support and subvert human thriving; though these reports cover a wide range of topics, every year the foundation chooses a small number of themes to focus on. This year, they are Let's Ask More of AI; The Power of Cities and Rethinking Digital Ads. Read the rest

The Safe Face Pledge launched last month as a "pledge to mitigate abuse of facial analysis technology," with four themes: "Show Value for Human Life, Dignity, and Rights;" "Address Harmful Bias"; "Facilitate Transparency"; and "Embed Commitments into Business Practices" (SAFE). Read the rest

Cash bail has turned American jails into debtors' prisons, where the wealthy can go about their business while awaiting trial, and the poor can languish for months or even years in jail because they can't make bail (in practice, they generally plead guilty, regardless of their innocence). Read the rest

Research into the shittiness of voice assistants zeroed in on a problem that many people were all-too-aware of: the inability of these devices to recognize "accented" speech ("accented" in quotes because there is no one formally correct English, and the most widely spoken English variants, such as Indian English, fall into this "accented" category). Read the rest

It's illegal to discriminate based on "protected classes," including "men and women on the basis of sex; any group which shares a common race, religion, color, or national origin; people over 40; and people with physical or mental handicaps" but from the earliest days of its self-serve ad platform, Facebook gave advertisers the ability to exclude people from ads for jobs, financial products, housing and other necessities based on these categories. Read the rest