In 2012, Chicago PD collaborated with the RAND Corporation and the Illinois Institute of Technology to automatically generate "risk scores" for people they arrested, which were supposed to predict the likelihood that the person would be a "party to violence" in the future (this program was called "TRAP" -- Targeted Repeat-Offender Apprehension Program" -- seemingly without a shred of irony). Now, that program has been shut down, and the City of Chicago's Office of the Inspector General has published a damning report on its eight-year reign, revealing the ways in which the program discriminated against the people ensnared in it, without reducing violent crime. Read the rest

Ring is Amazon's surveillance doorbell division, and a big part of their sales strategy involves terrifying people about the possibility of crime, partnering with police to assist in terrorizing Ring owners, and to provide police with warrantless, permanent, shareable access to surveillance doorbell footage (something the company has repeatedly lied about). Hundred of police departments have now partnered with Ring and they act as buzz-marketing teams for the company in exchange for freebies and access. Read the rest

Princeton computer scientist Arvind Narayanan (previously) has posted slides and notes from a recent MIT talk on "How to recognize AI snake oil" in which he divides AI applications into three (nonexhaustive) categories and rates how difficult they are, and thus whether you should believe vendors who claim that their machine learning models can perform as advertised. Read the rest

New Orleans is festooned with police cameras, the legacy of a secret partnership with the surveillance contractor Palantir, which used New Orleans as a covert laboratory for predictive policing products. Read the rest

"Predictive policing" is the idea that you can feed crime stats to a machine-learning system and it will produce a model that can predict crime. It is garbage. Read the rest

Predpol (previously) is a "predictive policing" company that sells police forces predictive analytics tools that take in police data about crimes and arrests and spits out guesses about where the police should go to find future crimes. Read the rest

After learning that Amazon was pushing the use of Rekognition, its facial recognition tool, for use in policing (a global phenomenon that is gaining momentum despite the material unsuitability of these tools in policing contexts), the ACLU of Northern California had a brainwave: they asked Rekognition to evaluate the faces of the 115th Congress of the United States. Read the rest

In 2009, JP Morgan Chase's "special ops" guy was an ex-Secret Service agent called Peter Cavicchia III, and he retained Palantir to spy on everyone in the company to find "insider threats"; even getting the bank to invest in Palantir. Read the rest

Palantir Technologies is a data-mining firm that loves it some predictive policing: computer-aided sorcery that uses data models to try and predict where crimes may occur and who's got a reasonable chance of committing them.

For predictive policing to work well, the predictive model being built needs to be well fed with data on criminals, their first, second and third-person acquaintances, their social media accounts, and crime statistics for the area where the model is meant to be seeing crimes before they may possibly happen. It sounds like shit right out of Minority Report, because it kinda is – just without spooky kids in a swimming pool and a hell of a lot less accuracy.

Accurate or not, the notion of predictive policing raises a number of civil rights and privacy concerns. The ACLU isn't down with it, as the methodology of stopping someone without reasonable suspicion is against the Fourth Amendment. In their eyes, computer-aided guesses don't cut it when it comes to justifying a stop-and-frisk. China's been using it to snoop on their citizens and has been sending suspected radicals and political dissidents for re-education, just in case they decided to protest their nation's ruling party's status quo. It's creepy shit.

Anyway, back to Palantir.

Did I mention that it was started up by Peter Thiel with money seeded by the CIA? No? How about the fact that they've been running an off-the-books program with the New Orleans Police so secretive that the city's own government didn't have a clue that it was going on? Read the rest

Weeks before the publication of Virginia Eubanks's new book Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor, knowledgeable friends were already urging me to read it, which was a no-brainer, having followed Eubanks's work for years.

Matt Taibbi is one of the best political writers working in the USA today, someone who can use the small, novelistic details of individuals' lives illuminate the vast, systemic problems that poison our lives and shame our honor; his 2014 book The Divide conducts a wide-ranging inquiry into the impunity of corporate criminals and the kafkaesque injustices visited on the poor people they victimize; in I Can't Breathe: A Killing on Bay Street, Taibbi narrows his focus to the police murder of Eric Garner, a Staten Island fixture and father, and the system that put murderers in uniform in his path.

Researchers from the Human Rights Data Analysis Group (previously) reimplemented the algorithm Predpol predictive policing system that police departments around America have spent a fortune on in order to find out where to set their patrols, and fed it Oakland's 2010 arrest data, then asked it to predict where the crime would be in 2011. Read the rest

In Chicago, the "Heat List" system is used to direct policing resources, based on data-mining of social media to identify potential gang-members; the model tells the cops where to go and who to arrest, and is supposed to reduce both violent crime and the likelihood that suspects themselves will be killed -- but peer-reviewed analysis (Scihub mirror) of the program shows that while being on the Heat List increases your chances of being harassed and arrested by Chicago PD, it does not improve crime rates. Read the rest