Youtube Kids spammers rack up billions of views on disturbing, violent, seemingly algorithmic videos

James Bridle takes a deep dive into the weird world of Youtube Kids videos, whose popular (think: millions and millions of views) genres and channels include endless series of videos of children being vomited on by family members and machinima-like music videos in which stock cartoon characters meet gory, violent ends.

As Bridle points out, it's hard to tell exactly what the actual fuck is going on here. Is this algorithmic content being spun by a machine learning system with a copy of Blender, an archive of public domain nursery rhyme songs, and a handful of stock superhero characters? Is it mechanical turks in some dank boiler room being paid to create endless variations on a theme? Is it the latest project from the weird animated Taiwanese animated news recap service?

And while the videos are sometimes funny-ha-ha and always funny-strange, we can't forget that these are targeted at extremely young children, who often watch unattended. What's more, their anodyne soundracks have nothing to alert parents who use audio cues to tell them when it's time to supervise their kids' viewing.

Bridle coined the term New Aesthetic in 2012 to describe pretty much exactly this kind of thing, and has spent the years since cataloging and creating funny, absurd and thought-provoking examples of the genre.

But Youtube Kids has shocked Bridle to his marrow. The mysterious nature of the videos' production cycle and the way they epitomize the "attention economy"'s worst traits makes them a kind of exploitative version of the propaganda machines that haunt Twitter and Facebook, but aimed at tiny children, for the sole purpose (seemingly) of racking up ad-views. The traumatizing nature of these videos seems to be beside the point.

I was a TV junkie growing up and I watched a lot of shitty, ill-conceived, cynically produced animations that were produced to provide very cheap content to fill the very early hours of the morning on broadcast TV. Even by those standards, this stuff is weird, disturbing, and cynical.

To expose children to this content is abuse. We’re not talking about the debatable but undoubtedly real effects of film or videogame violence on teenagers, or the effects of pornography or extreme images on young minds, which were alluded to in my opening description of my own teenage internet use. Those are important debates, but they’re not what is being discussed here. What we’re talking about is very young children, effectively from birth, being deliberately targeted with content which will traumatise and disturb them, via networks which are extremely vulnerable to exactly this form of abuse. It’s not about trolls, but about a kind of violence inherent in the combination of digital systems and capitalist incentives. It’s down to that level of the metal.

This, I think, is my point: The system is complicit in the abuse.

And right now, right here, YouTube and Google are complicit in that system. The architecture they have built to extract the maximum revenue from online video is being hacked by persons unknown to abuse children, perhaps not even deliberately, but at a massive scale. I believe they have an absolute responsibility to deal with this, just as they have a responsibility to deal with the radicalisation of (mostly) young (mostly) men via extremist videos — of any political persuasion. They have so far showed absolutely no inclination to do this, which is in itself despicable. However, a huge part of my troubled response to this issue is that I have no idea how they can respond without shutting down the service itself, and most systems which resemble it. We have built a world which operates at scale, where human oversight is simply impossible, and no manner of inhuman oversight will counter most of the examples I’ve used in this essay. The asides I’ve kept in parentheses throughout, if expanded upon, would allow one with minimal effort to rewrite everything I’ve said, with very little effort, to be not about child abuse, but about white nationalism, about violent religious ideologies, about fake news, about climate denialism, about 9/11 conspiracies.

Something is wrong on the internet [James Bridle/Medium]

Loading...