GDELT, a digital news monitoring service backed by Google Jigsaw, has released a massive, open set of linking data, containing 1.78 billion links in CSV, with four fields for each link: "FromSite,ToSite,NumDays,NumLinks."
The dataset has been purged of boilerplate links from headers and footers and is intended to help researchers analyze trends in linking behavior, in service of GDELT's mission to "support new theories and descriptive understandings of the behaviors and driving forces of global-scale social systems from the micro-level of the individual through the macro-level of the entire planet."
It's 396MB compressed, or 986MB uncompressefd.
One of the most useful ways to use this dataset is to sort by the "NumDays" field to rank the top outlets linking to a given site or the top outlets that linked to another outlet. Using the NumDays field allows you to rank connections based on their longevity and filter out momentary bursts (such as a major story leading an outlet to run dozens and dozens of articles linking to an outside website for several days and then never linking to that website again).
The entire dataset was created with a single line of SQL in Google BigQuery, taking just 64.9 seconds and processing 199GB.
Who Links To Whom? The 30M Edge GKG Outlink Domain Graph April 2016 To Jan 2019 – The GDELT Project [GDELT Project]
(via Naked Capitalism)
Frontier is the bottom-rung of the top-tier of US ISPs, serving customers in 29 states. Despite enjoying monopoly control over its customers' online lives, and despite massive government handouts and a lackadaisical approach to maintenance, and despite out-and-out theft from customers, the company is filing for bankruptcy, having accumulated $16.3b in debt through mismanagement.
Bruce Schneier's Foreign Policy essay in 5G security argues that we're unduly focused on the possibility of Chinese manufacturers inserting backdoors or killswitches in 5G equipment, and not focused enough on intrinsic weakness in a badly defined, badly developed standard wherein "near-term corporate profits prevailed against broader social good."
Long before 4chan and other anything-goes forums existed, every major online community had a similar community: the Well had its "weird" forum, Usenet had alt.syntax.tactical (among others), and Something Awful had the "Fuck You and Die" forum, where people were funny, mean, obscene, and gross, sometimes all at once.
First, they were all about serving a protective necessary function. But now, about 10 weeks after the explosion of the COVID-19 outbreak, face masks are beginning to serve a different role. Just like all the fashion accessories that came before them, face masks are now showing off a little piece of ourselves to the everyday […]
Promoting products is almost nothing like it was back in the Mad Men days. In fact, the digital landscape has changed the ad game so much that it barely even resembles early Grey’s Anatomy days anymore. Marketing a product digitally isn’t about the right ad slogan or color scheme. It’s about crafting the narrative around […]
Every once in a while, we see a new product come along that’s so versatile and elegantly simple that it’s strange no one’s ever gone there before. Portable lights themselves aren’t new, but there’s something about the MOGICS Coconut Light that’s so seamlessly well-designed and adaptable that it feels startlingly original. The Coconut is basically […]