GDELT, a digital news monitoring service backed by Google Jigsaw, has released a massive, open set of linking data, containing 1.78 billion links in CSV, with four fields for each link: "FromSite,ToSite,NumDays,NumLinks."
The dataset has been purged of boilerplate links from headers and footers and is intended to help researchers analyze trends in linking behavior, in service of GDELT's mission to "support new theories and descriptive understandings of the behaviors and driving forces of global-scale social systems from the micro-level of the individual through the macro-level of the entire planet."
It's 396MB compressed, or 986MB uncompressefd.
One of the most useful ways to use this dataset is to sort by the "NumDays" field to rank the top outlets linking to a given site or the top outlets that linked to another outlet. Using the NumDays field allows you to rank connections based on their longevity and filter out momentary bursts (such as a major story leading an outlet to run dozens and dozens of articles linking to an outside website for several days and then never linking to that website again).
The entire dataset was created with a single line of SQL in Google BigQuery, taking just 64.9 seconds and processing 199GB.
Who Links To Whom? The 30M Edge GKG Outlink Domain Graph April 2016 To Jan 2019 – The GDELT Project [GDELT Project]
(via Naked Capitalism)
In Social media’s enduring effect on adolescent life satisfaction, a pair of Oxford psych researchers and a colleague from Stuttgart's University of Hohenheim review a large, long-running data-set (Understanding Society, the UK Household Longitudinal Study, 2009–2016) that surveyed 12,672 adolescents at eight points over seven years.
Change My View (previously) is a wonderful subreddit founded by a Scottish highschooler named Kal Turnbull as a forum where people can conduct honest inquiry and debate, where the house-rules ensure that there is an open-minded willingness to have your views changed, and where those changes are marked with a Δ (delta) symbol.
A year ago, smarting over public criticism of its role in promoting division and stoking racism, Facebook announced a major shift in its newsfeed algorithm which would downrank posts from media organizations and uprank the things sent by your friends on the network, in the name of promotion a gentler form of "engagement" that would […]
If you’re into tools or gadgets, Memorial Day weekend is your Christmas. Take an extra 15% off the final price of these DIY accessories – all of which are already on sale – by entering the promo code WEEKEND15. LUXJET Universal 24-in-1 Magnetic Screwdriver Set & Repair Kit This small but sturdy kit won the […]
If you can build a cloud infrastructure, you can build a business. Companies are overwhelmingly turning to cloud computing to set up or bolster their network, and it’s easy to see why. It allows on-demand access to processing power, a la carte services, and nearly unlimited storage, all without adding extra systems and the maintenance […]
Does your gaming setup need an upgrade? No need to wait for Christmas. We’ve rounded up the latest tech accessories for your favorite video game platforms. All of them are already sale priced, but you can knock an additional 15% off the final price for Memorial Day by using the online code WEEKEND15. Audeze Mobius […]