contributor Tom Owad just published a mind-blowing how-to on his website explaining how to mine Amazon's wish list database to uncover "subversives."
Using a pair of 5-year-old computers, two home DSL connections, 42 hours of computer time, and 5 man hours, I now had documents describing the reading preferences of 260,000 U.S. citizens.
I downloaded all the files to an external 120 GB Firewire drive in UFS format. The raw data occupied little more than 5 GB. I initially wanted to move all the files into a single directory to facilitate searching, but as the directory contents exceeded 100,000 items, the speed became glacially slow, so I kept the data divided into chunks of 25,000 wishlists.
Next comes the fun part – what books are most dangerous? So many to choose from. Here's a sample of the list I made. Feel free to make up your own list if you decide to try some data mining. Send it to the FBI. I'm sure they'll appreciate your help in fighting terrorism.
Reader comment: Anonymous says: "[This] method for grabbing the wishlists is
overly complicated. Amazon's web services API allows programmatic access to wishlist
information, making it even easier for a savvy programmer to quickly
compile a list of customers interested in certain books."
With the cacophony of an election year ablaze with unparalleled drama being fought on the front lines of Twitter, we find ourselves slowing down and staring at it like a bad accident. The need for escapist relief is perhaps more dire than usual right now. This fall, if it’s drama you crave, but the Hillary […]
Today a future without schools. Instead of gathering students into a room and teaching them, everybody learns on their own time, on tablets and guided by artificial intelligence. Flash Forward: RSS | iTunes | Twitter | Facebook | Web | Patreon | RedditIn this episode we talk to a computer scientist who developed an artificially […]
Where are our petabyte drives? Brian Hayes takes us through the reasons storage is “stuck” in the low terabytes. The tl;dr is that we got such exceptional capacity growth in the late 90s and early 00s we don’t need much more right now, so the focus since then has been on SSDs, networking, interfaces, etc, […]
These days, the vape market is saturated with low-quality products, making it nearly impossible to separate the gems from the duds. The Atmos Rx Dry Herb Vaporizer stands out from crowd for two reasons: its impressive battery life and durable construction. This high-end little gadget is compact enough to fit in your pocket, and packs a powerful punch, […]
If you’re like us, you occasionally get ambitious with your dinner and try to cook multiple sides plus a main dish. These efforts usually end as a cold meal plus a pile of dishes to wash. MasterPan Multi-Sectional Meal Skillet makes it super easy to make multiple dishes at once without the hassle. This heavy gauge bottom pan […]
The Lytro Illum is our all-time best-selling camera and here’s our best deal yet. Apply the code “Lytro10” to save an extra 10% off on this camera’s mind-blowing functionality in this exclusive one day only sale.