Features Podcasts Family Video Comics Music Tech Science Books Film & TV Games

Update on the Boing Boing post release for your weekend project

You are planning to make something cool with the last 11 years of Boing Boing posts, right? Here's a quick update on the release from earlier in the week:

• So far, the XML file I posted last week has been downloaded 2,500 times. Woo! We're very excited to see what you all do with it.

macartisan on Twitter noticed some validation errors in the original XML file, and others of you saw similar issues. Fortunately, ntoll at FluidDB fixed these errors while working with the data. The XML file has been updated so you won't have to worry about wonky characters while parsing it.

• ntoll also converted the file to JSON for those of you who don't want to deal with XML. That file is available for download as well, and has some extra goodies like better category organization and a list of URLs and domains mentioned in each post.

• The FluidDB for Boing Boing has finished parsing. You will now be able to access all 64,000 posts through their API. ntoll is also adding the URL and domain information from the JSON file to the API. He'll be doing a write up with some examples and explanations on how to use the API soon.

If you've got some time this weekend, and want to play around with a huge collection of text, URLs and other interesting information, we'd love to see what you come up with. You can send me your projects directly at dean@boingboing.net or on Twitter.

Eleven years of Boing Boing posts available in [XML], [JSON] and via [FluidDB]

Publicly accessible and mutable Boing Boing API compiled overnight

On Tuesday I released the last eleven years of Boing Boing posts all in one file to celebrate Boing Boing's recent anniversary. Large datasets are fun, and we wanted to see how the great minds of our readers would twist all this information into something more awesome.

We were not disappointed. This morning I found out that ntoll over at FluidDB collected all the information in the XML file into their centralized database system. ntoll's post on the FluidDB Boing Boing repository explains a little bit about the structure of their system and how to access it as an API for use in other web applications, programs or plugins.

The system is pretty easy to access using their various wrappers (in Python, for example). You can find the documentation for FluidDB here as well if you're interested in developing an application on top of this database system.

Clearly, this is a very interesting project with a lot of far-reaching implications for developers and interested people looking to play around with the Boing Boing archives. I'm looking forward to seeing what new applications of our data come out of this.

If you're working on something neat with this data, you can let me know directly either at dean@boingboing.net or via Twitter.

[How we made an API for BoingBoing in an evening] Thanks Tom!

Housekeeping: How to submit stuff to Boing Boing

Boing_Boing_Portrait_by_Nick_Foster.jpg Found something awesome on the net? Made something awesome on the net? There are three ways to submit it to Boing Boing! 1: Add it to our Submitterator. This is the single best way to get our attention! It's the first place we look and public discussion and voting pushes items to the top of the queue. 2: If it's a photo or an image, you can add it to our Flickr pool. 3: You can submit things privately through this form. While stuff sent @boingboing on Twitter might get spotted, please do not send submissions via personal email or Twitter accounts! Every time you do this, a sniper takes out a unicorn. (Illustration by the awesomely talented Nick Foster.)

Guestblogger signing off!

diegodoppleganger.jpgI am signing off as a BB guest blogger. It has been a great deal of fun to post here occasionally and I was very happy to contribute to a site I have been reading for years. Thanks to all the BB editors who write articles provoking thoughts, laughter, and outrage. Particular thanks to Rob Beschizza for helping me craft my pieces and providing excellent layout work on a number of features. I will still be a not-so-mild-mannered professor and continue my work with CAPL to provide free, high quality, authentic images for the foreign language teaching community. Most of all, I would like to acknowledge to support of my family of three amazing kids and my smokin' hot wife Christy. She is also a foreign language professor and I have never met someone who is simultaneously so intelligent and kind hearted. Much of my work owes a great deal to her support and critical eye. Sláinte!

Eleven years' worth of Boing Boing posts in one file!

(image: number of Boing Boing posts per month by author, click to see larger)

Having very recently celebrated Boing Boing's eleventh bloggaversary, we're releasing an update of our previous archival release of Boing Boing posts.

This time, we're releasing a 120.3MB XML file (38.3MB zip) of 63,999 posts for your parsing pleasure. The whole file is released under a Creative Commons license that allows you to noncommerically remix and distribute it in whole or in part -- go crazy!

The first time we released a dump like this, Andy "Waxy" Baio made this breakdown of our blogging activity. More recently, I've been toying with this data behind the scenes and finding some interesting things. We want to see what you can do with it!

Happy (belated) Bloggaversary to us, and thanks to all of you for sticking with us for so many years.

[Download the zipped XML file here]

A decade of Wikipedia: lesser-known miracles

wp-10th.jpg Image: a few of the remixable design elements, via Wikimedia Commons

It's no secret that I love Wikipedia, which I consider one of the grandest and most radical social experiments of our time, and the very best example of what the free culture movement offers for the world's future. I even love Wikipedia critics. There's nothing I love more than to improve an article after some whiny-baby complains about its quality with a copypasta example. For instance, novelist Jonathan Lethem was bagging on "the infinite regress of Wikepedia [sic] tinkering-unto-mediocrity" the other day. Too bad The Atlantic has no way for readers to fix that typo in the way I updated the article on Blake Edwards' cult classic The Party, which was the object of Lethem's scorn. He seems to miss the point that an encyclopedia article, even one about a screwball comedy, is supposed to be dry, factual, and not especially screwball. Just the facts, ma'am. I also love that his snapshot of the page is no longer that relevant.

In the past I have discussed Wikibumps (like the spike of a million readers who checked out the Salvia article in the week after the Miley Cyrus bong video) and the Click to Jesus game, where you see how few links it takes to get from a random Wikipedia article to the Jesus article. Here are a couple of other good reasons to love Wikipedia and its sister projects which you may not have seen:

Best of Wikipedia Tumblr page
Raul's Laws, possibly the best and wonkiest explanation of how Wikipedia works

Commons Picture of the Year contest winners
2006
2007
2008
2009

I hope you'll swing by, learn some things, maybe improve something (they even have a secure server option). There is still plenty to do, and it will never be completed. At the very least, just marvel at the possibilities for the future of free culture embodied in the project. What are some of your favorite things about it? Please share in the comments.

Just look at this list of Boing Boing post titles

boingboingboingboingboing.jpg

Frank Chimero makes fun of some of our most cheesy post titles. Merlin Mann elaborates: Boing Boing is "auguring the deliberate perversion of [our] talent in the service of gavaging a profitable but pathologically undemanding audience."

Oh my God, not gavaging! But we're not without our defenders. Speaking of which, if The Awl is not on your daily reading list, you're just not on the Internet yet.

It's true that much here links daily to cultural ephemera, often dozens of times a day. But I'd like to make sure you read some of the awesome original features, blog posts, stories and galleries that we've published lately, including work by some very talented writers. Evidently, these are easy to miss!

Yakuza 3 played, reviewed and fact-checked, by the Yakuza.
The Last Hospice
Seen not heard: how obscure security makes school sucks
Caught Sleeping: Jason Rohrer's latest story
Hajj for Heathens
Less talk, mess rock: The native language of video games is neither spoken nor written
Being Dead in Pittsburgh
Making the Unreal Real
Maps
Death in Space and Cassini: Trip Reset
That Sinking Feeling
Neo-Minimalism and the Rise of the technomads
Leaking Secrets, Leaking Blood
30 mosques in 30 days
Portraits of the Mind
Bicycle Diaries
The inner life of Furries
Nomen Ludi (fiction)
1906
Totally awesome space colonies
Charting the frozen continent
High Design

I'm particularly proud of Maggie's item on Gliese581g, which went up in this form while others were still blogging the breaking news: Potentially habitable exoplanet discovered. Shame it doesn't exist, lol.

These and more are at our features page. We've also produced hundreds of original video episodes (YouTube channel).

Discussing Wikipedia's first decade on The Takeaway, 7:20am Eastern

For you early risers, I'll be discussing the tenth anniversary of Wikipedia with John Hockenberry on The Takeaway at 7:20 am Eastern time. Check your local listings or the live stream. Here's the show archive. The producers made a fun listener quiz for the occasion. Happy anniversary, Wikipedia!

CicLAvia on Kickstarter

FUN_6206.jpg

Earlier this year, Los Angeles hosted it's first CicLAvia (blogged here previously)— an event which closed off 7.5 miles of city streets to cars for a full day allowing cyclists and pedestrians full use of the roadways. It was a huge success with over 100,000 residents showing up on 2 wheels rather than 4. Yes, this happened in Los Angeles, dare I say one of the most "car-positive" cities in the world. The organizers are working on plans for the next CicLAvia for 2011 and have teamed up with Kickstarter to help raise some funds. They are hoping to bring in $5K, and have a bit over $1K right now. I just donated because I think it's a super worthwhile cause, and because I ride my bike in LA on the streets all the time anyway and being able to do it every once and a while without worrying about getting run over is awesome.

ciclavia.jpg

[Top photo by Alex Thompson, bottom by Waltarrrrr]

Boing Boing Charitable Giving Guide, the 2010 edition

Boing Boing's charitable giving guide has become a seasonal tradition of ours, listing the charities we personally support and want to give more attention to. As in previous years, we invite you to add your own favorite charities in the comments section.

Last year, the econopocalypse gave the charitable sector a rough holiday season. A year on, improvements are slow to come. But many of these charities help keep the world fair, free and healthy, so please spare what you can.

Electronic Frontier Foundation

It seems like every year, EFF's reason for existence becomes more self-evident: from Wikileaks-panic censorship to cozy telcoms deals to scuttle network neutrality to scary evoting mysteries to more warrantless wiretapping... EFF was founded by people who realized that the electronic world would quickly become as important as the real world for many aspects of our lives, and that the civil liberties battles we've fought in "real life" would have to be fought all over again online, by technically skilled, principled people. EFF always gets my biggest donation -- because our future is riding on it.

Creative Commons:

Creative Commons has permeated my life in a thousand ways -- on Boing Boing and in my writing, Creative Commons is responsible for how I get the job done and how I get paid for it. CC's advocacy of a nuanced, intelligent position on creativity and sharing changes the lives of creators, educators, scientists, scholars, and kids, all over the world. —CD

Read the rest

Facebook Community Council quietly closes

facebook-council.jpg Last year, I mentioned that I was one of about 350 people tapped to participate in Facebook Community Council, an experiment in crowdsourced content moderation. We'd slog through profiles and sites tagged as inappropriate by other users (tags included nudity, attacking, drugs, and violence). And there were plenty of each, especially the first two. A million tags later, we got the following notice (verbatim):
Thank you for participating in the Facebook Community Council.We will be shutting down starting this week, and will let you knowwhen we start another experiment.
Despite my fifth-place showing, I was not awarded a prize. I suspect they now have image and text recognition algorithms that make mere humans ineffective except in the more subtle forms of abuse. Over time, we saw a lot less penis and puke pics and "___ sucks" Facebook groups, and a lot more subtle trolling of middle and high school students and teachers. It was certainly interesting to see what garden-variety low-level trolling looks like these days. There were a lot of similarities to Wikipedia vandalism: a lot of one-off drive-by crap, with a few people fixated on gaming the system in ever more subtle ways.

Respect the Internet live feed tomorrow 12/3/2010

I'm speaking tomorrow in New York at Ketchum's day-long conversation / debate "about the role companies can (and should or should not) play in shaping online culture." There will also be speakers from ROFLCon, Buzzfeed, VICE, Gawker Media, MIT, and Harvard. My talk is going to be about DIY innovation and why it's smart for companies to become "maker friendly."

It should be interesting! You can watch a live feed of the event here.

Speakers:

Mark Frauenfelder, the editor of Boing Boing and MAKE Magazine 


Jonah Peretti, founder of Buzzfeed and the Huffington Post 


Alexis Ohanian, co-founder of Reddit and founder of Breadpig 


Tim Hwang, co-founder of ROFLCon 


Grant McCracken, anthropologist and author of the highly-praised book Chief Culture Officer 


Alex Pasternack, editor of Motherboard.tv, VICE Magazine's science and technology culture site 


Irin Carmon, blogger for Jezebel 


Christina Xu, co-founder of ROFLCon and of Breadpig 


Jeff Simmermon, Director of Digital Communications for Time Warner Cable 


Scott Heiferman, co-founder & CEO of MeetUp.com 


N'Gai Croal, founder of Hit Detection, video games expert & blogger for Newsweek 


Patrick Davison, one third of MemeFactory, researcher at the Web Ecology Project 


Joe Brown, blogger and reporter for Gizmodo and WIRED 


Greg Leuch, the genius who created "Shaved Bieber" & a member of F.A.T. Lab 


Mike Rugnetta, one third of MemeFactory, the definitive performance art piece about internet culture 


Lilit Marcus, co-founder of Save The Assistants, editor-in-chief of TheGloss.com If you are interested in attending the live event in NYC tomorrow (it's free but space is limited), reserve a spot here. (password is "ketchum")

Twitter, Where's My Car?

Seattle police use a dedicated Twitter account to report the details of verified car thefts. It's crowdsourcing police work! Police in other cities have tried this, but Seattle has a bizarrely high car theft rate, partly due to a logistical problem in the courts in which car thieves are routinely charged with misdemeanors and released.

Joel versus the volcano

Joel Johnson delivers a blistering smackdown to the trolls, miscreants and entitled creeps who infest comment threads at Gizmodo.

Emergency Unicorn Delivery

unicornmoment.jpg

Newer Entries - Older Entries