Want 80 terabytes of web-crawl? The Internet Archive will give you a copy of (an appreciable slice of) the Web, for research purposes: "we would like to experiment with offering access to one of our crawls from 2011 with about 80 terabytes of WARC files containing captures of about 2.7 billion URIs. The files contain text content and any media that we were able to capture, including images, flash, videos, etc."

  • http://twitter.com/DankNuggington Dank Nuggington

    So that’s like 79 terabytes of porn and some misc. news sites right?

  • http://www.facebook.com/profile.php?id=25519513 Joe Foster

    So many dicks.

    • William Rose

      So little time.

  • Jake0748

    It reminds me of the (really) old Dilbert cartoon where the pointy-hair boss asks Dilbert if he would download a copy of the internet and put it on a floppy for him. 

    • howaboutthisdangit

      Have a couple extra floppies on hand, just in case.

    • Tom Hunter

      Wow…that must be REALLY old! Like maybe aben 15 years old! Ancient!

  • howaboutthisdangit

    It’s one thing to have an offline copy of a website or wiki, but this….

    I’ve got about 600G available on my primary drive.  I wonder if I can free up another 79.5T?

    • Tom Hunter

       It is not made for individuals to get just for laughs. IT is for research purposes.

  • nowimnothing

    Is it weird that 79 terabytes seems small? Maybe the whole 1999 web would fit on that, but 2008 with photo-sharing websites?
    I have a 2T media server and I am working on fitting my dvd library on it. I know it will run out of room before I am done.

    • Tom Hunter

      Well, not everyone can be as special as you to have over 2 TB of movies…98% of which you will never watch again. 

      • Matthew11

        Nope, most of us ave 10+TB of movies, I’m currently trying to convert my entire collection of blu-ray’s, DVD’s as well as digital media into a more easy to access form, a signle 3D movie is pretty big in a lossless format so it doesn’t take much even paring it down to the cream of the collection.

      • nowimnothing

        That is only about 200 uncompressed dual layer DVDs. Start throwing in 30 disc TV series like Kids in the Hall and Monty Python (pretty sure I will watch those again) and that 2T goes fast.

  • Jorpho
  • http://www.facebook.com/people/Bruce-Miller/100000952005408 Bruce Miller

    . . . and the point is?