FedEx's file-transfer capacity versus the Internet

Discuss

35 Responses to “FedEx's file-transfer capacity versus the Internet”

  1. Rider says:

    A quick glance shows that the act of transferring all the data on and off of the drives is missing from the equation.  This is the most time consuming part of process and leaving it out really skews the results.

    • Sxe says:

      You never need to access all the info at once. Accessing what info you need from a local hard drive is incredibly faster than accessing that from the cloud. Transferring 1TB from one hard drive to another takes what, an hour? How long would it take you to upload 1TB to a cloud storage drive?

      Just look up hard drive transfer rates through network cables, SATA cables, even IDE cables, and compare that with your ISP’s maximum theoretical provided speeds. 

      • elpollodiablo says:

        With a really good consummer SSD hard drive you can maybe get 400MB/s write speed, with good-ol’ platter-spinning hard drives or micro-SD cards you’ll be lucky if you get a 1/4 of that : way faster than your home ISP, but if you got the money you can already buy a faster pipe to the net.

        • ddh819 says:

          you also have to take into account all the other traffic to the net your pipe is handling (email, workers streaming viral videos and music, other actual work related large file transfers).

      • Rider says:

        Again you are totally ignoring the real world.  How are these hard drives hooked up and interfaced?   How are they packed and taken to the airport? There are tons of real world issues that are totally ignored.  

        How is the information accessed and indexed?  

        Why are we totally ignoring the cost involved here?

    • glatt1 says:

       Exactly.  Especially with the example of the milk jug full of 25,000 micro SDs.  How do you find the one correct micro SD that contains the file you want?  And then you have to put it in a card reader and do the actual file transfer. You need an excellent indexing and card storage system.

      • Sean Nelson says:

        It wouldn’t be prohibitively difficult to make a system that turns all those cards into a giant RAID array.  In a properly designed system you wouldn’t need to keep track of which card goes where.  But then you’d just have to  have thousands of card readers on the host machine.  Of course, that would require multiple USB controllers because of the addressing limitations of USB.  

        … Perhaps the milk jug idea is a bit ridiculous after all…

  2. failquail says:

    Awesome transfer rates, but the ping time is going to be murder ;)

  3. arikol says:

    It’s a good thing that I wasn’t drinking tea while reading this, otherwise I would be sending the bill for a new keyboard to Cory.Urinary-tract-infection business model indeed

  4. IndexMe says:

    If only FedEx would publish an API and put a user-defined QR code on the waybill, we could make them a transparent part of the fabric! Get rid of the human element. This would be a great way to back up data centers to locations not susceptible to earthquake, hurricane, etc. and would be a very viable way to create a community-driven global digital delivery network for indie films from studio directly to theaters and homes. I started tongue in cheek but actually it makes a lot of sense! You could have your local 7/11 (which already handles packages and has fiber, net payment kiosks and networked registers where I live) act as intermediate shipping points and copy stations. Just reserve a copy and you can pick up a hard drive or envelope of sd cards within hours after it has arrived at your local hub. You could even work a payment system out with 7/11 either through them, or any of a number of e-payment services (you print a receipt from the net kiosk and then pay at the register). Heck iTunes sells debit cars there next to the shampoo and eyeliner too, why not everyone else? Hmm I’m thinking this is an interesting idea.

    • Stooge says:

      Without a time machine you’re simply saying you want to be the new Blockbuster.

      • JohnQPublic says:

        Funny you say that because for infrequent users, a brick and mortar blockbuster pay-per-use model is cheaper than the more “advanced” online subscription based provider. User consumption pattern is a big determining factor.

      • IndexMe says:

        I’m saying there is no reason to clog up satellites and undersea cables when delay is acceptable, or you have a local cache. There is a use-case for high latency, high volume data distribution such as 4K video. 

        I’m not living in another age. Though I have been lucky enough to be part of some experiments along these lines, such as doing the first live streaming of motion capture data between California and Japan with Silicon Graphics, and getting involved in Carl Malamud’s Internet World Expo which built a 45Mbps Internet Railroad around the world in 1996.

        More recently (at the past few years of the Tokyo International Film Festival) I have seen demonstrations of live global 4K video, from Cinegrid.org (see  http://cinegrid.kmd.keio.ac.jp/english.html ) which for example enables live connections between studio and filming location, or CAVE connections for education. Obviously these are fabulously resource hungry and only usable for limited use-cases. Whereas the world’s P2P bandwidth or Fedex bandwidth offer alternatives. And how does Hollywood distribute their movies globally? I believe by fedexing a hard drive. Sure, streaming is okay. Unless you are the Australian government with a soda straw for a pipe, or want to actually send a high enough quality file to play in a theater or other big screen.

        I’m saying it is prohibitive for any one producer to start mailing hard disks to every country in the world, but if there was an easy to board Internet railroad, or you could think of it as chucking your hard disk into that fabled station wagon as it drives by, just get your content to a single node and would be replicated by fedex and friends and that would be a fabulously enabling global resource.

        Think of it another way: Usenet is over 10TB/day. http://www.newsdemon.com/average-feed-size.php

        Now consider automatic cascading updates – a petabyte sized repository backing a huge, constantly updated library of 10,000 blue-ray quality (50GB) video titles. That’s 500TB. You don’t have to view every one. But it might be a good use for a town library too, wouldn’t it? And if half of it is commercial content, a small fee could pay for the servers. The media (64GB SD cards) is selling for $50 on Amazon. So it makes sense to think of what kind of an application could make use of postal bandwidth (doesn’t need to be fedex) and I think this might be one of them.

        As another data point I was approached last year by a documentary film director who had been tasked at building a very low-cost cultural library of documentary films. His idea was to make a library of USB sticks that fold into a credit card sized piece of plastic, onto which you could affix a printed label like a record cover. A small bookcase would be enough to display a hundred cards – each full of documentaries on a given subject area – which could be copied freely by visitors or viewed there. It seems that postal bandwidth is the only way to maintain an offering like this, and I’m thinking of helping implement it. It would probably be for free or close to it, but could be a useful resource.

    • dculberson says:

       Fedex does publish an API – thousands of businesses use it to ship through them – and the tracking number is  encoded as a standard bar code that’s inherently machine readable.  No need for a QR code when there’s already a bar code on there identifying the package and tracking its location.

    • BillStewart2012 says:

       Is it time to rewrite RFC1149 to update the kinds of avian carriers to use?

    • PaulDavisTheFirst says:

      If only FedEx would publish an API and put a user-defined QR code on the waybill, we could make them a transparent part of the fabric!

      it used to be called “netflix”

  5. GuyInMilwaukee says:

    So FedEx should deliver me a new internet everyday? hmm.. not a bad business model. They also could pick up my emails at the end of the day for delivery. I LOVE the future!

    • JohnQPublic says:

      Perhaps if you are the only customer, carbon footprint can further be reduced by swapping trucks with horse drawn carriages

      • Just_Ok says:

        Horses can’t draw carriages. They can’t hold the pens with their hooves, and if you put a pen in their mouth, they eat it.

    • mccrum says:

      But why use a private contractor to pick up and drop off simple e-mails?  I think a government service could send an e-mail anywhere in the US for, oh, carry the one, divide the… my math says 46 cents.

  6. Robin Davies says:

    Seems like a small task to revise  RFC 1149 (Transmission of IP over Avian Carriers) to encompass IP over Fedex Courier.

  7. SomeGuyNamedMark says:

    The problem with sneakernet is that it has a massive capacity but it is extremely spikey and the packet size is huge.

  8. dross1260 says:

    “Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway.” 

  9. Reminds me of an information systems lecture I had many many years ago involving calculating the data rate of sending a transport aircraft across the Atlantic carrying floppys. Was actually surprisingly high in the hypothetical situation we were given at the time versus traditional internet traffic at the time.

    I guess the main thing was trying to make sure we weren’t too hung up on data and information always meaning electronics or photonics.

  10. Daneel says:

    So when Ted Stevens said the internet was a series of tubes he was referring to fuselages?

  11. xzzy says:

    Once a year or so we have to move vast chunks of data between servers at work, allowing us to retire old machines and get users working on the new ones. Our smallest machines these days are in the 16TB range, the newest ones are over 100TB.

    At any rate, migrating this data is no fun. We have bonded gigabit connections all over the place and never get to use all of it because hard drives are just too damn slow at reading out data. Anecdotally, the best transfer speeds I see are about 2TB copied per day. If either end of the copy is doing other work, rates rapidly go down from there.

    Gonna be a good day when we stop relying on spinning sheets of metal to store our data.. we might actually be able to saturate the network then!

  12. Alexander Borsi says:

    The only issue here is that there are legal ways to rip my DVD movies but there is none for BluRay movies–that I am aware of. Last I checked it was still illegal to rip them, even though the process is technically exactly the same as the DVD movies.

    Please, someone enlighten me on if there has been any development in this area. I would so gladly spend the next month ripping my movies and buying 4TB hard drives if it were legal.

    • TaymonBeal says:

      Isn’t it still technically a DMCA violation to rip DVDs?

      • Alexander Borsi says:

        Technically yes, but the trials that I have been able to find have ruled in favor of the person and not the MPAA. So I feel fairly safe with that, seeing as I still have my entire DVD collection in safe storage in the attic and I only watch them on my own devices.

        From what I understand, BluRay discs use another type of encryption that is protected under something more than DVD’s. That is why it is still a bigger NO-NO

  13. BillStewart2012 says:

    Many years ago, when Netflix was in the DVD-by-mail rental business rather than the download business, somebody estimated that their bandwidth was about 1/3 of the total Internet’s.  4 GB/day is about 300 kbps for an individual user, and Netflix was shipping a lot of DVDs.

  14. Fark says:

    My local 7/11 has an ATM & a smoothie machine. Where the hell are you located!?

    • IndexMe says:

      Tokyo. Though I could be mixing it up with FamilyMart or Lawson their arch-rivals. 7/11 has awesome 7 and i Holdings Bank atms which can withdraw from credit cards even. They also (unless I am thinking FamilyMart) have Internet-connected copying machines so you can upload PDFs and print in A3 color – or use a USB stick. The kiosk machines let you access a ton of services including international phone card purchase, e-money, software purchases, and reservations for concerts and events. You can also pay your electric and gas bills at these places and at least some (am/pm) let you ship boxes via popular couriers. Not available in the U.S.?

  15. batmanroxus says:

    I really wish they could condense this into one sentence and tell me exactly what they are trying to say. 

  16. roselan says:

    And what about good old magnetic tapes data density? I feel you can squeeze one order of magnitude or two in that data plane.

Leave a Reply