Graphcore produced a series of striking images of computational graphs mapped to its "Intelligent Processing Unit."
The graph compiler builds up an intermediate representation of the computational graph to be scheduled and deployed across one or many IPU devices. The compiler can display this computational graph, so an application written at the level of a machine learning framework reveals an image of the computational graph which runs on the IPU.
The image below shows the graph for the full forward and backward training loop of AlexNet, generated from a TensorFlow description.
Our Poplar graph compiler has converted a description of the network into a computational graph of 18.7 million vertices and 115.8 million edges. This graph represents AlexNet as a highly-parallel execution plan for the IPU. The vertices of the graph represent computation processes and the edges represent communication between processes. The layers in the graph are labelled with the corresponding layers from the high level description of the network. The clearly visible clustering is the result of intensive communication between processes in each layer of the network, with lighter communication between layers.
There aren’t many details in Trump’s “American A.I. Initiative,” but the point appears to be: send a message of technological dominance to China.
Stanford folklorist and science historian Adrienne Mayor has a fascinating-sounding new book out, titled “Gods and Robots: Myths, Machines, and Ancient Dreams of Technology.” It’s a survey of how ancient Greeks, Romans, Indian, and Chinese myths imagined and grappled with visions of synthetic life, artificial intelligence, and autonomous robots. From Mayor’s interview at Princeton University […]
Editor’s Note: Richard Metzger is a connoisseur of cannabis, and recently started growing his own. He’s test-driving high-end rig good for small-scale grows from Cloudponics. This is not a sponsored post, Boing Boing is not getting anything from Cloudponics. Metzger’s just really *that* enthusiastic about weed, and so far he likes the Cloudponics setup. Here’s […]
Use a single password for every website, and you’re compromising your security. Use a different one each time, and you’re bound to lose track of them. The solution? RoboForm Everywhere, a catch-all tool that will not only manage the passwords on every site you visit but generate better ones. As a simple password database, it’s […]
Just a reminder: Print isn’t dead. And now that printers are becoming as portable as cell phones, it might be around for quite some time. Enter the MEMOBIRD Mobile Thermal Printer, a mini-printer that is versatile, portable – and most importantly, never needs a refill on ink or toner. Measuring just a few inches around, […]
What do Facebook, Twitter, YouTube and Google all have in common? Somewhere in their framework, they all use MySQL, that most versatile (and free!) of database management systems. And they’re not alone. If your company or the one you’d like to work for wrangles data (and who doesn’t?), they’re going to need someone with a […]