Graphcore produced a series of striking images of computational graphs mapped to its "Intelligent Processing Unit."
The graph compiler builds up an intermediate representation of the computational graph to be scheduled and deployed across one or many IPU devices. The compiler can display this computational graph, so an application written at the level of a machine learning framework reveals an image of the computational graph which runs on the IPU.
The image below shows the graph for the full forward and backward training loop of AlexNet, generated from a TensorFlow description.
Our Poplar graph compiler has converted a description of the network into a computational graph of 18.7 million vertices and 115.8 million edges. This graph represents AlexNet as a highly-parallel execution plan for the IPU. The vertices of the graph represent computation processes and the edges represent communication between processes. The layers in the graph are labelled with the corresponding layers from the high level description of the network. The clearly visible clustering is the result of intensive communication between processes in each layer of the network, with lighter communication between layers.
Tacotron 2 is Google’s new text-to-speech system, and as heard in the samples below, it sounds indistinguishable from humans. From Quartz: The system is Google’s second official generation of the technology, which consists of two deep neural networks. The first network translates the text into a spectrogram (pdf), a visual way to represent audio frequencies […]
Rodney Brooks is the father of the Roomba, the founder of iRobot, and the creator of both the Baxter and Sawyer product lines from Rethink Robotics. He’s arguably the world’s most accomplished roboticist. And if he’s not – and I personally can’t think of who could challenge him for that crown – he’s definitely the […]
A loud experimental band from Monaco named Hardcore Anal Hydrogen enlisted the aid of artificial intelligence to generate the trippy, psychedelic visuals used in their music video for the track, “Jean-Pierre.” On their site, the band details the ins and outs of how they manipulated Google Deep Dream, Neutral Style Transfer, and DeepFlow to get […]
The web is an invaluable tool for connecting small businesses with their target audiences. However, when it comes to building a website and marketing online, the learning curve can be steep if you’re doing it on your own. The WordPress Essentials Lifetime Bundle can help you out by getting you up to speed with the platform […]
Most of us understand that when we visit a website, we’re subjecting ourselves to surveillance by trackers. And, while these tools are usually used for innocuous purposes, like determining which ads to show you, they can be leveraged for much more nefarious goals, and they have the potential to tank your browsing speed as well as […]
Learning how to code is a great way to improve your hiring potential and open the door to more lucrative careers, but getting the ball rolling can be a bit daunting considering the number of languages out there and steep price associated with training. However, the Pay What You Want: Learn to Code 2018 Bundle is […]