Graphcore produced a series of striking images of computational graphs mapped to its "Intelligent Processing Unit."
The graph compiler builds up an intermediate representation of the computational graph to be scheduled and deployed across one or many IPU devices. The compiler can display this computational graph, so an application written at the level of a machine learning framework reveals an image of the computational graph which runs on the IPU.
The image below shows the graph for the full forward and backward training loop of AlexNet, generated from a TensorFlow description.
Our Poplar graph compiler has converted a description of the network into a computational graph of 18.7 million vertices and 115.8 million edges. This graph represents AlexNet as a highly-parallel execution plan for the IPU. The vertices of the graph represent computation processes and the edges represent communication between processes. The layers in the graph are labelled with the corresponding layers from the high level description of the network. The clearly visible clustering is the result of intensive communication between processes in each layer of the network, with lighter communication between layers.
ChinAI Jeff Ding's weekly newsletter reporting on the Chinese AI scene; on the occasion of the newsletter's first anniversary, Ding has posted a roundup of things about the Chinese AI scene that the rest of the world doesn't know about, or harbors incorrect beliefs about.
I'm heading back to Austin for the SXSW Interactive festival and you can catch me three times this weekend: first on the Untold AI panel with Malka Older, Rashida Richardson and Christopher Noessel (5-6PM, Fairmont Manchester AB); then at the EFF Austin Party with Cindy Cohn and Bruce Sterling (7PM, 1309 Bonham Terrace); and on […]
There aren’t many details in Trump’s “American A.I. Initiative,” but the point appears to be: send a message of technological dominance to China.
Need to upgrade your sound? Bluetooth technology has never been better, but that’s not the only reason to look into a new set of speakers or headphones. We found ten pieces of audio gear that are already on sale, and you can take an additional 15% off the final price for Memorial Day weekend by […]
Trying to earn a promotion? Memorial Day weekend might be a good place to start. There are tons of e-learning packages that can help you build professional skills a lot quicker (and cheaper) than any technical academy. Whether you want to earn IT certifications, learn to code, become a designer, or anything else, these comprehensive […]
If you’re into tools or gadgets, Memorial Day weekend is your Christmas. Take an extra 15% off the final price of these DIY accessories – all of which are already on sale – by entering the promo code WEEKEND15. LUXJET Universal 24-in-1 Magnetic Screwdriver Set & Repair Kit This small but sturdy kit won the […]