Researchers from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) trained a neural network to recognize materials (e.g., metal grate, plants, concrete sidewalk) being hit with a drumstick, and synthesize sounds to accompany the actions. It did well enough to fool humans into thinking the sounds were real.
From the abstract:
Objects make distinctive sounds when they are hit or scratched. These sounds reveal aspects of an object's material properties, as well as the actions that produced them. In this paper, we propose the task of predicting what sound an object makes when struck as a way of studying physical interactions within a visual scene. We present an algorithm that synthesizes sound from silent videos of people hitting and scratching objects with a drumstick. This algorithm uses a recurrent neural network to predict sound features from videos and then produces a waveform from these features with an example-based synthesis procedure. We show that the sounds predicted by our model are realistic enough to fool participants in a "real or fake" psychophysical experiment, and that they convey significant information about material properties and physical interactions.
Machine learning algorithms have successfully identified plant species in massive herbaria just by looking at the dried specimens. According to researchers, similar AI approaches could also be used identify the likes of fly larvae and plant fossils. From Nature: There are roughly 3,000 herbaria in the world, hosting an estimated 350 million specimens — only […]
I just laid the audio from the Blade Runner 2049 trailer to the new Google Assistant ad.I'm scared. Literally no extra editing involved 😳 pic.twitter.com/5lwUWqxFml— Spencer Chen (@spencerchen) May 18, 2017 Spencer Chen, VP of marketing and business development at Alibaba Group, added the audio from the Blade Runner 2049 trailer to the ad for […]
As AI improves, the mystery of consciousness interests more programmers and physicists.
Toaster ovens are the perfect appliance for small things like toasted sandwiches and roasted garlic (try it!), but anything more involved usually requires a full-sized conventional oven.However, despite its small size, the Wolfgang Puck Pressure Oven can handle anything from baked pastries to broiled meats. This kitchen appliance has a minimal countertop footprint, and cooks […]
The Pry.Me Bottle Opener holds tens of thousands of times its own weight, and you can pick one up now from the Boing Boing Store.This remarkable keychain is considerably smaller than any of your keys, but don’t let that fool you: it can easily open any bottle, and could even tow a trailer full of […]