Researchers from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) trained a neural network to recognize materials (e.g., metal grate, plants, concrete sidewalk) being hit with a drumstick, and synthesize sounds to accompany the actions. It did well enough to fool humans into thinking the sounds were real.
Objects make distinctive sounds when they are hit or scratched. These sounds reveal aspects of an object's material properties, as well as the actions that produced them. In this paper, we propose the task of predicting what sound an object makes when struck as a way of studying physical interactions within a visual scene. We present an algorithm that synthesizes sound from silent videos of people hitting and scratching objects with a drumstick. This algorithm uses a recurrent neural network to predict sound features from videos and then produces a waveform from these features with an example-based synthesis procedure. We show that the sounds predicted by our model are realistic enough to fool participants in a "real or fake" psychophysical experiment, and that they convey significant information about material properties and physical interactions.
Donald Trump’s desperate PR attempt “speech” from this morning read kind of like the lyric sheet from some obscure Radiohead-wannabe art-rock band. So naturally, comedian Emily Heller took it to the next level by feeding it into OpenAI’s “Talk To Transformer” Neural Network. I fed the first part of Trump's I WANT NOTHING note into […]
In Artificial Condition, Martha Well’s soap opera loving rogue security AI remains cantankerous and awesome. Murderbot is an AI security robot with a busted autonomy regulator. So long as they can keep the regulator a secret, they can remain fully aware and independent. Mostly they want to watch soap operas. Soap operas and to be […]
Janelle Shane is an AI researcher. In this TED talk she explains that we should not be afraid that AIs are going to rebel against us. We should be afraid of AIs because they are going to do exactly what we tell them to do. “It’s really easy to accidentally give AI the wrong problem […]
For all that tech that gets squeezed into them, the best wireless earbuds are ones we barely have to think about. That’s the whole point, right? We get wireless because we just want to hit play and have a hands-free, cordless soundtrack for the rest of the commute. If that’s your philosophy, definitely give these […]
Need a boost on that resume? Get a valuable tech education on your own time with these eBook bundles. They contain guides from Packt Publishing that cover everything from game development to machine learning. The Complete Mobile App Developer eBook Bundle It’s a veritable gold rush in the App Store these days. Get in on […]
Vinyl is officially back. People are hearing the proof behind the initial “retro” excitement: that records really do have a richer sound. And if you haven’t switched to old-school records for serious listening, it’s a new golden age. Why? Because quality turntables like the Altec Lansing ALT-500 are finally available to a market other than […]