Researchers from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) trained a neural network to recognize materials (e.g., metal grate, plants, concrete sidewalk) being hit with a drumstick, and synthesize sounds to accompany the actions. It did well enough to fool humans into thinking the sounds were real.
From the abstract:
Objects make distinctive sounds when they are hit or scratched. These sounds reveal aspects of an object's material properties, as well as the actions that produced them. In this paper, we propose the task of predicting what sound an object makes when struck as a way of studying physical interactions within a visual scene. We present an algorithm that synthesizes sound from silent videos of people hitting and scratching objects with a drumstick. This algorithm uses a recurrent neural network to predict sound features from videos and then produces a waveform from these features with an example-based synthesis procedure. We show that the sounds predicted by our model are realistic enough to fool participants in a "real or fake" psychophysical experiment, and that they convey significant information about material properties and physical interactions.
I just laid the audio from the Blade Runner 2049 trailer to the new Google Assistant ad.I'm scared. Literally no extra editing involved 😳 pic.twitter.com/5lwUWqxFml— Spencer Chen (@spencerchen) May 18, 2017 Spencer Chen, VP of marketing and business development at Alibaba Group, added the audio from the Blade Runner 2049 trailer to the ad for […]
As AI improves, the mystery of consciousness interests more programmers and physicists.
Neural nets are starting to wake up. These pickup lines, generated by a neural net maintained by research scientist Janelle Shane are much more interesting than standard pickup lines. Are you a 4loce? Because you’re so hot! I want to get my heart with you. You are so beautiful that you know what I mean. […]
Despite the upfront cost, electric toothbrushes are much better at removing plaque than those freebies from the dentist’s office. For those who struggle to fill the American Dental Association’s recommended two minutes of brushing time, or anyone with limited dexterity, a sonic toothbrush can give your oral care routine a boost.To keep your chops healthy […]
Learning a new language will give your resume an upgrade, sure, but it will also provide a huge cognitive boost for mental tasks outside of translation and conversation. Bilingual brains have been shown to be better at handling multiple concurrent tasks, and gaining fluency in a new tongue is an amazing way to improve memory, […]
If you struggle to get a good night’s rest, consider replacing your pillows before dropping hundreds on a new mattress. You can give your tired neck a break with a 2-pack of memory foam pillows, available now in the Boing Boing Store.Each of these pillows is stuffed with cooling polyurethane foam that molds to your […]