Researchers from MIT's Computer Science and Artificial Intelligence Laboratory (CSAIL) trained a neural network to recognize materials (e.g., metal grate, plants, concrete sidewalk) being hit with a drumstick, and synthesize sounds to accompany the actions. It did well enough to fool humans into thinking the sounds were real.
Objects make distinctive sounds when they are hit or scratched. These sounds reveal aspects of an object's material properties, as well as the actions that produced them. In this paper, we propose the task of predicting what sound an object makes when struck as a way of studying physical interactions within a visual scene. We present an algorithm that synthesizes sound from silent videos of people hitting and scratching objects with a drumstick. This algorithm uses a recurrent neural network to predict sound features from videos and then produces a waveform from these features with an example-based synthesis procedure. We show that the sounds predicted by our model are realistic enough to fool participants in a "real or fake" psychophysical experiment, and that they convey significant information about material properties and physical interactions.
In Artificial Condition, Martha Well’s soap opera loving rogue security AI remains cantankerous and awesome. Murderbot is an AI security robot with a busted autonomy regulator. So long as they can keep the regulator a secret, they can remain fully aware and independent. Mostly they want to watch soap operas. Soap operas and to be […]
Janelle Shane is an AI researcher. In this TED talk she explains that we should not be afraid that AIs are going to rebel against us. We should be afraid of AIs because they are going to do exactly what we tell them to do. “It’s really easy to accidentally give AI the wrong problem […]
Even the covers to this collection of AI-written science fiction novels were created by AI. The reviews are also written by AI. Titles include Bitches of the Points, Auro-Minds and the Hungers, The Table in 10, and Breath Chanter. Of course it’s an art project and the writing is a mess, but an excerpt from […]
Seems like no matter what kind of wireless earbud you buy, you’re sacrificing something: Sound for longevity, battery life for durability, the list goes on. Finally, it seems like the tech is starting to come together for the full package in a few newer models. Case in point: These PaMu Slide Bluetooth 5 In-Ear Headphones. […]
If you’re doing any kind of data work, chances are you’re working in Excel. This venerable platform has evolved beyond its roots as a workhorse spreadsheet creator into an essential tool for data analysts and other high-level number crunchers. Want to brush up on this year’s version of the software? There’s no quicker way than […]
Does your computer gear need an upgrade? Don’t cross your fingers and wait for Christmas. You can get 15% off the final sale price of all these essential accessories now by using the online code BFSAVE15, including gaming mice and computer desks. Wireless Charging Mouse Pad Talk about a space saver. This high-quality mouse pad […]