I really love the research that they're doing over at Yale's Haskins Laboratories: instead of studying speech perception and production in terms of faithfully replicating alllll of the sounds we make with our mouths, (like the minute clicks, pops, and hisses of consonants), the team is proposing that all we need to understand speech is to track and re-create a few select resonances of the vocal tract. I like to think of speech production in this context as a series of bottles with varying levels of water in them--the mouth is one bottle that changes pitch resonance when you move it to open it or close it, the nasal cavity another, and so on throughout the vocal tract. It ends up sounding like a bunch of complicated melodies that are then combined into a complex micro-tonal harmony, a.k.a., we're all better at perceiving and making music than we think we are!
The examples below break it down into isolated sine-wave patterns that you can combine yourself to build a sentence. What do you think? How easily can you hear words emerge?
If you like this, you can go here
for more interactive demonstrations, or check out this great sine-wave-synthesized Robert Frost poem
Thanks to Robert E. Remez, as well as Phillip Rubin and Jennifer Pardo at Haskins Labs for allowing me to embed their work here.
Coming up, I'll be writing about a cool ethnographic example of a language that actually uses something like this in practice!
Despite Trump’s denial of climate change the the ghastly attacks on climate science and mitigation in the new proposed budget, the Carbon Bubble — which overprices hydrocarbons and the industries that rely on them, as though we’ll be burning all of them with impunity — is about to pop.
South American polka dot tree frogs are pretty cool, but Julián Faivovich and Carlos Taboada found out they are even cooler when an ultraviolet flashlight is trained on them. They fluoresce. Many animals can see beyond the spectrum visible to humans, and these frogs adapted with this trait. From the abstract: Fluorescence, the absorption of […]
A small (51 men aged 24 +/- 3 years) study published in Neuron tasked experimental subjects with practicing the ancient Greek mnemonic technique of “memory palaces” and then scanned their brains with functional magnetic resonance imaging, comparing the scans to scans from competitive “memory athletes” and also measuring their performance on memorization tasks.
The Lightning port has thus far resisted the cruel fate that befell the headphone jack, and despite rumors that it may be disappearing come iPhone 8, for the present and foreseeable future, Lightning cables are a hot commodity for iPhone users. As such, we must make do in this strange time in which long, glorified […]
All the filters in the world won’t save your smartphone pics from a shaky hand. To really step up your mobile photography game, you’ll need some kind of mount to hold it steady. You could buy a smartphone attachment for a conventional camera tripod, but who wants to carry that kind of gear everywhere they […]
The forced transition from analog to digital TV signals was probably met with relative indifference from people with Netflix subscriptions and the “I don’t even own a TV” snoots. But anyone living in the vast swaths of the country that don’t have guaranteed high-speed internet, broadcast TV is a perfectly valid (and 100% free) way […]