I really love the research that they're doing over at Yale's Haskins Laboratories: instead of studying speech perception and production in terms of faithfully replicating alllll of the sounds we make with our mouths, (like the minute clicks, pops, and hisses of consonants), the team is proposing that all we need to understand speech is to track and re-create a few select resonances of the vocal tract. I like to think of speech production in this context as a series of bottles with varying levels of water in them--the mouth is one bottle that changes pitch resonance when you move it to open it or close it, the nasal cavity another, and so on throughout the vocal tract. It ends up sounding like a bunch of complicated melodies that are then combined into a complex micro-tonal harmony, a.k.a., we're all better at perceiving and making music than we think we are!
The examples below break it down into isolated sine-wave patterns that you can combine yourself to build a sentence. What do you think? How easily can you hear words emerge?
If you like this, you can go here
for more interactive demonstrations, or check out this great sine-wave-synthesized Robert Frost poem
Thanks to Robert E. Remez, as well as Phillip Rubin and Jennifer Pardo at Haskins Labs for allowing me to embed their work here.
Coming up, I'll be writing about a cool ethnographic example of a language that actually uses something like this in practice!
The Breitbart chief and Trump campaign CEO’s sexist bullying was evident in the early days of Biosphere 2 in Arizona, then a quasi “space colonization” and environmental research project. Stephen K. Bannon, who recently took a leave from running Breitbart.com to become Donald Trump’s chief campaign executive, once bullied women in the historic environmental research […]
Jesse Singal requested this shoop, and I delivered. After all, who’s downloading pirated papers? Everyone. (I’ve uploaded this to Redbubble if you’d like a poster—of course, you can just as well pirate it.)
Hydraulic Press Channel shows why carbon fiber and variants like carbon nanotubes have so many uses: depending on the configuration, they can hold up against the hydraulic press.
If you’re like us, packing and unpacking are two of your least favorite aspects of traveling. Specifically with multi-destination trips, our suitcases usually end in wrinkled clothing, toothpaste stains, and a misplaced deodorant.The good news is that we’ve found a suitcase that eliminates the disastrous effects of packing and unpacking: The Rolo Travel Bag ($42.99). You essentially use it […]
Finding quality icons is a challenge for designers, and can also get pretty costly if you use them often. And when you’ve got a lot to do, the last thing you want to spend your time on is creating new icons from scratch That’s why we recommend using the Noun Project ($49). Noun Project is a site […]
While Netflix and Hulu have seemingly dominated the streaming market with their limited selections, we’ve looked a little outside the box and found something pretty great as an alternative. SelectTV combines all the content of cable with the convenience of streaming, and it’s affordable too.SelectTV is an online subscription service that packs an impressive library of over […]