I really love the research that they're doing over at Yale's Haskins Laboratories: instead of studying speech perception and production in terms of faithfully replicating alllll of the sounds we make with our mouths, (like the minute clicks, pops, and hisses of consonants), the team is proposing that all we need to understand speech is to track and re-create a few select resonances of the vocal tract. I like to think of speech production in this context as a series of bottles with varying levels of water in them--the mouth is one bottle that changes pitch resonance when you move it to open it or close it, the nasal cavity another, and so on throughout the vocal tract. It ends up sounding like a bunch of complicated melodies that are then combined into a complex micro-tonal harmony, a.k.a., we're all better at perceiving and making music than we think we are!
The examples below break it down into isolated sine-wave patterns that you can combine yourself to build a sentence. What do you think? How easily can you hear words emerge?
If you like this, you can go here for more interactive demonstrations, or check out this great sine-wave-synthesized Robert Frost poem.
Thanks to Robert E. Remez, as well as Phillip Rubin and Jennifer Pardo at Haskins Labs for allowing me to embed their work here.
Coming up, I'll be writing about a cool ethnographic example of a language that actually uses something like this in practice!
Teams of researchers are developing sesame seed-size neuro-implants that detect brain activity that signals depression and then deliver targeted electrical zaps to elevate your mood. It’s very early days in the science and technology but recent studies suggest that we’re on the path. Links to scientific papers below. Fortunately, the goal is to develop tools […]
In the 1960s, when Scientific American copy editor Michael J. Battaglia was 15, he had a chemical romance with the periodic table. In fact, Battaglia was so fascinated by the basic substances of our universe that he tried to collect ’em all (at least the 104 elements that science knew about at the time.) From […]
Aren’t they beautiful? Here’s how ‘ghost apples’ formed on this apple tree in West Michigan.
Breaking into the indie video game market may be easier than you think. It all starts with an idea, and then it’s a matter of finding the right development platform to bring it to life. No matter what that platform is, it’s a good bet that it’s covered in the 2019 Game Dev & Design […]
Learning a new language like Spanish doesn’t have to be hard. Either you can buy a ticket to a Spanish-speaking country, immerse yourself in the culture and pick it up intuitively – or you can do it from the comfort of the chair you’re in right now by logging on to Rocket Spanish. There are […]
When it comes to Valentine’s Day gestures, we encourage you to make the date your own. But we’ve got to admit, you can’t beat the classic appeal of a well-picked, perfectly arranged bouquet of roses. And whether you need them delivered at home or to a long-distance lover, the best call is Teleflora’s Valentine’s Day […]