I really love the research that they're doing over at Yale's Haskins Laboratories: instead of studying speech perception and production in terms of faithfully replicating alllll of the sounds we make with our mouths, (like the minute clicks, pops, and hisses of consonants), the team is proposing that all we need to understand speech is to track and re-create a few select resonances of the vocal tract. I like to think of speech production in this context as a series of bottles with varying levels of water in them--the mouth is one bottle that changes pitch resonance when you move it to open it or close it, the nasal cavity another, and so on throughout the vocal tract. It ends up sounding like a bunch of complicated melodies that are then combined into a complex micro-tonal harmony, a.k.a., we're all better at perceiving and making music than we think we are!
The examples below break it down into isolated sine-wave patterns that you can combine yourself to build a sentence. What do you think? How easily can you hear words emerge?
If you like this, you can go here
for more interactive demonstrations, or check out this great sine-wave-synthesized Robert Frost poem
Thanks to Robert E. Remez, as well as Phillip Rubin and Jennifer Pardo at Haskins Labs for allowing me to embed their work here.
Coming up, I'll be writing about a cool ethnographic example of a language that actually uses something like this in practice!
After years of speculation and wrangling over his remains, Kennewick Man turns out to be closely related to contemporary, local Native Americans after all. Discovered near Kennewick, Wash., in 1996, the skeleton ended up in a tug of war between tribes in the pacific northwest who wanted to bury the remains, and scientists who wanted […]
Our solar system is awesome.
The European Organization for Nuclear Research, or CERN, has been releasing portions of its research to the public for years. This week’s massive 300 terabyte dump of Large Hadron Collider (LHC) data is the biggest yet by a long shot — and it’s all out there, open source, free for the exploration.
You never know when new projects, ideas or opportunities can drop into your lap at a moment’s notice. That may require you to learn a new programming language like Python. Or maybe you need a primer on 3D game development. Or you might realize you could use a serious brush-up on iOS mobile creation.Point is, […]
Isn’t it about time to stretch what your Mac can do? I mean, you’ve got plenty of great programs now…but don’t you think you could use some new tools to get your creative, analytical and organizational juices really flowing? It’s spring, so we cleaned up a whole bunch of super-cool apps lying around and packaged […]
In the world of app development, there’s no greater arena to find success than with Android users. About 80% of the smartphones in use today worldwide operate on the Android operating system, so if you build a great app that Android users love, you’re an international rock star. You’ll be able to make sure your […]