I really love the research that they're doing over at Yale's Haskins Laboratories: instead of studying speech perception and production in terms of faithfully replicating alllll of the sounds we make with our mouths, (like the minute clicks, pops, and hisses of consonants), the team is proposing that all we need to understand speech is to track and re-create a few select resonances of the vocal tract. I like to think of speech production in this context as a series of bottles with varying levels of water in them--the mouth is one bottle that changes pitch resonance when you move it to open it or close it, the nasal cavity another, and so on throughout the vocal tract. It ends up sounding like a bunch of complicated melodies that are then combined into a complex micro-tonal harmony, a.k.a., we're all better at perceiving and making music than we think we are!
The examples below break it down into isolated sine-wave patterns that you can combine yourself to build a sentence. What do you think? How easily can you hear words emerge?
If you like this, you can go here for more interactive demonstrations, or check out this great sine-wave-synthesized Robert Frost poem.
Thanks to Robert E. Remez, as well as Phillip Rubin and Jennifer Pardo at Haskins Labs for allowing me to embed their work here.
Coming up, I'll be writing about a cool ethnographic example of a language that actually uses something like this in practice!
I have offered plenty of advice on caring for your cast iron cookware. Stop seasoning it in the house, use your BBQ. Seasoning this stuff in the oven (my favorite old way,) or on the stove smokes your house up. Just throw the shit on the grill. Super thinly put a coat of oil on […]
One of the major contributors to greenhouse gases is the methane that cows belch up as they break down cellulose, but five years ago, research from Australia's Commonwealth Scientific and Industrial Research Organisation (CSIRO) found that adding small amounts of a pink seaweed called Asparagopsis to cows' diets eliminated the gut microbes responsible for methane […]
On Slate Star Codex (previously), Scott Alexander breaks down Invisible Designers: Brain Evolution Through the Lens of Parasite Manipulation, Marco Del Giudice's Quarterly Review of Biology paper that examines the measures that parasites take to influence their hosts' behaviors, and the countermeasures that hosts evolve to combat them.
If there’s one thing that stayed consistent through the last decade or so of tech industry turmoil, it’s the love affair between techies and Linux. There’s just a ton you can do with the OS, and its open-source format means you can customize your rig from the ground up. Apparently not content with that level […]
Accidents happen. And when they do, you’re going to want a dash cam for a second pair of eyes. At the minimum, a decent dash cam can save you vast sums of time and money in case of an accident. But a really good dash cam can do a whole lot more. Here are six […]
The field of data analytics is growing as fast as the internet itself. Self-driving cars, airline pricing, and huge marketing campaigns are all driven by the insights that data scientists can distill out of vast sums of information. Even with the help of powerful software like Python, it’s a highly skilled position. But those skills […]