I really love the research that they're doing over at Yale's Haskins Laboratories: instead of studying speech perception and production in terms of faithfully replicating alllll of the sounds we make with our mouths, (like the minute clicks, pops, and hisses of consonants), the team is proposing that all we need to understand speech is to track and re-create a few select resonances of the vocal tract. I like to think of speech production in this context as a series of bottles with varying levels of water in them--the mouth is one bottle that changes pitch resonance when you move it to open it or close it, the nasal cavity another, and so on throughout the vocal tract. It ends up sounding like a bunch of complicated melodies that are then combined into a complex micro-tonal harmony, a.k.a., we're all better at perceiving and making music than we think we are!
The examples below break it down into isolated sine-wave patterns that you can combine yourself to build a sentence. What do you think? How easily can you hear words emerge?
If you like this, you can go here for more interactive demonstrations, or check out this great sine-wave-synthesized Robert Frost poem.
Thanks to Robert E. Remez, as well as Phillip Rubin and Jennifer Pardo at Haskins Labs for allowing me to embed their work here.
Coming up, I'll be writing about a cool ethnographic example of a language that actually uses something like this in practice!
Tonight’s full Moon is a “Pink Moon” aka “Passover Moon” aka “Paschal Moon” aka “Hanuman Jayanti” aka supermoon, the largest full moon of 2020. From NASA: The term “supermoon” was coined by the astrologer Richard Nolle in 1979 and refers to either a new or full Moon that occurs within 90% of perigee, its closest […]
Scientists say that traces of SARS-CoV-2 genetic material — viral RNA — in the poo we flush down the toilet and into the sewage system might reveal how badly coronavirus has hit a given community. Analyzing sewage could show the true scale of an outbreak, in the absence of available testing, they say.
Even tho they are only updated once a day (at most) I check, check and re-check 91-divoc and the IHME COVID-19 Projections. The linear scale graphs on 91-divoc have given me the best picture of ‘is the curve flattening’ for the regions I watch. Tribalism runs rampant during Trump’s Pandemic and I am naturally more […]
While all the downsides of stay-at-home orders and social distancing are evident, there are at least a few small silver linings to come out of all this. For many, this time spent indoors has meant a happy reintroduction to your very own kitchen. You know your kitchen. It’s usually the place that holds all your […]
Have you ever had more time to hone in on fine details than right now? Sure, at first glance, this might not seem like the time to get tripped up on the nitty-gritty of minutia. But how often are you ever going to have this much time to really stop and think about hows and […]
There are plenty of productive ways to spend time while stuck indoors. While it’s undoubtedly fun to binge all 15 seasons of Supernatural or sink days of playtime into an Overwatch campaign, learning something new is definitely a more meaningful and long-term beneficial use of open hours. And if you’re going to invest time in […]