I really love the research that they're doing over at Yale's Haskins Laboratories: instead of studying speech perception and production in terms of faithfully replicating alllll of the sounds we make with our mouths, (like the minute clicks, pops, and hisses of consonants), the team is proposing that all we need to understand speech is to track and re-create a few select resonances of the vocal tract. I like to think of speech production in this context as a series of bottles with varying levels of water in them--the mouth is one bottle that changes pitch resonance when you move it to open it or close it, the nasal cavity another, and so on throughout the vocal tract. It ends up sounding like a bunch of complicated melodies that are then combined into a complex micro-tonal harmony, a.k.a., we're all better at perceiving and making music than we think we are!
The examples below break it down into isolated sine-wave patterns that you can combine yourself to build a sentence. What do you think? How easily can you hear words emerge?
If you like this, you can go here
for more interactive demonstrations, or check out this great sine-wave-synthesized Robert Frost poem
Thanks to Robert E. Remez, as well as Phillip Rubin and Jennifer Pardo at Haskins Labs for allowing me to embed their work here.
Coming up, I'll be writing about a cool ethnographic example of a language that actually uses something like this in practice!
Scientific American summarized five of Donald Trump’s “major moves many see as hostile toward science.” They are: • Trump’s pick for head of the U.S. Environmental Protection Agency has actively battled its mission “To lead the EPA, Trump appointed Scott Pruitt, the Oklahoma attorney general who has long opposed environmental regulations and has questioned the science […]
Why does The Caterpillar Lab only have 44 subscribers? Caterpillars set to smooth jazz, like these gorgeous stinging rose caterpillars checking each other out, make this New Hampshire nonprofit a hidden gem.
A paper from a group of Kings College London researchers documents an unexpected and welcome side effect from an experimental anti-Alzheimer’s drug called Tideglusib: test subjects experienced a regeneration of dentin, the bony part of teeth that sits between the pulp and the enamel.
Computer hacking isn’t just something happening to the DNC. Major software companies need white-hat hackers to ensure the security of their products and users, and I came across a Computer Hacker Professional Certification Package that conveniently teaches those advanced IT techniques online.This course package will prepare you for various computer security certification exams with over 60 hours […]
One of the best ways to progress a career in project management is through earning recognized certifications. These certifications carry significant clout and don’t require expensive tuition or student loans. This Ultimate Project Management Certification Bundle is a great example of an affordable way to get ahead. It includes training for 9 certifications including PMP, […]
There’s nothing quite like the rush of playing against a real human opponent. But from a developer standpoint, creating fun multiplayer experiences is incredibly complex. Fortunately, the Unity3D game engine has made all aspects of game creation, including multiplayer functionality, as accessible as ever.This Unity Course Bundle introduces all of the necessary elements of creating […]