Researchers at Stanford have developed face-capture technology that can alter pre-recorded videos in real-time on low cost computers. In other words, you can make George W Bush or Donald Trump appear intelligent.
We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.
I loved The Mummy back in the day… although it hasn’t held up very well. If I were home and dying of the flu in bed, I wouldn’t use the last of my strength to get up and change the channel if The Mummy Returns came on, right up to the point where the Scorpion […]
It’s almost shocking to say…but there’s actually an incredible amount of manhood wrapped up in how well you cook a steak. Of course, no one would argue your grilling abilities are THAT important. Or that how well you sear a prime slab of beef should have any bearing on your social standing or feeling of […]
The notion of two people sleeping in the same bed always inspires romantic visions of love and intimacy. However, most quickly realize that the romance of sleeping together is often quickly replaced by the realities of the act. One partner snores. The other talks in their sleep. One grinds their teeth. The other hogs the […]
Add Internet of Things to the shortlist of those actually benefiting from the effects of the COVID-19 pandemic. You might not realize it, but the organizing principle that is bringing more automation to the world is actually proving to be a major asset as human beings are forced to stay home and away from the […]