From a Cornell University paper by Egor Zakharov, Aliaksandra Shysheya, Egor Burkov, and Victor Lempitsky titled "Few-Shot Adversarial Learning of Realistic Neural Talking Head Models"
Several recent works have shown how highly realistic human head images can be obtained by training convolutional neural networks to generate them. In order to create a personalized talking head model, these works require training on a large dataset of images of a single person. However, in many practical scenarios, such personalized talking head models need to be learned from a few image views of a person, potentially even a single image. Here, we present a system with such few-shot capability. It performs lengthy meta-learning on a large dataset of videos, and after that is able to frame few- and one-shot learning of neural talking head models of previously unseen people as adversarial training problems with high capacity generators and discriminators. Crucially, the system is able to initialize the parameters of both the generator and the discriminator in a person-specific way, so that training can be based on just a few images and done quickly, despite the need to tune tens of millions of parameters. We show that such an approach is able to learn highly realistic and personalized talking head models of new people and even portrait paintings.
Image: Egor Zakharov/YouTube
Thank you, Mr. Oswalt. Do not watch this. Seriously. pic.twitter.com/QhIPuM8ysJ — JΞSŦΞR ✪ ΔCŦUΔL³³º¹ (@th3j35t3r) January 23, 2020
In this BBC News clip, a child seems to materialize just behind the woman speaking. WTF. Unfortunately this isn’t likely a fun glitch in our simulated reality but rather something with much more insidious potential. From WAXY: If you watch the woman’s face at the same time the boy appears, you can see her expression […]
Researchers have developed a generative neural network to make fake videos of talking heads. It’s getting a lot harder to tell the difference between real and deep fakes. We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations […]
If you remember your Norse mythology (or just watched Marvel’s Thor movies), you’re probably familiar with Heimdal, the god whose ever-watchful eye was entrusted with protecting the home of the gods in Asgard. Back on Earth, Heimdal Thor is also the name of a security package from Heimdal Security, that’s actually dedicated to much the […]
Everyone’s got their nose in a phone these days, and that doesn’t seem like it’s going to change anytime soon. With the increase in mobile device and e-commerce reliance comes increased need for developers who can build the apps we’re all so glued to. In fact, employment of devs is expected to grow up to […]
Whether you love cooking at home or you swore this was going to be the year you curbed your DoorDash addiction, you know you can’t get the job done well without the proper tools on hand. For all your recipe and meal prep needs, this 3-piece Sukasu Osami Chef’s Knife set will do you right […]