From a Cornell University paper by Egor Zakharov, Aliaksandra Shysheya, Egor Burkov, and Victor Lempitsky titled "Few-Shot Adversarial Learning of Realistic Neural Talking Head Models"
Several recent works have shown how highly realistic human head images can be obtained by training convolutional neural networks to generate them. In order to create a personalized talking head model, these works require training on a large dataset of images of a single person. However, in many practical scenarios, such personalized talking head models need to be learned from a few image views of a person, potentially even a single image. Here, we present a system with such few-shot capability. It performs lengthy meta-learning on a large dataset of videos, and after that is able to frame few- and one-shot learning of neural talking head models of previously unseen people as adversarial training problems with high capacity generators and discriminators. Crucially, the system is able to initialize the parameters of both the generator and the discriminator in a person-specific way, so that training can be based on just a few images and done quickly, despite the need to tune tens of millions of parameters. We show that such an approach is able to learn highly realistic and personalized talking head models of new people and even portrait paintings.
Image: Egor Zakharov/YouTube
OMG pic.twitter.com/S3Y2mpnDYd — Greg Hogben (@MyDaughtersArmy) May 12, 2020 As a wise man once said, it’s funny cause it’s true. See below for the full clip from Jimmy Kimmel Live! Now THIS video has been doctored… @RealDonaldTrump #JimmyKimmelLiveFromHisHouse #StayHome @DrFakenstein pic.twitter.com/ue10HBjmj9 — Jimmy Kimmel (@jimmykimmel) May 12, 2020
Thank you, Mr. Oswalt. Do not watch this. Seriously. pic.twitter.com/QhIPuM8ysJ — JΞSŦΞR ✪ ΔCŦUΔL³³º¹ (@th3j35t3r) January 23, 2020
In this BBC News clip, a child seems to materialize just behind the woman speaking. WTF. Unfortunately this isn’t likely a fun glitch in our simulated reality but rather something with much more insidious potential. From WAXY: If you watch the woman’s face at the same time the boy appears, you can see her expression […]
Add Internet of Things to the shortlist of those actually benefiting from the effects of the COVID-19 pandemic. You might not realize it, but the organizing principle that is bringing more automation to the world is actually proving to be a major asset as human beings are forced to stay home and away from the […]
We’ve all had those nights where we’re working on a laptop or scrolling through our phone before glancing at the time to find it’s actually a lot later than we thought. Most nights, you’d be fast asleep or at least dead tired at midnight or 1 or 3 a.m. But after staring at a screen, […]
If you’re a fan of ABC’s entrepreneurial feeding frenzy “Shark Tank,” then you know complete buyout offers from the expert Sharks don’t happen all that often. But back in 2017, that’s exactly what happened when inventor Logan Riley debuted his instantly eye-catching creation the RokBlok to the agog Sharks. Part of the reason that happened […]