Real time face capture lets you control famous faces

motion-capture

Researchers at Stanford have developed face-capture technology that can alter pre-recorded videos in real-time on low cost computers. In other words, you can make George W Bush or Donald Trump appear intelligent.

We present a novel approach for real-time facial reenactment of a monocular target video sequence (e.g., Youtube video). The source sequence is also a monocular video stream, captured live with a commodity webcam. Our goal is to animate the facial expressions of the target video by a source actor and re-render the manipulated output video in a photo-realistic fashion. To this end, we first address the under-constrained problem of facial identity recovery from monocular video by non-rigid model-based bundling. At run time, we track facial expressions of both source and target video using a dense photometric consistency measure. Reenactment is then achieved by fast and efficient deformation transfer between source and target. The mouth interior that best matches the re-targeted expression is retrieved from the target sequence and warped to produce an accurate fit. Finally, we convincingly re-render the synthesized target face on top of the corresponding video stream such that it seamlessly blends with the real-world illumination. We demonstrate our method in a live setup, where Youtube videos are reenacted in real time.

Read the rest

Stunning visualization of Kung Fu motion capture data

screenshot

Tobias Gremmler created this magnificent visualization of motion data he captured of a person practicing Kung Fu.

(via Laughing Squid) Read the rest

Blooper reel from LA Noire reveals its excellent motion capture technology

(Audio NSFW)

Matt Richardson says: "These are actual outtakes from the voice actors of LA Noire, rendered out.

These hilarious screw-ups were generated as a natural side effect of the MotionScan animation process used to create the game.

Unlike other motion-capture systems that use shiny, reflective dots to track key points as an actor moves, MotionScan generates 3D models, texture maps, and meshes directly from a stereo camera recording of an unadorned actor's performance. The result is an instant virtual copy of that performance that captures mis-timed laughs, a tongue sticking out, and errant sneezes, with only minimal touch-up needed from an animator.

Ars Technica: L.A. Noire blooper reel chips away at the uncanny valley (Via Boing Boing G+ Community) Read the rest

TOM THE DANCING BUG: Billy Dare Into the Uncanny Valley

Four out of five dentists recommend the TOM THE DANCING BUG WEBSITE for their patients who visit time-wasting websites. The other one out of five recommend that their patients brush their teeth with pixie stix and follow RUBEN BOLLING (@rubenbolling) on TWITTER. Read the rest