Art installation includes drones that stalk and record all visitors

Hansel & Gretel opened this month in New York. The collaboration between artist Ai Weiwei and architects Jacques Herzog and Pierre de Meuron is a noisy dystopian nightmare projected back to visitors and broadcast live to the internet.

View this post on Instagram

This artwork, 'Hansel & Gretel', focuses on the mass surveillance in public areas, allowing visitors to discuss and explore the impact surveillance has throughout communities. Artist @aiweiwei_studio and architects Jacques Herzog and Pierre de Meuron, collaborated to design such an interactive and immersive artwork. 'Hansel & Gretel' has been laid into two separate parts, where visitors are both the observer and the observed, having each movement recorded, monitored and tracked by infrared cameras. Photographer: James Ewing. @parkavearmory #aiweiwei #jacquesherzog #pierredemeuron #paahanselandgretel #surveillance #publicart #art #artwork #live #movement #design #interactive #dark #dim #infrared #community #observer #observed #blackandwhite #newyork #manhattan #experience #visual #visualart #monitor

A post shared by Creative Road Art Projects (@creativeroad) on

The installation includes sobering military drone statistics that estimate between 6,300 and over 9,200 people have been killed by military drones.

The artists and technicians also explain the technology:

Every movement in the Drill Hall is tracked and recorded from above by a grid of 56 small computers with infrared (IR) cameras, each attached to a projector suspended on a truss system high above the gently sloping floor. To allow for better tracking in low light conditions we installed an array of floodlights which operate in the near infrared spectrum and are thus is invisible to the human eye. Each computer runs a tracking algorithm that compares a preprogrammed image of the floor to the real time camera feed, and subtracts away any redundancy until only the difference features remain. The moving person can thus be isolated, identified, and followed, which triggers a red rectangular outline and grid pattern to appear.

The IR image now overlaid with tracking data undergoes a series of visual transformations. The powerful computers are able to make adjustments in cropping, scaling, warping, shifting, rotation, exposure, brightness, and sharpness, all within milliseconds. Only then are the "real time" images sent to the projector. The entirety of the 215 x 145 foot Drill Hall floor is covered by a total projection surface of 12360 x 7850 pixels, with each pixel being approximately ⅕ of an inch.

Hansel & Gretel (via Quartz)