MIT researchers developed a robot that can play Jenga based on a novel approach to machine learning that synthesizes sight and touch. From MIT News:
Alberto Rodriguez, the Walter Henry Gale Career Development Assistant Professor in the Department of Mechanical Engineering at MIT, says the robot demonstrates something that’s been tricky to attain in previous systems: the ability to quickly learn the best way to carry out a task, not just from visual cues, as it is commonly studied today, but also from tactile, physical interactions.
“Unlike in more purely cognitive tasks or games such as chess or Go, playing the game of Jenga also requires mastery of physical skills such as probing, pushing, pulling, placing, and aligning pieces. It requires interactive perception and manipulation, where you have to go and touch the tower to learn how and when to move blocks,” Rodriguez says. “This is very difficult to simulate, so the robot has to learn in the real world, by interacting with the real Jenga tower. The key challenge is to learn from a relatively small number of experiments by exploiting common sense about objects and physics.”
He says the tactile learning system the researchers have developed can be used in applications beyond Jenga, especially in tasks that need careful physical interaction, including separating recyclable objects from landfill trash and assembling consumer products.
“In a cellphone assembly line, in almost every single step, the feeling of a snap-fit, or a threaded screw, is coming from force and touch rather than vision,” Rodriguez says. “Learning models for those actions is prime real-estate for this kind of technology.”
"See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusion" (ScienceRobotics)
We presume it can tell by the pixels.
Whiskers are a fantastic natural sensor that enables cats, fish, seals, and many other animals to detect not just direct contact but even air flow indicating an approaching object. In a fascinating example of biomimicry, University of Queensland engineer Pauline Pounds and her colleagues have developed tiny whisker sensors for drones. According to the researchers, […]
Finnish company Valkee sells the HumanCharger, a pair of $150 earbuds with integrated LEDs to shine light into your ears. Their claim: This revolutionary device is for your well-being and channels bright light directly to the light-sensitive regions of the brain, right where it is needed the most. HumanCharger® can be used to increase energy […]
So you’ve visited the Kennedy Space Center every year. You’ve watched “The Right Stuff” for the 95th time. There must be something to do while you’re waiting to join Space Force for the next manned mission to Mars or the moon. Here’s a combo that should raise a salute from any fan of space or […]
Looking for a new tablet? If you haven’t upgraded in a while, it might be time to check out the latest iPad Pro for two very good reasons. First, the 2018 model is a real workhorse. The 12X Bionic chip processor means it can handle any task you set out for it, and still have […]
You want wireless earbuds to make an impact on your mood and workout, not the environment. If that’s the case, we’ve got a new contender for AirPod market share: Brio Phantom X7 True Wireless Earbuds. The features on these tiny, comfortable buds are impressive even without the environmental angle. Their Bluetooth 5.0 connectivity is good […]