Learning to Play Using Low-Complexity Rule-Based Policies: Illustrations through Ms. Pac-Man, a new paper published in the Journal of Artificial Intelligence Research 30 details a very successful experiment in teaching an AI to play Ms Pac Man:
The researchers had agents play 50 games using different RL methods. They found that methods utilizing the cross-entropy policies performed better than methods that were hand-crafted. As they explained, the basic idea of cross-entropy is that it selects the most successful actions, and modifies the distribution of actions to become more peaked around these selected actions.
During the game, the AI agent must make decisions on which way to go, which are governed by ruled-based policies. When the agent has to make a decision, she checks her rule list, starting with the rules with highest priority. In Ms. Pac-Man, ghost avoidance has the highest priority because ghosts will eat her. The next rule say that if there is an edible ghost on the board, then the agent should chase it, because eating ghosts results in the highest points.
One rule that the researchers found to be surprisingly effective was the rule that the agent should not turn back, if all directions are equally good. This rule prevents Ms. Pac-Man from traveling over paths where the dots have already been eaten, resulting in no points.
The fad for fire-and-forget retro consoles continues with Sony’s PlayStation Classic. It’s $100, has 20 games built-in, modern connectors, and the original 1995 design—albeit shrunk to the size of the original’s controller. Five of the games were announced: Final Fantasy 7, Jumping Flash, R4: Ridge Racer Type 4, Tekken 3 and Wild Arms. The mini […]
Wide World of Sports Video Games picks just one classic video game to represent each sport and organizes them into a neat gallery. It’s the work of Tim Szetela, with Jason Eppink and John Sharp. Players compete in more than 8,000 different sports around the world, but many sports video games focus on baseball, basketball, […]
Davit Masia, creator of Pixatool (previously), made another app for pixel artists with Manuel Jesus Bolanos Gomez—this time with the focus on movement. Pixel FX generates particle effects such as clouds, smoke, fire and fog. With Pixel FX Designer you can create awesome particle effects with the ability to giving them a pixelart feel by […]
iOS 12 is finally here, which means now is the best time for aspiring developers to throw their hats into the app development game. While app development can be tricky for some, you can take an intuitive, beginner-friendly approach to understanding app creation and Apple’s latest iOS platform with the iOS 12 & Xcode 10 Bootcamp, […]
It might still be September, but the holiday season will be here before you know it, which means now is the time to think about where you want to vacation to—and what to do once you get there. To this end, we’ve scoured the Web and tracked down a number of travel hacking ebooks, gadgets, […]
The human eye is a beautiful, incredible thing, but it’s far from perfect, especially when it comes to examining objects up close. Capable of magnifying objects up to 1,000 times, this portable microscope camera lets you see wonders hidden to your regular vision, and it’s on sale today for $38.99. Don’t let its compact size fool […]