Learning to Play Using Low-Complexity Rule-Based Policies: Illustrations through Ms. Pac-Man
, a new paper published in the Journal of Artificial Intelligence Research 30 details a very successful experiment in teaching an AI to play Ms Pac Man:
The researchers had agents play 50 games using different RL methods. They found that methods utilizing the cross-entropy policies performed better than methods that were hand-crafted. As they explained, the basic idea of cross-entropy is that it selects the most successful actions, and modifies the distribution of actions to become more peaked around these selected actions.
During the game, the AI agent must make decisions on which way to go, which are governed by ruled-based policies. When the agent has to make a decision, she checks her rule list, starting with the rules with highest priority. In Ms. Pac-Man, ghost avoidance has the highest priority because ghosts will eat her. The next rule say that if there is an edible ghost on the board, then the agent should chase it, because eating ghosts results in the highest points.
One rule that the researchers found to be surprisingly effective was the rule that the agent should not turn back, if all directions are equally good. This rule prevents Ms. Pac-Man from traveling over paths where the dots have already been eaten, resulting in no points.
When Nintendo suddenly canceled the NES Classic, the surprise hit toy of last Christmas, the roar of anguish and outrage matched any the Internet had seen. Insane! Idiocy! There was only one smart take on the matter: the company must have a SNES Classic up its sleeve, playing even more and better classic games. And […]
Games Nostalgia is a retrogame site with a useful difference: instead of simply providing files which then must be fed to the often-difficult gods of emulation, it packages the classics as ready-to-click apps for Mac and PC. Examples to eat your morning: seminal Atari/Amiga RPG Dungeon Master, DOS blaster Doom, and 1990’s original RTS Dune […]
The first time Merle Rasmussen played Dungeons & Dragons, he thought it was a Halloween game.
“It was October 1975, and I was an 18-year-old freshman at Iowa State University. My roommate got this game filled with skeletons and undead monsters. I had no idea.” The role-playing bug had bitten him, but fantasy wasn’t his genre. So that same year, he started writing a game set in a modern world, the spy game that would become Top Secret.
If you struggle to get a good night’s rest, consider replacing your pillows before dropping hundreds on a new mattress. You can give your tired neck a break with a 2-pack of memory foam pillows, available now in the Boing Boing Store.Each of these pillows is stuffed with cooling polyurethane foam that molds to your […]
Although flagship smartphones are unlikely to adopt heavy-duty outer casing anytime soon, you can always prepare your device for the outdoors with a beefy case and and an external battery like this Nomad Tile Trackable PowerPack, available in the Boing Boing Store for $119.95.The Nomad Tile can fully recharge an iPhone 7 over three times […]
Even though credit cards now feature an EMV chip for securing transactions, they still have to include the magnetic strip for compatibility with older point of sale systems. Because of this, there’s no way for the chip’s new security capabilities to protect against card skimmers in the wild.How do you protect yourself from legacy-technology-induced fraud? […]