Deepmind presented an AI that could beat human champions at Starcraft II. It claimed the AI was limited to what human players can physically do, putting its achievement in the realm of strategic analysis rather than finger twitchery. But there's a problem: it was often tracked clicking with superhuman speed and efficiency.
1. AlphaStar played with superhuman speed and precision.
2. Deepmind claimed to have restricted the AI from performing actions that would be physically impossible to a human. They have not succeeded in this and most likely are aware of it.
3. The reason why AlphaStar is performing at superhuman speeds is most likely due to it’s inability to unlearn the human players tendency to spam click. I suspect Deepmind wanted to restrict it to a more human like performance but they are simply not able to.
Pietikäinen suggests that because Deepmind would have depended on recorded human games to train the AI, it picked up a peculiar human behavior: idle or unnecessary "spam clicking". As a result Deepmind would have been forced to lift the AI's clickspeed limits to escape this behavior, at which point it develops strategies that irreducibly depend on bursts of superhuman speed. In brief:
"It is deeply unsatisfying to have prominent members of this research project make claims of human-like mechanical limitations when the agent is very obviously breaking them and winning it’s games specifically because it is demonstrating superhuman execution."
It looks rather like Deepmind bungled an interesting AI's announcement by making claims about it that it didn't realize were wrong. It almost seems like they didn't know why their AI is so good at Starcraft II and ended up fooled by its relatively slow mean speed.
Google spent all the money in the world creating a machine god to dream the perfect Startcraft II strategy, and woke it from its slumber, and it raised its ghostly data-hand, and it said "click faster."
渋谷でゲームあるある再現してみた pic.twitter.com/dk5KH6kUgM — がんそ【駒沢アイソレーション】 (@KaoruGans0) August 5, 2020 In this video, @KaoruGans0 walks around Shibuya like a character from a video game: stilted and repetetive pacing; sliding oddly along walls; and interacting robotically with landmarks, conspiciously obvious items and other people.
Townscaper is a charming and beautiful toy by Oskar Stålberg (previously at BB), available now for Windows and MacOS. It approaches the city-builing genre, but subtracts all the things that make such games distressing and frustrating, leaving you to create the waterside town of your dreams without worrying about resources, enemies, natural disasters or other […]
I wrote about the original 8bit Card Deck a couple of years back, and now a second edition is live with tweaked designs and the same pixel-perfect look. $15 a deck, target hit, and no question about fulfilment as the print order’s already in with Gambler’s Warehouse. The 8Bit Deck is back with a fresh […]
Part of the reason WordPress is the undisputed king of website creation is its open-source framework, allowing anyone to create plugins offering levels of functionality to WordPress sites that were unprecedented. So where do you find all the great ideas that are pushing WordPress forward? You can sample a heaping spoonful of that innovation with […]
If you’re a photographer, videographer, or graphic designer, you’ve got a lot of competition charging up behind you. Because while you’ve been trained as a content creator, the task of snapping brilliant images, capturing well-composed video, and posting effective social media is now part of literally everyone’s skill set. For years, Adobe and their ubiquitous […]
After years of hearing a steady drumbeat about the necessity of surfing the web under the protection of a VPN, even the most technophobic among us are starting to come around. But even knowing the dangers one can face from cybercrooks phishing for information from unsuspecting victims online, those last holdouts still have some fears. […]