Software beats humans at crossword solving; Web is "shallow AI"

A bilingual Italian-English crossword competition has been swept by software based crossword-solvers that beat the pants off their human competitors in all but the pun-heavy Italian cryptic crossword category. Interestingly, the software used search-engine results and the Web as a "shallow source of human knowledge for artificial intelligence."
WebCrow uses four techniques in parallel to find possible answers to a clue. Two involve looking for the clue or a near match in a database of solved crosswords or using a dictionary. Another uses rules known to work on a kind of Italian clue with two letter answers and the fourth technique is to search the internet.

WebCrow performs a search using key words extracted from the clue. It can usually find the answer by looking at the small previews that appear with the search engine results, but it can scan whole pages if necessary. Words of the right length that crop up most often in the results are taken to be possible answers...

Tony Veale works on software that can deal with human language at University College Dublin, Ireland, and watched WebCrow in action. He told New Scientist he was impressed. "It's part of a trend to use the web as a shallow source of human knowledge for artificial intelligence," he says.