Article Image

IPFS News Link • Robots and Artificial Intelligence

The Best AI Go Programs Have Large Flaws Exposed Which Means More Testing...

• https://www.nextbigfuture.com, by Brian Wang

It has been believed that the AI programs that play the strategy game of Go had gone far beyond human capability by 2016. In March 2016, it beat human world champion Lee Sedol in a five-game match, the first time a computer Go program had beaten a 9-dan professional without handicap. Although it lost to Lee Sedol in the fourth game, Lee resigned in the final game, giving a final score of 4 games to 1 in favor of AlphaGo. In recognition of the victory, AlphaGo was awarded an honorary 9-dan by the Korea Baduk Association.

In 2023, a new computer program was used to probe for weaknesses with the Go-playing AI programs. Weaknesses were found and the weaknesses were so simple to exploit they were taught to an amateur player. Amateur players would have no chance against the top human Go players. The top human Go players were beaten by the AI software but without comprehensive knowledge of what weaknesses the AI programs have. The new attacking AI computer program has found large repeatedly exploitable flaws in how the Go AI plays.

The flaws in the programs show that there is no actual understanding being replicated in the AI programs. The programming and techniques can do well at mimicking intelligence and achieving patterns of very strong play, but flaws can be found with enough testing. The Game of Go has complexity far beyond brute force supercomputing. The AI Go programs have been shown to be far from perfect. This could also be the case with the new GPT-4 and Generative AI systems.