Researchers Gain New Understanding From Simple AI

In the last two years, artificial intelligence programs have reached a surprising level of linguistic fluency. The biggest and best of these are all based on an architecture invented in 2017 called the transformer. It serves as a kind of blueprint for the programs to follow, in the form of a list of equations. But beyond this bare mathematical outline, we don’t really know what transformers are…

Source