Is Superintelligence Impossible?

Andy Clarke does an interesting and concise commentary on a discussion between Daniel Dennett and David Chalmers. I pass on the final two paragraphs of Clark's comments and suggest you read the whole piece.

I think we can divide the space of possible AI minds into two reasonably distinct categories. One category comprises the “passive AI minds” that seemed to be the main focus of the Chalmers-Dennett exchange. These are driven by large data sets and optimize their performance relative to some externally imposed choice of “objective function” that specifies what we want them to do—win at GO, ...