A machine’s hallucinations

Abstract

Have you ever looked at a turtle and thought it was a rifle? I’m willing to bet that most of you have not. This may sound like an absurd case, but it is exactly what happened when researchers at MIT (Massachusetts Institute of Technology) were trying to find vulnerabilities in machine learning systems developed by Google. They altered a few pixels of the picture of a 3d-printed plastic turtle, and a seemingly unchanged and harmless plastic turtle was classified by Google’s algorithm as a rifle. The picture still showed a plastic turtle, so where did the algorithm go wrong?