The Origin of the Bolt Machine

The origin of the bolt machine comes from a meeting in rochester. Scott kirkpatrick was giving a talk on the hopfield work. Jeff and dave rummelhart were trying to figure out how the brain works. They found that if they lowered temperature slow enough, you got to the gold minimum. But there's an amazing linearization takes place which allows them to compute weights changes across layers.