How a GPT Works and How a Neural Network Works in General

A neural network in this case is just a mapping of from input neurons to a set of output selections. And what I've done here is I've trained a very simple model that can recognize the picture of a smiley face or a picture of a frowny face. It's really not as hard as it looks. So we see here, the input show is a five by five grid that shows a smile of frowny face and we see that the perceptron perceptron is a very, very simple neural network.