Mini-GPT 4 is an AI chatbot you can use to ask questions about an image, a feature that's been promised but not yet shipped by GPT 4. So the prompter posts an image of a cactus sitting on ice in a lake and says, describe the image. Mini-GPT said the image shows a cactus plant standing in the middle of a frozen lake and then goes on to describe other aspects of it. Now let's try one of those responses: I have no idea if we can get it to write a poem.
We've had many examples of text-to-image but fewer AI models that can interpret images. MiniGPT-4 is a new open source model that can look at an image of food and give you the recipe, look at a white board mockup of a website and give you the code, look at a picture of a person and their dog at sunset and write a poem. Subscribe to the YouTube channel here: https://www.youtube.com/@TheAIBreakdown