<\/p>\n
Artificial intelligence (AI) image generators are making big advances, and they\u2019ve learnt a thing or two about South Africa.<\/p>\n
AI image generators are the latest in the rapidly growing world of machine learning. <\/p>\n
They are tools that transform a string of words, like \u201cfood magazine photo of Durban curry on a plate on top of a tablecloth\u201d into images like these:<\/p>\n At a basic level, machine learning uses huge amounts of data to learn some kind of task. <\/p>\n This could be identifying faces, for things like Instagram filters, or predicting which words come next in a sentence, like how Google suggests searches after you only type a couple of words.<\/p>\n Image generators are no different, and are trained using vast collections of pictures paired with a description of what\u2019s happening in each of them. This allows them to predict what a given sentence may look like as an image. <\/p>\n Here are some of its predictions for what \u201ca political rally in South Africa\u201d could look like:<\/p>\n Not bad! Except for the faces. These tools are only good at creating things if they see lots of examples of them during training. It would be interesting to see how much these tools \u201cknow\u201d about South Africa.<\/p>\n As you can see, image generators often struggle with realistic faces, especially with groups of people.<\/p>\n One of the things AI image generators are good at is making pictures in different artistic styles.<\/p>\n Obviously, these tools often struggle with the fine details of complicated things like faces and hands. You\u2019ll no doubt run into examples of strange people with extra arms, or objects like firearms which seem okay from a distance, but make no sense on a closer look.<\/p>\n As you might guess, it usually creates writing that is (mostly) nonsense. Here are its attempts at \u201ca political cartoon about Jacob Zuma\u2019s prison sentence ending\u201d:<\/p>\n You usually get better results by being specific and telling it exactly what you want. But it can be very interesting to see what it comes up with when given a very abstract sentence.<\/p>\n Keep in mind that these machine learning models don\u2019t \u201cunderstand\u2019 what you ask them to do, and aren\u2019t doing any kind of \u201dthinking\u201c that would be familiar to a human. <\/p>\n They just associate words and images in ways that they have seen before.<\/p>\n Here are some very different attempts at \u201cChief Justice Zondo shining a light on corruption\u201d.<\/p>\n The AI model being used for these images is called Stable Diffusion, which is open source and available for free. <\/p>\n The examples in this article are far from the best that can be achieved with better hardware, clever use of current tools like upscalers, and lots of attempts. <\/p>\n But they should give you an idea of what is currently possible, and a taste of what is still to come.<\/p>\n