An example of what Scribble Diffusion can "produce" (right) using a simple sketch (left). — Photography Courtesy of Scribble Diffusion/AFP Relaxnews
It appears that no field of activity will be untouched by artificial intelligence, including the domains of culture and art. The Scribble Diffusion web application presents itself as a simple and novel way to take your first steps into the world of AI-generated art, with just a simple sketch and a short description.
In recent months the web has seen a flood of people trying out programs like Midjourney or DALL-E and posting their creations on social media. These very powerful machine learning models allow users to generate incredibly photorealistic digital images, from more or less precise descriptions in natural language, known as prompts. But there are also image-creating tools that are less oriented towards photorealism, and focusing on a fun, playful approach instead. This is the case of Scribble Diffusion.
This web application, which can be accessed free of charge, allows users to convert simple sketches or drawings into more or less realistic paintings. The idea is to make a drawing with a finger, a stylus or a mouse, with a brief text description and then obtain a much more artistic equivalent in one click. Of course, it's possible to "touch up" the image afterwards too for a result more in line with your expectations.
Scribble Diffusion is an open-source project and its code is available on GitHub. The program is based on a brand new neural network structure called ControlNet. Here, artificial intelligence interprets the drawing to then generate the closest possible "artistic" image. – AFP Relaxnews
