Artist uses AI to extract color palettes from text descriptions

Enlarge / A collection of 4 instance color palettes extracted from quick written prompts by Matt DesLauriers.

A London-based artist named Matt DesLauriers has developed a software to generate color palettes from any text immediate, permitting somebody to sort in “beautiful sunset” and get a collection of colours that matches a typical sundown scene, for instance. Or you may get extra summary, discovering colours that match “a sad and rainy Tuesday.”

To obtain the impact, DesLauriers uses Stable Diffusion, an open supply picture synthesis mannequin, to generate a picture that matches the text immediate. Next, a JavaScript GIF encoder named gifenc extracts the palette data by analyzing the picture and quantizing the colours down to a sure set.

DesLauriers has posted his code on GitHub; it requires an area Stable Diffusion set up and Node.JS. It’s a bleeding-edge prototype in the intervening time that requires some technical talent to arrange, however it’s additionally a noteworthy instance of the sudden graphical improvements that may come from open supply releases of highly effective picture synthesis fashions. Stable Diffusion, which went open supply on August 22, generates photos from a neural community that has been educated on tens of tens of millions of photos pulled from the Internet. Its means to draw from a variety of visible influences interprets effectively to extracting color palette data.

Advertisement

Other palette examples DesLauriers offered embrace “Tokyo neon,” which suggests colours from a vibrant Japanese cityscape, “living coral,” which echoes a coral reef with deep pinks and blues, and “green garden, blue sky,” which suggests a saturated pastoral scene. In a tweet earlier in the present day, DesLauriers demonstrated how totally different quantization strategies (decreasing the huge variety of colours in a picture down to only a handful that signify the picture) may produce totally different color palettes.

Different color quantization modules can produce different color palettes from the same image.Enlarge / Different color quantization modules can produce totally different color palettes from the identical picture.

It’s not the primary time an artist has used AI to extract color palettes from text. In May, an artist named dribnet revealed a generative artwork collection referred to as “Homage to the Pixel,” impressed by Josef Albers. He concurrently launched a web-based software that anybody can use to produce a six-color palette based mostly on text inputs.

Why use AI to discover color palettes? Aside from the novelty issue, you may probably extract matching colours from unconventional sources or summary emotions like “the day after my last day in high school,” “the discarded wrapper on a fast food burger,” or “Star Wars and Lord of the Rings mash-up.”

The means to extract color palettes from written prompts looks like one thing that standard artwork instruments may duplicate sooner or later since selecting teams of colours that go collectively effectively might be notoriously troublesome. Many extra sudden functions of picture synthesis fashions are probably on the best way.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Popular Posts

Amazon’s second Prime Day sale will take place Oct. 11-12

Workers retrieve containers at an Amazon success heart on Prime Day in Raleigh, North Carolina, U.S., on Monday, June 21, 2021.Rachel Jessen | Bloomberg...

What’s the Kennection? #29

All 5 solutions to the questions beneath have one thing in frequent. Can you work it out?

Napster names ex-Roblox music exec as CEO

Interested in studying what's subsequent for the gaming trade? Join gaming executives to debate rising components of the trade this October at GamesBeat Summit...

Singapore’s Temasek leads investment in Chinese start-up Well-Link

In simply three years, Beijing-based Well-Link Technologies has constructed a enterprise on real-time cloud rendering, together with serving to miHoYo launch the cloud model...

DocuSign names former Google executive Allan Thygesen as new CEO

Allan Thygesen, attends the YouTube Brandcast 2022 at Imperial Theatre on May 17, 2022 in New York City.Roy Rochlin | Getty ImagesDocuSign shares rose...