Microsoft’s new AI bot creates drawings based on text descriptions

Microsoft’s new AI tool draws beautiful images from text

The Artificial Intelligence (AI) technology has incredibly evolved over the last few years and is touted to be the next big thing of the future.

Making more headway in that direction is Microsoft Corp. who has been investing in multiple projects relating to AI. The tech giant has created a new AI tool which it calls a “drawing bot” using a Generative Adversarial Network (GAN) running on two machine learning models. The bot uses the GAN to generate images based merely on a descriptive caption.

One machine learning model generates images from text descriptions, while the other model known as a discriminator uses descriptions of text to judge the authenticity of generated images, so that it cannot be tricked. Working together, the discriminator pushes the generator toward perfection. By using the GAN technique, AI pays close attention to individual words when generating images from caption-like text descriptions, thereby achieving a three-fold uplift in image quality compared to previous text-to-image method.

According to Microsoft, the bot is even capable of imagining details while drawing that are not specifically mentioned in the text, which indicates that the AI contains an ”artificial imagination”.

For instance, the below image was created by the drawing bot simply from the description of “a bird with a yellow body, black wings and a short beak.” Although it is not specified in the text given, the AI elected to place the bird on a branch using its artificial imagination. Not just birds, the AI tool can draw anything from ordinary countryside scenes, such as grazing livestock, to the bizarre, like a floating double-decker bus.

“If you go to Bing and you search for a bird, you get a bird picture. But here, the pictures are created by the computer, pixel by pixel, from scratch,” Xiaodong He, a principal researcher and research manager in the Deep Learning Technology Center at Microsoft’s research lab in Redmond, Washington, said in a report on the project. “These birds may not exist in the real world — they are just an aspect of our computer’s imagination of birds.”

Microsoft researcher Pengchuan Zhang said of the research, “You need your machine learning algorithms running your artificial intelligence to imagine some missing parts of the images. From the data, the machine learning algorithm learns this commonsense where the bird should belong.”

The research report, which has yet to undergo scientific review, could act as a sketch assistant to painters and interior designers, says Microsoft. Mr. He imagines the technology could generate animated films based on screenplays, which would ‘augment the work that animated filmmakers do’ by eliminating some of the manual labor involved.

Kavita Iyer

An individual, optimist, homemaker, foodie, a die hard cricket fan and most importantly one who believes in Being Human

Recent Posts

10 Best Free Skype Alternatives For Windows/Android/iOS

Since its advent in 2003, Skype has become an industry standard when it comes to video calling on Windows PC. In…

7 hours ago

Sony PlayStation Classic hacked to run games off a USB drive

Hackers crack Sony’s PlayStation Classic shortly after the release Last week, Sony released PlayStation Classic with 20 officially preinstalled games,…

11 hours ago

What to Do If Your iPhone or iPad got stuck on Apple logo?

There are situations when people have frozen iPhone and iPad on Apple logo during startup. And, if you are also…

2 days ago

Google decides to kill off Google+ earlier than planned

Another data leak forces Google to close down Google+ in April 2019 In October this year, we had reported how…

2 days ago

How to factory reset an iPhone or iPad?

Factory Resetting an iPhone or iPad is the best way to get rid of problems that you are not able…

3 days ago

Google Chrome’s Dark Mode For macOS To Arrive In Early 2019

Chrome’s Dark Mode in macOS Mojave to come by early 2019 In early September this year, it was rumored that…

3 days ago