in

This AI Could Go From ‘Art’ to Steering a Self-Driving Car

This AI Could Go From ‘Art’ to Steering a Self-Driving Car
DALL-E generated these images for the prompt “a knight made of spaghetti.” Courtesy of OpenAI

You’ve probably never wondered what a knight made of spaghetti would look like, but here’s the answer anyway—courtesy of a clever new artificial intelligence program from OpenAI, a company in San Francisco.

The program, DALL-E, released earlier this month, can concoct images of all sorts of weird things that don’t exist, like avocado armchairs, robot giraffes, or radishes wearing tutus. OpenAI generated several images, including the spaghetti knight, at WIRED’s request.

DALL-E is a version of GPT-3an AI model trained on text scraped from the web that’s capable of producing surprisingly coherent text. DALL-E was fed images and accompanying descriptions; in response, it can generate a decent mashup image.

grid with computer generated illustrations of a vegetable with a dog on a leash

Images created by DALL-E in response to “an illustration of a baby daikon radish in a tutu walking a dog.” Courtesy of OpenAI

Pranksters were quick to see the funny side of DALL-E, noting for instance that it can imagine new kinds of British food. But DALL-E is built on an important advance in AI-powered computer vision, one that could have serious, and practical, applications.

Called CLIP, it consists of a vast artificial neural network—an algorithm inspired by the way the brain learns—fed hundreds of millions of images and accompanying text captions from the web and trained to predict the correct labels for an image.

Winter Sale. Winter Sale. Get WIRED for $10 $5. Subscribe Now

Researchers at OpenAI found that CLIP could recognize objects as accurately as algorithms trained in the usual way—using curated data sets where images are neatly matched to labels.

As a result, CLIP can recognize more things, and it can grasp what certain things look like without needing copious examples. CLIP helped DALL-E produce its artwork, automatically selecting the best images from the ones it generated. OpenAI has released a paper describing how CLIP works as well as a small version of the resulting program. It has yet to release a paper or any code for DALL-E.

Source: www.wired.com

What do you think?

48 points
Upvote Downvote

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Computer Vision and AI for Enterprises – 2021 Guide

Computer Vision and AI for Enterprises – 2021 Guide

Smart Algorithm Cleans Up Images By Searching For Clues Buried In Noise

(video) Smart Algorithm Cleans Up Images By Searching For Clues Buried In Noise