DZone
AI Zone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
  • Refcardz
  • Trend Reports
  • Webinars
  • Zones
  • |
    • Agile
    • AI
    • Big Data
    • Cloud
    • Database
    • DevOps
    • Integration
    • IoT
    • Java
    • Microservices
    • Open Source
    • Performance
    • Security
    • Web Dev
DZone > AI Zone > New Research Highlights the Long Road Still Ahead for AI

New Research Highlights the Long Road Still Ahead for AI

A recent study from UCLA highlights just how far there still is to go for AI.

Adi Gaskell user avatar by
Adi Gaskell
·
Feb. 21, 19 · AI Zone · News
Like (1)
Save
Tweet
3.98K Views

Join the DZone community and get the full member experience.

Join For Free

The media has been awash with breathless prose about the capabilities of artificial intelligence in recent years. One would be forgiven for thinking that machines are practically at human levels of cognition already, or at least will be very soon.

A recent study from UCLA highlights just how far there still is to go. The study illustrated a number of quite significant limitations that the researchers believe we have to understand and improve upon before we let ourselves get carried away.

The researchers ran a number of experiments to test the progress made with machine vision. The first of these saw the VGG-19 deep learning network being shown color images of various animals and objects, with each image altered in some way. For instance, a camel might have been doctored to have zebra stripes. Across 40 different images, it was only able to correctly identify the object five times.

Easily Fooled

The researchers suggest that humans typically identify objects from their shape, but AI-systems appear to be using a different method. This was highlighted in a second experiment where VGG-19 was shown images of glass figurines alongside a second network, called AlexNet.

Once again, however, after being trained using images from the ImageNet database, both systems were unable to identify the glass figurines with any degree of accuracy. Similar results were achieved in a third experiment that tested the same two systems on a fresh set of images.

The goal was not so much to test the reliability of the systems but to understand how they identified the objects. This understanding was furthered by a fourth experiment where both networks were shown another bunch of images, all of which were solid black.

On this task, the AI did much better, producing the correct guess in their top five choices around half of the time. Still not a great performance, but certainly better, and the authors' reason that the AI did better with black objects because they lack "internal contours," which the team believes confuse the AI.

A fifth and final experiment then scrambled each image to make it more difficult to identify. The team picked six images that the AI had correctly identified in the previous experiments and jumbled them up. Interestingly, while human volunteers struggled to identify the scrambled images, the computers did so five out of six times.

The team believes this happens because humans see the entire object when they look at it, whereas computers tend to look at fragments of it instead.

"This study shows these systems get the right answer in the images they were trained on without considering shape," they continue. "For humans, the overall shape is primary for object recognition, and identifying images by overall shape doesn't seem to be in these deep learning systems at all."

Given the number of computer vision systems entering the market, the team is optimistic that their work will do much to improve the quality and reliability of these systems.

AI

Published at DZone with permission of Adi Gaskell, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

Popular on DZone

  • How to Determine if Microservices Architecture Is Right for Your Business?
  • Using Unsupervised Learning to Combat Cyber Threats
  • JUnit 5 Tutorial: Nice and Easy [Video]
  • Kafka Fail-Over Using Quarkus Reactive Messaging

Comments

AI Partner Resources

ABOUT US

  • About DZone
  • Send feedback
  • Careers
  • Sitemap

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • MVB Program
  • Become a Contributor
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 600 Park Offices Drive
  • Suite 300
  • Durham, NC 27709
  • support@dzone.com
  • +1 (919) 678-0300

Let's be friends:

DZone.com is powered by 

AnswerHub logo