Over a million developers have joined DZone.

Researchers Develop AI to Tackle Minecraft Mazes

Well, I for one welcome our new robotic overlords. Check out how researchers are are using the Minecraft environment to test out their theories and make progress in the field of AI.

· Big Data Zone

Hortonworks DataFlow is an integrated platform that makes data ingestion fast, easy, and secure. Download the white paper now.  Brought to you in partnership with Hortonworks


Earlier this year, Microsoft announced that they would be opening up the hugely popular virtual game environment Minecraft for scientific research. They launched Minecraft AIX to utilize the platform for research into areas such as AI.

The platform was developed at Microsoft’s Cambridge lab and allows researchers to use the Minecraft environment to test out their theories and, hopefully, therefore make progress in the field of AI.

First Steps

One of the first examples of this in practice was unveiled in a recently published paper whereby scientists put AI algorithms through their paces in Minecraft constructed mazes.

Mazes have long been used in behavioral psychology as researchers tested the ability of rats and mice to remember things and learn new pathways, with a particular emphasis on reinforcement learning. With this approach receiving particular attention in AI work, it is perhaps no surprise that virtual mazes should be used to put AI through their paces.

In real-world experiments, mazes have to be limited in their complexity to ensure that experiments can be replicated. Of course, no such limitations exist in Minecraft.

Virtual Maze

Rather than rats, however, the beings put through their paces in the Minecraft mazes are artificial intelligence creations.  The aim is to test the AI in environments that more accurately reflect the uncertain and often fuzzy nature of the real world.

Such environments are difficult to create in the real world, but Minecraft offers considerable opportunities to do just that.  The team created a bunch of challenging mazes for their AI to try and crack, and you can see the algorithms in action via the video below.

The mazes are designed to ensure that the algorithms are heavily tested, with various rewards offered for the successful completion of a task. By building the mazes in a virtual world, they also ensure the replicability of the tests, and hopefully therefore the robustness of the results.

The initial results suggest that the best performing algorithms are using deep reinforcement learning with a side helping of additional memory that is formed from the context within which the algorithm finds itself.  It’s a break from most current systems and suggests a useful level of progress.

It’s probably the best example of how the Minecraft platform can be used for AI research thus far, and the team suggests that it will be a fertile testing ground for any future AIs they develop too.

“In future work, we intend to take advantage of the flexibility of the Minecraft domain to construct even more challenging cognitive tasks to further evaluate our architectures,” they conclude.

Hortonworks Sandbox is a personal, portable Apache Hadoop® environment that comes with dozens of interactive Hadoop and it's ecosystem tutorials and the most exciting developments from the latest HDP distribution, brought to you in partnership with Hortonworks.


Published at DZone with permission of Adi Gaskell, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

The best of DZone straight to your inbox.

Please provide a valid email address.

Thanks for subscribing!

Awesome! Check your inbox to verify your email so you can start receiving the latest in tech news and resources.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}