AI can now play Minecraft just as well as you - heres why that matters

Date:
Sat, 25 Jun 2022 16:08:32 +0000

Description:
OpenAI has developed a neural network capable of playing Minecraft to a human-level standard.

FULL STORY ======================================================================

Experts at OpenAI have trained a neural network to play Minecraft to an equally high standard as human players.

The neural network was trained on 70,000 hours of miscellaneous in-game footage, supplemented with a small database of videos in which contractors performed specific in-game tasks, with the keyboard and mouse inputs also recorded.

After fine-tuning, OpenAI found the model was able to perform all manner of complex skills, from swimming to hunting for animals and consuming their
meat. It also grasped the pillar jump, a move whereby the player places a block of material below themselves mid-jump in order to gain elevation.

Perhaps most impressive, the AI was able to craft diamond tools (requiring a long string of actions to be executed in sequence), which OpenAI described as an unprecedented achievement for a computer agent. An AI breakthrough?

The significance of the Minecraft project is that it demonstrates the
efficacy of a new technique deployed by OpenAI in the training of AI models - called Video PreTraining (VPT) - that the company says could accelerate the development of general computer-using agents.

Historically, the difficulty with using raw video as a source for training AI models has been that that what has happened is simple enough to understand, but not necessarily how . In effect, the AI model would absorb the desired outcomes, but have no grasp of the input combinations required to reach them.

With VPT, however, OpenAI pairs a large video dataset drawn down from public web sources with a carefully curated pool of footage labelled with the relevant keyboard and mouse movements to establish the foundational model.

To fine tune the base model, the team then plugs in smaller datasets designed to teach specific tasks. In this context, OpenAI used footage of players performing early-game actions, such as cutting down trees and building crafting tables, which is said to have yielded a massive improvement in the reliability with which the model was able to perform these tasks. Read more

Microsoft, OpenAI may have solved a fundamental AI bottleneck

Microsoft is giving businesses access to GPT-3

OpenAI's new DALL.E model turns your words into art

Another technique involves rewarding the AI model for achieving each step in
a sequence of tasks, a practice known as reinforcement learning. This process is what allowed the neural network to collect all the ingredients for a diamond pickaxe with a human-level success rate.

VPT paves the path toward allowing agents to learn to act by watching the
vast numbers of videos on the internet. Compared to generative video modeling or contrastive methods that would only yield representational priors, VPT offers the exciting possibility of directly learning large-scale behavioral priors in more domains than just language, explained OpenAI in a blog post .

While we only experiment in Minecraft, the game is very open-ended and the native human interface (mouse and keyboard) is very generic, so we believe
our results bode well for other similar domains, e.g. computer usage.

To incentivize further experimentation in the space, OpenAI has partnered
with the MineRL NeurIPS competition , donating its contractor data and model code to contestants attempting to use AI to solve complex Minecraft tasks.
The grand prize: $100,000.



======================================================================
Link to news story: https://www.techradar.com/news/ai-can-now-play-minecraft-just-as-well-as-you-h eres-why-that-matters/


--- Mystic BBS v1.12 A47 (Linux/64)
* Origin: tqwNet Technology News (1337:1/100)