MineDojo | Building Open-Ended Embodied Agents with
Internet-Scale Knowledge
Open-ended Exploration
in
Overworld
The Nether
, and
The End
Fight against an
Ender
dragon
Scoop a
bucket of
lava
Explore an
ocean
monument
Find a
desert pyramid
Wide Variety of Terrains, Weathers, and Items
Equip different levels of
armor
Build a
Nether Portal
and enter it
Visit an
end city
Traverse different
terrains
Diverse and Creative Tool Usage
Encircle
llamas
with
fences
Play fireball with a
ghast
Grow
wheat
Block damage with a
shield
730K
YouTube videos with
2.2B
words in English transcripts
~7K
Wiki pages with interleaved text, images,
tables, and diagrams
340K
Reddit posts with
6.6M
comments in r/Minecraft subreddit
Jim (Linxi) Fan
Guanzhi Wang
Yunfan Jiang
Ajay Mandlekar
Yuncong Yang
Haoyi Zhu
Andrew Tang
De-An Huang
Yuke Zhu
Anima Anandkumar
Email lead developers. * Equal
contribution. † Equal advising.
@inproceedings
fan2022minedojo
title
{MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge}
author
{Linxi Fan and Guanzhi Wang and Yunfan Jiang and Ajay Mandlekar and Yuncong Yang and Haoyi Zhu and Andrew Tang and De-An Huang and Yuke Zhu and Anima Anandkumar}
booktitle
{Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track}
year
{2022}
url
{https://openreview.net/forum?id=rc8o_j8I8PX}
MineDojo team ©2022
US