

/cdn.vox-cdn.com/uploads/chorus_image/image/65089914/minecraftearth.0.jpg)
“In order to steal, you would have to look up and go, ‘Hmm, I’m going to take your blocks,’” says Saxs Persson, creative director of Minecraft. That introduces an interesting social dynamic because, unlike most games, you’ll be physically next to the person you’re stealing from in the virtual world. I could, if I wanted to, also steal my friend’s blocks here to create my own mega building. They could also see everything I was doing in real time, and we could build together block by block. I sat for around 10 minutes creating a Minecraft build where I could see blocks flying onto the structure from someone next to me. The Verge has reported that they had the chance to spend some time with the game, and it plays out exactly as the developers promise: These levels include face-to-face interaction between players and monsters and quest missions. Once it’s been placed enough times in a safe area, it will persist for new players to simply walk up and start interacting with the adventure.Minecraft Earth uses OpenStreetMap data to bring blocky adventures into real-world settings. These will mainly be placed nearby where people are often collecting the tapables, and it will be up to the first few players in that area to decide exactly where an adventure gets placed. Adventures will start off conservatively, and players will walk up to the rough area that Microsoft has designated a place to play. This allows Microsoft to locate every player in the game and precisely know where they are standing and where to place an adventure for everyone to interact with. “To do this, we had to take some of the HoloLens algorithms for capturing images on device and turn them into a point cloud that we can share,” says Jason Cahill, an engineering architect for Minecraft. MICROSOFT USED ITS HOLOLENS TECH TO BRING ‘MINECRAFT EARTH’ TO LIFE Without this machine vision, Microsoft wouldn’t be able to be so ambitious with Minecraft Earth. There are obviously privacy implications here, and Microsoft says all data and images will be anonymized so that the algorithms are only detecting feature points around you. They’ll also contribute to making Microsoft’s Azure Spatial Anchors technology more powerful, simply by pointing their cameras at the environment around them.

This means that Minecraft Earth players are going to help inform where adventures should be placed. “We rely on people going out and, essentially, not scanning the world, but seeing the world for us and then making that common play space,” explains Persson. This is the secret sauce of Minecraft Earth, if you will. Apple and Google are also working on ways to let multiple devices see and interact with the same virtual object in AR, but Microsoft is trying to create the infrastructure and tools to let developers use this across iOS and Android.

These holograms, as Microsoft calls them, always stay in the same spot. It uses machine vision algorithms so that real-world objects can be used as anchors for digital content. Microsoft is using its new Azure Spatial Anchors technology in Minecraft Earth.
