The Metaverse has many advanced technologies at its core. Some have been under development for years, and others are brand new. We have explored some of them in previous booklets, such as blockchain and Web 3. Today we cover three more technologies that are essential to the development of the Metaverse – AR, VR and MR.

Talking about new worlds in the Metaverse would be incomplete without a discussion of augmented reality (AR), virtual reality (VR) and mixed reality (MR). These are key components for the Metaverse and play a crucial role in the MetaverseME app and football game KickOff Evolution. Today we’ll explore these technologies and answer questions like:

• What is AR/VR/MR?

• How are these technologies the same?

• How do they differ?

• Do you need special equipment?

• What are some examples of AR/VR/MR?

• What role do they play in the Metaverse?

You’ll find answers to these questions and more below. Let’s dive in!

What Is Augmented Reality (AR)?

Augmented reality (AR) technology enriches the user's real world experience by layering on virtual elements and digital information, such as images, sound, video, and other virtual details. ‘Augmented’ literally means adding extra value, and that is exactly what this technology does.

The main goal of AR is to complement the real life environment and allow virtual elements to interact with real objects to create the intended stories. In AR, virtual environments and digital objects coexist with real ones.

AR technology typically uses familiar devices like smartphone cameras, so no special equipment is needed. With AR systems, virtual 3D objects are projected onto real-world objects in real time based on their geometric relationships, their position, and the orientation of objects relative to them. The combined image is then projected onto the screen of a mobile device, augmented reality glasses, or another device.

Examples of AR technology can be found everywhere. The most basic AR examples are photo filters on Instagram and Snapchat, virtual dressing rooms where you can try on clothes with your avatar, and interior decorating apps. In terms of gaming, Pokémon Go developed and published by Niantic in 2016, gave AR technology a boost and sparked user interest.

What Is Virtual Reality (VR)?

Virtual reality (VR) refers to technology that creates three-dimensional digital images and virtual experiences for users.

VR creates the illusion of being immersed in a life-size, three-dimensional digital environment. Computer graphics are used to create images and videos that replicate the real or imagined world. Then the user can step into and engage with the computer-generated digital environment.

To experience VR, users need specialized computers and devices, such as VR glasses, gamepads and gloves to control the 3D virtual environment. With special lenses in VR headsets and controllers, users can perceive and interact with virtual content like in the real world. Some hardware even includes features that allow users to perceive the VR environment using all five human senses.

Examples of VR technologies include entertainment apps and video games (like Resident Evil 7 for Playstation), educational platforms, and business apps for virtual meetings (such as MeetinVR).

What Is Mixed Reality (MR)?

Speaking of AR and VR, it’s also worth mentioning mixed reality (MR). Contrary to popular belief, MR is not a combination of AR and VR. Sometimes referred to as a hybrid reality, MR is a fusion of the virtual and physical worlds to create a new environment where interaction between virtual and physical objects takes place in real time.

Unlike VR (which immerses users in a completely virtual environment), or AR (which simply superimposes digital content on top of the physical environment), MR devices constantly collect new information happening in the real world environment (for example, a person’s body position, lighting, and physical objects). This information is then used to seamlessly place digital content into the physical environment and allow users to interact with it. That is, they can interact with the digital projections as though they were real, and can still see themselves and other people and objects in the real world around them.

MR is best understood with examples, so let’s look at the HoloAnatomy software, which uses Microsoft Hololens technology. The HoloAnatomy software can project a 3D hologram of a human body into the real world. Students wearing the MR glasses can still see the real world around them, but now they also see the hologram as if it was actually there in real life. Not only that, but they can interact with the digital body, examining (for example) how the heart moves, how the brain processes information, or how bones fit together. The experience gives medical students a greater understanding of anatomy by giving them a hands-on (albeit virtual) learning experience.

How AR and VR Impact the Development of the Metaverse

According to Statista, the combined AR and VR market will reach $30 billion in 2023 and more than $50 billion by 2027. More and more companies are finding ways to use these cutting-edge technologies, and, of course, they are closely tied to the development of the Metaverse too.

Many Metaverses, including MetaverseME, now use augmented reality as a core technology. Others are fully immersed in a three-dimensional virtual environment through VR. While wearing a VR headset or other gadget is not mandatory in the Metaverse, experts believe virtual reality technology will be an integral part of new Metaverse environments.

Here at MetaverseME, we believe the Metaverse will influence the way we interact with each other by connecting the virtual and physical worlds. As such, the Metaverse will become a shared, virtual, 3D space with an online infrastructure and real-time events. Therefore, AR, VR, and MR technologies will be essential in connecting the real and the virtual in the meta-universe. Augmented reality technology embeds 3D visualisations in the physical world. Mixed reality goes a step further by enabling real-time interaction with digital objects. Meanwhile, VR is an integral component of the new Metaverse ecosystem, providing users with an immersive, dynamic, three-dimensional, virtual environment.

As AR, VR, and MR technologies are developed, the Metaverse will become a place where users can jump into a digital reality (with VR), alter the physical world with digital objects and experiences (with AR), or even interact with digital projections as if they existed in real life (with MR).

Applications of AR and VR in the Metaverse

AR, VR and the Metaverse are combining in interesting ways in gaming, education, healthcare, and other areas. Here are some examples of the many applications of AR and VR in the Metaverse.

Gaming

As games become increasingly immersive, AR and VR technologies will play a bigger role in game development. There are now many Metaverse games that make extensive use of AR and VR technologies.

For example, the Pokemon-inspired play-to-earn game Axie Infinity features fantastic creatures called Axies that players can breed, raise, collect, and trade. Also popular is Illuvium, which is described as a 'true triple-A, 3D blockchain' game. In this game, users hunt divine-like creatures, called Illuvials, in an alien landscape, where they can capture them with shards or nurse them back to health.

Famous virtual worlds such as Decentraland and online gaming platforms such as The Sandbox are also examples that combine AR, VR and the Metaverse. We have described them before when we explained the ecosystems within the Metaverse.

Education

The field of education has turned to new technologies since COVID-19. Today, many science concepts are presented as real with the help of augmented reality.

For example, a tornado can be created right in the classroom, or the universe can be explored using the SkyView app directly from a smartphone.

Meanwhile, the Steam VR Museum allows users to see world-class paintings and sculptures up close. In the Metaverse, you can even bring your virtual avatar online and make it a real student.

Healthcare

AR, VR and Metaverse technologies are also actively used in healthcare.

Today, doctors can use filters in surgery, superimpose medical images on a patient, treat post-traumatic stress disorder in military veterans, and conduct rehabilitation all using augmented and virtual reality technology.

Other Areas

Advanced technologies such as AR and VR are used in other areas too:

• Tourism: AR/VR technology allows for virtual travel, which is an advantage for people who cannot travel long distances.

• Remote Work: Metaverse virtual business architecture is already used by numerous companies. For example, Nike, Intel, YouTube, McDonald's and other companies have virtual offices.

• Real Estate: Prospective buyers can go on a property tour, visiting real properties in real time in Metaverse and view all their options in real time).

• Banking: You can use your mobile device to access the banking Metaverse and get a 360-degree view of real banks.

• Virtual Marketplaces: Businesses are moving away from two-dimensional e-commerce and creating realistic virtual marketplaces for customers.

• Social Media and Entertainment: From filters to the creation of avatars and virtual clones, VR and AR are changing the way users communicate and entertain themselves online.

Challenges with the Adoption of AR and VR in the Metaverse

The application of AR/VR technologies into the development of the Metaverse is an exciting area that we’re particularly interested in here at MetaverseME, as we continue to explore how to incorporate augmented and virtual reality into our own ecosystem.

That said, it’s worth remembering that there are many challenges for developers to overcome. Some potential problems include the compatibility of digital objects and real-time data synchronisation. At scale, these problems could be very complex and expensive to solve.

As AR, and VR are still emerging technologies, they are currently not well integrated into the world of commerce (largely because of the high cost and complexity of the technology). However, these tools are the future, and companies in every industry should rethink their product development and marketing approaches to incorporate VR/AR technologies.

Mass adoption of AR and VR will be a slow process too. There is a growing population of people who are interested in exploring AR, VR and the Metaverse, but adoption on a larger scale will take time. Users need to understand these technologies before they will embrace them. Moreover users need to see a real benefit for themselves and their everyday life, be it in entertainment, education or other areas, when adopting these new technologies. Something that goes beyond a pure hype around the fascination for incredible technology. We hope that booklets like this one will encourage you to learn more about this cutting edge technology, and become a pioneer in the Metaverse.

Conclusion

Very soon, users will be able to bridge the gap between the digital and physical worlds by entering the Metaverse with augmented and virtual reality. If you’re as excited about this as we are, we invite you to join us and embark on your own hero road to the Metaverse!

Our upcoming app will give you the opportunity to create your unique digital self (your ME!) and explore the Metaverse in online worlds and games. We will also be exploring applications of augmented reality, such as the ability to project your game in KickOff Evolution onto the dining room table so everyone can watch.

Let's keep exploring new technologies together! To learn more about the MetaverseME ecosystem, check out this booklet, and to stay connected to our work (including the upcoming release of our app), follow us on Twitter, Discord, Telegram and Instagram.

Co-author: Yulia Migal (Content & Partnership Manager at MetaverseME)