Technologies

A Mixed Reality System Enabling Immersive Panoramic Communication Between Remote Users


Abstract/Technology Overview

Advances in telecommunication technologies have made video conferencing an integral part of our daily lives. Video conferencing is widely used for communication across remote locations in a number of industries, which allows users to exchange information and share experiences with each other, despite the distance.

The sharing of panoramic videos, facilitated by 360° cameras has allowed for video conferencing with greater immersion, and social media platforms are providing live broadcasting features. Currently, panoramic videos are restricted to broadcasting the host's view only, limiting the remote user's understanding of the host's real environment.

Improving the interactivity and providing a more immersive visual experience for users could lead to greater utility and wider acceptance of panoramic video conferencing.


Technology Features, Specifications and Advantages

Shared Sphere is a Mixed Reality panoramic collaboration platform. It combines an Augmented Reality experience for the host user with a Virtual Reality (VR) experience for the guest user. Importantly, Shared Sphere allows view independence, with guest users able to scope the host user’s surroundings independent of the host’s orientation.

Shared Sphere also incorporates view awareness cues that allow the users to see which direction the other person is facing. Finally, Shared Sphere uses motion sensing in the VR environment to create a 3D virtual image of the guest user’s hand gestures for the host. In this way the remote user can use natural hand gestures to communicate with the host user and show points of interest.


Potential Applications

This Mixed Reality system enables immersive panoramic communication between remote users to solve technical problems that could not be solved by voice or video communication alone.

The technology can be used for remote assistance in fields such as mining, engineering, teaching and telehealth.

It is ideal for applications where the remote user needs to have good awareness of the local host’s environment, and to help them on real world tasks.


Customer Benefit

Users of this technology benefits from the following:

  • Remote problem solving
  • Reduced FIFO operating expense
  • Guest users can view the host’s location independent of host’s orientation
  • Users can easily understand where other users are looking
  • Non-verbal communication using hand gestures

OVERVIEW
Contact Person

Viraj Perera

Organisation

UniSA Ventures Pty Ltd

Technology Category
  • Augmented Reality, Virtual Reality & Computer-Simulated Environments
Technology Status
  • Available for Licensing
Technology Readiness Level
  • TRL 6
Keywords

mixed reality, mixed reality communication, augemented reality, virtual reality, telecommunication, 360°, immersive, remote, communications, motion sensing, live, broadcast, edutech