Virtual office, virtual exhibition, virtual idol, what else can RTE+XR do?

On June 10, 2021, HTC VIVE will hold a new product experience meeting and developer customer conference with the theme of "Integration·Universal" in Beijing. Nearly 300 XR industry elites gathered together to witness the first public appearance of the HTC VIVE all-in-one VR all-in-one VIVE FOCUS 3 The latest developments and outstanding achievements of industry technology. As one of the first companies to join the HTC VIVE ISV partner program, Agora was invited to attend the conference and conducted in-depth sharing and discussion on topics such as ISV partner program, VR/XR, and real-time interaction.

HTC VIVE ISV partner Panel

RTE+XR, innovation scenarios without boundaries

With the development of technology, XR technologies such as VR/AR/MR have been implemented in many industries. In the past two years, due to the impact of the epidemic, home office work, learning, and entertainment have become a global trend. Many real-time interactive scenes represented by online classrooms, video conferences, telemedicine, remote interviews, e-commerce live broadcasts, etc. have exploded, and real-time interactions have occurred. (RTE) has become a rigid demand, and it also provides a wealth of application scenarios for the development of XR technology. Hou Yunyi, head of IoT products at Shengwang, pointed out that the combination of real-time interaction and XR is the trend of industry development, and it is also the best practice for building the metaverse metaverse that has been in great fire in the near future. Whether for individual users or enterprise-level users, the XR scenario emphasizes that users can achieve a deep immersive experience and real-time interconnection and interaction in the virtual world, while real-time audio and video technology can break the boundary between virtual and reality and provide users with A low-latency, stable and smooth real-time interactive experience in the virtual world is escorted.

person in charge of IoT products, Soundnet 1619e3e63456df

Hou Yunyi believes that the cooperation with HTC VIVE can bring richer, innovative and interesting scenarios for real-time interaction related practices. But more importantly, it can help related XR developers seamlessly access the real-time audio and video technology of the sound network, explore more innovations in scenarios and applications, and accelerate the implementation of related application scenarios. From the perspective of the consumer market, RTE+XR can inspire developers to create richer content and bring users a more immersive experience. At the same time, Guangzhou Creative Digital Technology Co., Ltd., which joined the ISV partner program to provide virtual idol business services, is also a customer of Shengwang. Through the real-time audio and video technology of Shengwang, the creative two-dimensional virtual idol breaks the dimension wall and interacts with users in real time, bringing users a wonderful imagination space and a unique experience between virtual and reality. From the perspective of the enterprise market, RTE+XR can bring a more efficient experience to remote collaboration scenarios such as remote surveying, telemedicine, and smart manufacturing, saving companies time and costs, and helping them achieve digitalization and intelligence. At present, Shengwang has many successful cooperation cases. For example, Virbela, who builds an immersive 3D world for remote work, online learning and virtual activities, is also one of Shengwang's customers. In the virtual world constructed by Virbela, each user can create a unique virtual identity. Through the real-time audio and video technology of the sound network, collaborative office, speech, teaching, etc. can be realized in the virtual scene; users in "spare time" You can also hold a football game or beach party outdoors, and even move offline exhibitions online, which is very Metaverse.

Picture from Virbela's official website

Talking about the development trend of real-time interaction and XR in the next 5-10 years, Hou Yunyi said that with the continuous improvement of related hardware performance, the user's interactive experience will inevitably be enhanced. With the blessing of real-time interaction, multi-modal, cross-terminal, humanized perception, and interactive experience will bring a qualitative leap, and Metaverse is no longer an unattainable dream. In addition, with the acceleration of the global online trend, mobile applications are undergoing earth-shaking changes. Real-time audio and video technologies that are not limited by distance, space and time will become the basis for building many application scenarios, and real-time interaction Just like humans need air and water, they will become the daily needs of the general public, everywhere.

Shengwang real-time audio and video technology creates an immersive experience with low latency, high stability, and high smoothness

In VR/AR/MR application scenarios, users often encounter cross-regional and cross-border collaboration, so the network situation will be more complicated. The Agora software-defined global real-time network SD-RTN™ covers 200+ countries and regions around the world. The high-quality transmission rate of the global end-to-end network exceeds 99%. Users in any country/region provide high-speed network services.

In scenarios such as remote collaboration and remote guidance, Agora's solution can provide up to 1080P 60fps ultra-clear video quality, so that both parties can clearly see what is being coordinated and give timely feedback. During the call, the world's leading voice engines, Agora SOLO™ and NOVA™, take into account high fidelity, high performance and smooth weak network experience, which can bring users a high-quality interactive experience.

Virtual scenes have high requirements for the "spatial sense" of audio. For example, in competitive games or virtual office scenes, you need to perceive the distance and orientation of other users through the sound of footsteps, and spatial sound effects can make users more immersive. The sense of immersion in the environment. Agora’s solution supports 360° surround sound, and the sound has a perfect sense of orientation, distance, and space. It can provide users with functions such as "listening position recognition" and "listening sound recognition distance" in specific scenarios. Improve the immersive experience that the content brings to users.

At present, the world's leading information technology, consulting and business process service company Wipro, AR product and service provider HiLeia communication platform under Liangfengtai, and AR+AI enterprise service provider Liangliangye released AR glasses GLXSS ME (Multi-Edition ), Ruiyue Nibiru's remote assistance products all adopt the real-time audio and video solutions provided by Agora, which are widely used in collaborative office, intelligent manufacturing, remote medical treatment, remote power maintenance and many other scenarios.