Inspiration Box adds "Online Cloud Exhibition" product, "Live Viewing Linkage" is waiting for you to build together丨RTE NG-Lab Bi-Weekly Report

foreword

Hello fellow developers, "RTE NG-Lab Bi-Weekly Report" is here as scheduled!

In the past two weeks, we have updated some new real-time interactive scenes and products, and also held the first offline event of the code lab, and experienced the latest 4.0 SDK of Shengwang with you.

When Inspiration Box was just launched, a small partner in the exchange group put forward the demand for "online cloud exhibition development framework", hoping to help enterprises and developers to quickly develop and build online exhibition applications, so as to facilitate developers to quickly develop an online exhibition. On the virtual exhibition software, online virtual exhibitions can be arranged, and the physical exhibitions and physical exhibits can be "moved to the cloud", which can provide an immersive viewing experience and real-time online communication and interaction. This time, we have found the Vertex Gallery virtual gallery and Infinite-Art-Gallery for you. I wonder if they meet your needs.

After experiencing the SoundNet 4.0 SDK, Dawancha submitted an inspiration through the issue in the inspiration box: Live viewing linkage inspiration, support for multi-screen linkage viewing, the audience can watch multi-room content simultaneously, and the audience can watch the content in multiple rooms simultaneously. , automatically open the God's perspective, you can watch the video streams of all players who have started in this game. At present, this inspiration has not yet landed on the product, everyone is welcome to participate, and everyone initiates open source co-construction~

If you submit valuable PR or issue in the Inspiration Box code repository, you can get limited edition badges from the RTE developer community . Last week, two friends won limited edition badges. If you submit enough, you can Get a set!

We will launch RTE NG-Lab bi-weekly reports every two weeks in the future, with recent progress and plans synchronized with you, as well as related information. Welcome more partners to participate~

---

01 Upcoming Events Preview

1. Independent developers open the microphone

🕰 Event Date: September 17th

🏠 Activity form: Online access to Vland cloud live, after successful registration, you will be invited to join the live chat group

📝 Scan the QR code to register:

02 Inspiration treasure box map • New item display

1. Vland cloud scene

Project Category: Virtual Events/Virtual Conference

project address:

https://www.vland.live

Founded in 2021, Vland Cloud Live is a virtual live interactive cloud platform that everyone can design and create. By integrating technologies such as gamification scene generation, real-time audio and video interaction, and virtual social identity, it provides "virtual space as a service" for pan-industry scenarios.

Vland puts the needs of human-to-human interaction in the first place, fully empowering users' imagination and creativity, allowing every enterprise and organization to build a virtual world and restore real offline interaction in the virtual space.

2. ehlo

Project Category: Virtual Events/Virtual Conference

project address:

https://www.ehlo.space/

A virtual workplace that communicates online in real-time, teams seamlessly collaborate, brings members closer together, transforms the way teams write, and powers more connected, productive teams in more than 60 countries.

3. Spot

Project Category: Virtual Events/Virtual Conference

project address:

https://www.spotvirtual.com/

Spot is a team communication software for the office that provides a complete solution for team connection, collaboration and culture building. 3D scenes of virtual offices and events can be provided, creating a fully customized immersive space for offices, meetings, events, and more.

4. Vertex Gallery virtual gallery

Project Category: Virtual Event/Virtual Trade Show

project address:

https://vertexgallery.pavece.com/

Vertex Gallery is a virtual art gallery showcasing 34 new artworks every day, with artwork changing every night at 22:00 UTC. Galleries display not only paintings but also pictures and other types of art such as sculpture. Vertex galleries get their data from the Artic edu API, an excellent API that provides free and public domain data about art.

5. Infinite-Art-Gallery

Project Category: Virtual Event/Virtual Trade Show

project address:

https://github.com/Brazil-0034/Infinite-Art-Gallery

Unlimited galleries generated procedurally in 3D! Each artwork comes from Reddit's r/Art channel, which currently has over 1.8 million artworks. Galleries are rendered entirely in the browser using THREE.JS, and may additionally require a server to host and filter posts from Reddit, Harvard Art Museum, and Met APIs.

7. kalidoface

Project Category: Virtual Events/Metaverse

project address:

https://github.com/yeemachine/kalidokit

Kalidokit is a web-side RGB camera motion capture solution for Mediapipe/Tensorflow.js faces, eyes, poses and hands, compatible with Facemesh, Blazepose, Handpose and Holistic. It takes the predicted 3D landmarks and computes simple Euler rotations and blendshape face values.

8. OpenShot Video Editor

Project Category: More / Video Editor

project address:

https://github.com/OpenShot/openshot-qt

OpenShot Video Editor is an award-winning free and open-source video editor for Linux, Mac, and Windows, dedicated to providing the world with high-quality video editing and animation solutions.

9. Dash.js

Item Category: More/Video Player

project address:

https://github.com/Dash-Industry-Forum/dash.js

dash.js is an initiative of the DASH Industry Forum to establish a production-quality framework for building video and audio players that play MPEG-DASH content from client-side JavaScript libraries using the W3C-defined Media Source Extension API set. The core goal of this project is to build an open-source JavaScript library for playing DASH.

10. VLC

Item Category: More/Video Player

project address:

https://github.com/videolan/vlc

VLC is a free and open source media player and multimedia engine focused on playing everything and running anywhere. VLC can play most multimedia files, discs, streams, devices, and is also capable of converting, encoding, streaming, and manipulating streams into multiple formats.

11. Audiokitsynthone

Item Category: More / iOS Synthesizers

project address:

https://github.com/AudioKit/AudioKitSynthOne

An open source iOS synthesizer app that keeps your synthesizer up to date with all the new features of the base operating system. Synth One is now a universal version for iPhone/iPad. Many of Synth One's features are available as modules in AudioKit, giving you easy access to oscillators, filters, reverbs, effects, and other DSP processing.

12. Zy Player

Item Category: More/Video Player

project address:

https://github.com/cuiocean/ZY-Player

Cross-platform desktop video resource player. Simple and ad-free. Free and high-value. Support Windows, Mac, Linux, support IPTV, satellite TV live broadcast, video source support customization, support import, export; support poster mode and list mode to browse resources; play history, automatically jump to historical progress; favorites support import, export, support Simultaneous chasing drama; support simplified mode, fish and water; one-click search for all resources, support for historical search records; export resource download links; support for third-party player playback; display Douban scores.

13. Gsyvideoplayer

Item Category: More/Video Player

project address:

https://github.com/CarGuo/GSYVideoPlayer

Video players (IJKplayer, ExoPlayer, MediaPlayer), HTTPS, support barrage, plug-in subtitles, support filters, watermarks, gif screenshots, title ads, middle ads, multiple simultaneous playback, support basic drag, sound, brightness adjustment , support playback while caching, support video rotation with rotation (90, 270, etc.), synchronous support for gravity rotation and manual rotation, support list playback, list full-screen animation, video loading speed, list small window supports dragging, animation effects , adjust the ratio, switch multiple resolutions, support switching players, small window preview of progress bar, seamless playback of list switching details page, rtsp, concat, mpeg.

03 Code Lab Workshop

On August 20th, we organized a small offline workshop to experience the power of the 4.0 SDK with developers. Completed and experienced the new multi-player and multi-screen sharing features together.

1) Features and improvements of the 4.0 SDK

Zhang Zhen, a senior architect of Shengwang SDK from Shanghai, introduced the features and performance improvement of the 4.0 SDK to the developers on site through video connection.

The following are some of the new features and improvements

• new features

Supports multiple media streams, making complex scenarios easier to implement

Built-in media player, smaller package size

One-stop solution for cloud market plug-ins

Ultra HD resolution

New AI noise reduction, spatial sound effects and ultra-high sound quality 3 new functions enhance the audio experience.

Support gasket push flow

• Functional improvements

Quickly switch channels

Get the local vocal tones and implement the singing scoring function

• Key experience indicators improved

In terms of latency, the 4.0.0 SDK has been optimized by 60-80ms compared to the previous version, and the experience has been greatly improved, especially in a weak network environment.

In terms of packet loss, the video packet loss boundary has been increased from 70% to 80%, and normal video interaction can still be performed at an 80% packet loss rate.

In terms of freezing rate, the 4.0.0 SDK is about 10% lower than most of the current competing products. Compared with the 3.7 version of the SoundNet SDK, the freeze rate of the screen sharing scene has been reduced by 5%, and the screen sharing experience has been significantly improved even in a weak network environment.

Detailed reference: SoundNet Native RTC SDK 4.0.0 is online

2) Developers experience the development of innovative scenarios

During the event, with the support of evangelists and engineers, the developers realized the scene of multi-person and multi-screen sharing step by step. In response to this scenario, we have released a detailed tutorial in the community. Those who were unable to come to the scene can also experience this scenario by referring to the tutorial. The address is as follows: rtcdeveloper.agora.io/t/topic/24601

After some development and debugging, the on-site friends have successfully realized the scene of multi-person and multi-screen sharing. Everyone entered the same room together, and shared their mobile phone screens while making audio and video calls.

After hands-on practice, the developers on the scene believed that the API design of the current 4.0 SDK is very clear and easy to use. Some developers said that such a "multi-player, multi-screen sharing" function can be applied to some game live broadcast scenarios, allowing the audience to be in a "God's perspective" and see the game interface of multiple Up masters at the same time. Afterwards, the developers on the scene also imagined the application scenarios of this function and expressed their opinions. here is the quote

About RTE NG-Lab Bi-Weekly Report

RTE NG-Lab Bi-Weekly Report is initiated by RTE NG-Lab program. Every two weeks, we will synchronize with you the latest news of three projects: Idea Box, Code Lab, and NGLab Incubator. progress and plans, and related information.