The countdown to the Winter Olympics, how should audio and video practitioners make the final upgrade?

With 2022 approaching, one of the things we are most excited about in the new year is the Winter Olympics. Recently, the Beijing Municipal Bureau of Radio and Television issued the "Opinions on Promoting the High-Quality Development of Radio and Television and Online Audio-visual", which proposed to promote 5G+8K+ interactive video, open an 8K experimental channel, and promote the "Winter Olympics Ultra HD 8K Digital Broadcasting Technology and System". Project construction.

In the past ten years, we have known that the upgrade of the network means that the video definition upgrade has obtained the technical foundation. 3G brings the explosion of long videos, 4G brings the rise of live broadcast and short videos, and 5G is bound to higher-definition videos, especially the 5G+8K model, which has ignited the enthusiasm of enterprises and users.

Of course, the high-definition video brings a high-quality experience, but it is also an upgrade of the technical architecture. If there is no stable technical base, high-definition will bring not only sweetness, but also troubles such as lag, delay, and packet loss. The Winter Olympics are approaching, how can we upgrade our audio and video capabilities? Tencent cloud audio and video solutions bring new ideas.

"Full" call, one integrated call for all SDK capabilities

From June 6, 2019, the Ministry of Industry and Information Technology officially issued 5G commercial licenses to China Telecom, China Mobile, China Unicom, and China Radio and Television. China has officially entered the first year of 5G commercial use. Since then, the development and implementation of 5G is obvious to all. The 5G+8K audio and video solution has also been advancing in an orderly manner. When it comes to the Winter Olympics, in order to appreciate the heroic appearance of the Olympic athletes more closely, the video upgrade has become everyone's wish.

However, if you know the development of audio and video communication related applications, then you will understand how complicated the process will be. The improvement of video definition means a series of changes in the terminal, codec, network node, CDN, cloud and so on. After entering the era of the Internet of Everything, the channels for users to watch audio and video have also changed, from the single PC terminal in the past to multi-terminal devices. In the development of multi-terminal audio and video communication applications, in order to achieve different product capabilities, it is often necessary to integrate the SDKs of multiple suppliers, which not only greatly increases the developer's development and joint debugging workload, but also cluttered and unified between different functional modules. API call rules, which often increase the developer's joint debugging workload and increase the difficulty of the work.

Faced with these problems, Tencent Cloud integrated its own audio and video technology and audio and video communication terminal capabilities, and launched the terminal brand product Tencent Cloud Cube Audio and Video Terminal Engine to help users obtain the ability to call "full" terminals by integrating the SDK once. development experience.

The ability to integrate full-end calls at one time is destined to have rich application scenarios. Tencent Cloud's solutions have been applied in many industries such as medical care, e-commerce, customer service, pan-entertainment, finance, industrial fields, smart industries, office collaboration, and online education. Correspondingly, in different scenarios, different SDK support is required. Tencent Cloud Vision Cube integrates various SDKs such as video capture/streaming, mobile live broadcast, interactive live broadcast, short video editing, video calling, instant messaging, and beauty animation. This means that whether it is native to IOS or Android, whether it is the web side, applet, Flutter, Electron, or ReactNative, etc., cross-platform and multi-terminal access will no longer need to reinvent the wheel. Developers can really devote themselves to business scenarios, select the required functional modules according to business needs, freely combine and use the SDK version and download them to achieve free business development.

At the same time, VisionCube can also provide full-link multi-dimensional real-time data query and monitoring of SDK terminals, which is convenient for users to perform quality monitoring and visual management of business scenarios such as terminal streaming, live on-demand viewing, etc. It also provides account APPID, platform, application package name, etc. Dimensional query provides customers with a rich perspective for reviewing the operation effect of the market; and supports one License url to unlock the authorization capability of all terminals, which is convenient for management.

Such powerful capabilities naturally require more powerful underlying support, and Tencent Cloud Vision Cube still insists on reducing the integration difficulty and usage threshold for developers. In recent years, the serverless technology has been mature and implemented, and VisionConvenience has been combined with it to provide developers with a cloud-native low-code integration environment and multiple aPaaS solutions, including Demo source code and API examples in various scenarios. For reference; cross-platform front-end plug-ins such as Flutter, Electron, and applet provide support for cross-terminal developers.

"true" essence of sense, codec optimization makes the experience more immersive

8K is an experience upgrade as well as a technology upgrade. A more realistic picture allows users to access the world on the other side of the screen through the network. To obtain high-definition video, it is not efficient to simply rely on the network or the terminal. There are many ways to solve this problem, such as further optimization of codecs, or the use of artificial intelligence to achieve high-definition video.

In order to obtain a more realistic experience, Tencent Cloud Audio and Video launched the Tencent Bright Eyes Extreme High-definition product in 2018, which helps users obtain a more high-definition and realistic view through a lower-bit rate and higher-definition streaming media service. Lower bit rates mean more efficient video transmission and lower video transmission and storage costs. In the past, the lack of encoding and decoding capabilities often required more factors to be taken into account during transmission, while Tencent Cloud's ultra-fast high-definition video processing service will classify and identify results in real time according to video scenes.

Combining the dimensions of video source rate, frame rate, resolution, texture, motion variation, machine load, and ROI detection, Tencent Bright Eyes can intelligently select the optimal encoding parameters. The intelligent dynamic coding technology can also be combined with intelligent scene recognition, dynamic coding matching, and image quality restoration enhancement, and the high-definition service uses intelligent bit rate control to comprehensively improve the subjective viewing experience. In different scenarios, users have different requirements for video quality. Therefore, Tencent Mingmou will also combine video source image texture and real-time motion detection results to sharpen, soft blur, de-interlace, deblock, reduce noise, and color the video. Pre-processing such as order compensation and frame reduction.

The functions of Tencent Bright Eyes Extreme HD products mainly include extreme high-definition transcoding, image quality regeneration and smart barrage. Ultra-fast high-definition transcoding means that it can further improve the efficiency of streaming media services. Through the audio and video encoding, intelligent scene recognition, dynamic encoding, CTU/line/frame three-level code rate precision control model accumulated by Tencent Video Cloud for many years, live broadcast, On-demand and other industries can achieve lower bit rates.

The image quality regeneration brings unprecedented enhancement of the picture. Through video pre-processing and encoding algorithm optimization, including texture and color enhancement, super resolution, double frame, denoising, decompression effects, etc., it can effectively eliminate blur, Noise, jitter, and frustration, etc., enhance details, remove blur, improve color quality, and solve problems such as low resolution and frame rate stuttering and unclearness, and improve picture clarity.

The intelligent bullet screen has a wider application. Through the front, target and face detection technology, the position coordinates of the ROI area are identified in real time, so that the bullet screen does not block the viewing, and the interactive experience of video users is improved to a higher level.

"Stabilize" the overall situation, and the triple play supports the audio and video feast

Viewcube All in one SDK is a "full" integration of audio, video and communication terminal capabilities; Tencent Mingmu presents users with low bit rate, higher-definition "real" real picture quality; and TRTC real-time RT-ONE™, which integrates three networks, such as audio and video communication network, IM instant messaging network, and CDN streaming media distribution network, is a cornerstone for "stabilizing" the overall situation.

What does triple play mean? At present, Tencent Cloud is the only cloud computing service provider in the industry that can realize the integration of three networks. After Tencent Cloud Audio and Video directly connects the three major networks of TRTC, IM, and CDN, the underlying technology can be reused and the technical capabilities Mutual integration and mutual empowerment, the upper-layer application solutions and product packaging can be provided to customers with a one-stop SDK and API, so as to meet the real needs in various changeable real-time interactive scenarios.

The three-in-one RT-ONE™ can not only meet the customer's three-network parallel requirements, but also realize the technical superposition of cloud-edge-end infrastructure through three networks, reducing access thresholds, improving network quality, and reducing usage. costs, etc. At present, RT-ONE™ has opened 27 geographic regions around the world, operates 68 availability zones, has more than 2,800 CDN acceleration nodes, and has a bandwidth reserve of over 200Tbps, and these numbers are still growing. When massive infrastructures cover the world, users can obtain high connectivity, high reliability, and high security global network connection channels, and comprehensive and stable global audio and video services.

After RT-ONE™ network three networks are integrated, its capabilities in mass scheduling, nearby access, and transmission optimization have also been improved, and it can provide customers with more accurate and intelligent network scheduling services and lower-latency transmission. ability. Relying on Tencent's self-developed routing algorithm and scheduling system, RT-ONE™ can adjust the scheduling strategy for users in real time, select the optimal route, access the nearest access, and reduce the delay, which enables users to innovate at a high speed based on this, and obtain a wider range of development and competition.

The integration of the three networks in one integrates and empowers each other in terms of capabilities, shares and reuses in technology, and is a comprehensive unification in terms of experience. Especially through Tencent Cloud Cube of All in one SDK, customers can enjoy the product capabilities of three networks at the same time with only one access, meeting their needs for audio and video communication services in most application scenarios. At the same time, Tencent Cloud Audio and Video has coordinated the console. Users can manage IM under one console, and use the same account to manage, log in, and authenticate IM, live broadcast, and TRTC users in a unified manner. The monitoring & logging system can also view different capacity usage, monitor user status and view user logs in one place. Such integration greatly reduces the access and use threshold for customers, allowing customers to enjoy "three-in-one" services with higher quality and lower cost.

At present, Tencent Cloud Audio and Video has built a cloud-based multimedia engine that integrates content aggregation, video production and processing, content copyright and distribution, and provides cloud-based creation capabilities for the presentation of rich content on the Internet. With technological innovations in codec, ultra-fast HD, TRAE audio engine, etc., it continues to support 90% of domestic audio and video customers to achieve cloud innovation.

The three characteristics of "full stability" have become the label of Tencent Cloud Audio and Video, which can support various audio and video business innovations on the C-end and B-end. Such performance also makes Tencent Cloud video cloud solutions continue to lead the Chinese market. Recently, the "China Video Cloud Market Tracker (2021 First Half)" report released by the International Data Corporation (IDC) shows that Tencent Cloud audio and video solutions in the video cloud The solution market ranks first. At the same time, in the key track of RTC (real-time communication), the growth rate of Tencent Cloud audio and video ranks NO.1 among leading manufacturers. More than that, Tencent Cloud Audio & Video has been deeply engaged in the fields of audio and video encoding and decoding, audio and video processing and other technical fields. It has won the "China Patent Gold Award", the highest intellectual property award in China, and has won the championship in the MSU video encoding and decoding competition for many times.

When the era of 5G+8K ultra-high-definition video arrives, it seems that there is only one screen between us and the Olympic athletes, but behind the screen, there is the full support of countless developers and audio and video technology services. Tencent Cloud Audio and Video has continued to explore breakthroughs in basic networks, product capabilities, solutions, and core technologies, providing industry users and developers with comprehensive, easy-to-use, and stable audio and video communication solutions.