" NetEase's First Audio and Video Technology Conference came to an end . many audio and video fields such as NetEase Smart Enterprise, NetEase Games, NetEase Cloud Music, NetEase Hangzhou Research Institute, etc. gathered together, combined with their own years of research and experience accumulation, and discussed with the audience 1613092a2ecda0 on cutting-edge audio and video technology innovation , Sharing the practical results of audio and video applications has brought many new thoughts and insights to the development of the industry.

As we all know, vision is the main source of information for the perception of all things, and hearing makes silent information further and "remarkable." In the era of mobile Internet, online learning, work, and entertainment with "good sound and color" are very popular, and new scenarios such as interactive live broadcasting, video conferencing, and remote recruitment have emerged one after another. And behind it is the strong support of audio and video technology, subtly incorporating online scenes from all walks of life.

Based on this background, NetEase's first audio and video technology conference came into being with the "opening of the horizon". closely revolves around "color" and "sound". This conference set up two thematic sub-sessions , "Broad Vision: Video Technology Innovation Vision" and "Sound on the Scene: Audio Technology Immersive Experience", which lasted for two days. Dedicated a hearty technological feast for all the guests and online audiences present.

NetEase Audio and Video Technology Conference

exhibition technology, promote communication

First of all, Dr. Chen Gong, the chief producer of this conference and the VP of NetEase Smart Enterprise Technology, described the opportunity and purpose of this conference. Chen Gong said that in recent years, audio and video technology has developed rapidly and commercialization has accelerated. NetEase continues to make technological innovations and breakthroughs in this field. At 1613092a2ecedb, the NetEase TM599 Audio and Video Technology Subcommittee was established The sub-committee will focus on displaying the accumulation of technical capabilities of NetEase Group in various subdivisions of audio and video, and at the same time promote exchanges and cooperation within the industry.


Chen Gong, Technical VP of NetEase Smart Enterprise

horizons

Video Technology Innovation Vision

At the “Broad Eyes: Video Technology Innovation Horizons” special session, Han Qingrui, the topic producer and senior technical expert of NetEase Audio and Video Laboratory, introduced the main content of the topic, combining with NetEase Cloud Music, NetEase Shield, NetEase Yunxin, and NetEase Exchange. Entertainment experience in video technology, this session will focus on video processing, video in-depth verification, content security, video enhancement and computer vision technology, AI dance synthesis and other topics to carry out in-depth sharing.


Han Qingrui, Senior Technical Expert, NetEase Audio and Video Laboratory

Netease Cloud Music senior video algorithm engineer Sui Shichen cut into the current hot short video field, from a technical perspective deeply analyzed the functions and design ideas of various video creation tools in cloud music , and believes that technology is ultimately only to assist creators to express their value. Tools instead of directly replacing the creator’s ideas.


Sui Shichen, Senior Video Algorithm Engineer, NetEase Cloud Music

Netease easy to shield senior engineer Hu Yifeng image algorithm introduced "double-edged sword" effect of the application of AI in each scene , and is the most prominent face fake hidden, for example, share Netease easy to shield from the dimension of the algorithms and applications Solution strategies and significant results in video in-depth forgery detection.


Hu Yifeng, Senior Image Algorithm Engineer, NetEase Easy Shield

Zhou Chenhui, a senior video algorithm engineer at NetEase Yunxin, sorted out the causes of a series of problems affecting video clarity, color, and quality, and shared solutions based on AI video processing algorithms for each problem. 1613092a2ed0da Netease Enhancement is promising in scenarios such as real-time audio and video interaction, low-latency live broadcast, and on-demand.

Zhou Chenhui, Senior Video Algorithm Engineer, NetEase Yunxin

Tan Zhipeng, a senior AI research engineer at NetEase Interactive Entertainment, focused on the common dance animations in the game and film industry, and explained the difficult process behind the generation of dance animations, and uses AI music dance synthesis algorithm technology to quickly and efficiently produce and generate High-quality dance animation.


Tan Zhipeng, Senior AI Research Engineer, NetEase Interactive Entertainment

Acoustic Immersive

Audio technology immersive experience

The "Sound on the Scene: Audio Technology Immersive Experience" special session is also full of technical dry goods. introduced that the new crown pneumonia epidemic has greatly promoted the development of online application scenarios. 1613092a2ed1c9 real-time audio and video calls are very "just needed" technical points in many applications, and the sound quality is also audio and video. One of the most core parameters in the call system.


Liu Huaping, Head of NetEase Cloud Music Audio and Video Lab

audio algorithm expert Hao Yiya first reviewed the background and main application scenarios of RTC real-time communication, and introduced the architecture and effects of 1613092a2ed22d NetEase Cloud letter AI noise reduction technology , as well as the echo cancellation algorithm. Netease Yunxin has also made a lot of efforts in the construction of the audio standardization evaluation system, such as: setting up an audio laboratory, establishing a noise reduction algorithm evaluation system, etc., and expects to continue to promote the development of the domestic RTC audio field. Finally, Netease Yunxin shared other audio capabilities such as 3D sound effects, AEC, and the academic research results of the audio laboratory.


NetEase Yunxin Audio Algorithm Expert Hao Yiya

, head of NetEase Cloud Music Audio and Video Algorithm, said that 1613092a2ed29a immersive audio is very important for users to get a real and immersive experience . Focusing on this theme, Zhao Xiangyu enumerated the main factors that affect the immersion of the sound field, as well as the technical solutions to deal with it. Finally, the audio effects of the technical solution were displayed, which made all the live and online audiences "immersed" together.


Zhao Xiangyu, Head of NetEase Cloud Music Audio and Video Algorithm

Voice algorithm experts from NetEase Hangzhou Research Institute Liu Dong, Yang Zhen, Li Xiang focused on the development and application of AI technology for many years in related fields voice, and through their respective roots of audio understand the system, the acoustic model speech recognition, speech recognition The online reasoning system describes the technical challenges, solutions and practical cases faced in the research and development process in three dimensions.



Liu Dong, Yang Zhen, Li Xiang, Voice Algorithm Experts of NetEase Hangzhou Research Institute

Fu Mingming, an audio design expert for NetEase's game Thunderfire, shared the theme of the development and application of AI music. Fu Mingming proposed that AI music is an intersection of algorithms and art. The essence is to analyze and learn music data through various algorithms to form a style model with relatively certain aesthetics, and perform it in the selected style model based on user input. Content generation.


Netease game Thunder Fire audio design expert Fu Mingming

conference has ended

Technology sharing never stops

NetEase's first audio and video technology conference has come to a successful conclusion. At the conference, wonderful speeches from experts in various fields of audio and video, provided practical technical solutions for industry practice and application, and also provided new thinking and insights for industry development, guiding the future technical direction and development trend .

conference has ended, and technology sharing has never stopped . The insights of the lecturers attracted more than 54,000 views and were widely recognized by the audience. In order to facilitate the audience to revisit the review and promote technical exchange and sharing, speech videos will be successively published on Practitioner Salon, Cloud Chamber of Commerce, MCtalk, Bilibili and other platforms. Related content articles will also be successively published on the "NetEase Smart Enterprise Technology+" WeChat public account. Please pay attention.

Scan and follow the official account to get the latest information right away~



网易数智
619 声望140 粉丝

欢迎关注网易云信 GitHub: