Shanghai Jiaotong University and Taobao set up a media computing laboratory: to promote the development of key technologies such as video super-resolution

On July 27, the School of Electronic Information and Electrical Engineering of Shanghai Jiao Tong University and Alibaba Group Taobao Technology announced a strategic cooperation to jointly establish the School of Electronic Information and Electrical Engineering of Shanghai Jiao Tong University-Taobao (China) Software Co., Ltd. Media Computing Joint Laboratory (hereinafter referred to as the "Joint Laboratory"). The joint laboratory is to better explore the ultimate experience in the future media era, and promote the development of the industry through innovation and industrial integration.

It is reported that the two parties will rely on Shanghai Jiaotong University's profound academic accumulation in the field of digital media and Alibaba's leading market experience in the e-commerce field of Taobao to jointly explore the relationship between media computing and content business in the future, promote the development of key technologies, and create services that serve consumers well. user's content experience.

Signing guests: Zhang Wenjun, Yu Gang Signing guests: Guo Xiaojun, Wu Guilin

The two parties will carry out research in the core technical fields of content e-commerce, including video coding, video processing, quality evaluation, video understanding, immersive media experience and other fields, and fully exploit the effects of intelligent algorithms to meet the needs of users at low cost and high image quality anytime, anywhere. Audio and video are the main carriers and the e-commerce content consumption and use needs are constantly evolving, so as to promote the reform of the future media era.

90% of human information is obtained through visual and auditory. The global digital media industry is developing rapidly, and digital media content is showing an exponential growth trend: images, audio, video and virtual scenes are becoming the main content of people's online communication. In recent years, Taobao has continued to make efforts in contentization. Taobao live broadcasts while watching and shopping, and content community shopping that integrates grass growing and consumption have become a new form of consumer entertainment. Taobao Live supports tens of millions of live streaming peaks to be online at the same time, while Taobao short videos based on shopping, guess what you like, product details, etc. require an average of tens of millions of short video transcoding tasks per day. The media content behind the scene is rich and varied, and the scale effect brought by it provides sufficient soil for the exploration and implementation of related advanced technologies. While Taobao continues to develop its content business, it also invests more in basic technologies. It has a series of related layouts in video encoding, video enhancement, video transmission, and video understanding, and has achieved certain industry and academic influence. He has won many championships in the international video coding competition MSU, and won many championships in the authoritative video enhancement competition CVPR NTIRE (New Trends in Image Restoration and Enhancement workshop and challenges on image and video processing). Based on the global real-time transmission network GRTN Taobao Live provides low-latency guarantee, and related technologies have been approved by international standards. Innovative technologies in the multimedia field have been published in top academic journals and conferences including IEEE T-PAMI, IEEE T-IP, IEEE T-CSVT, CVPR, ICCV, etc. A series of academic papers.

The media computing joint laboratory will conduct more media computing research from the dimension of "experience". Basic technical capabilities are the most important part of improving the experience. The development of new technologies will promote the development of new media content and bring new feelings in audio and video experience and interaction methods.

Professor Zhang Wenjun, director of the Future Media Network Collaborative Innovation Center of Shanghai Jiao Tong University, said: The Shanghai Jiaotong-Taobao Media Computing Joint Laboratory is committed to the production, processing, encoding, transmission and evaluation of audio and video content, running through the entire link of typical media services, and Taobao Online Live broadcast and big video business are very compatible. It is believed that through this in-depth cooperation, our research team can be well guided to focus on practical problems, so that cutting-edge research results in the academic world can be quickly implemented and applied, thereby bringing users a better consumption experience.

Professor Zhang Wenjun, Director of the Future Media Network Collaborative Innovation Center, Shanghai Jiao Tong University

Yu Gang, director of the joint laboratory and head of Alibaba Group's Taobao technology, said: In the future commercial retail scene, what users see is what they get, the immersive experience will be further enhanced, the video content will be more vivid, the color of the video will be more vivid, and the video clarity will be enhanced. be further improved. The Media Computing Joint Laboratory will effectively promote and strengthen relevant key technologies in the entire process from production to consumption on the device side, cloud and video.

Yu Gang, head of Alibaba Group Taobao Technology

According to the "New Generation Artificial Intelligence Development Plan" issued by the State Council, visual media will be one of the cores of business intelligence. The future media network is not only a topic of concern for scientists, but also a topic of common concern for the consumer electronics industry management departments and enterprises. This time, Alibaba Taobao Technology and the School of Electronic Information and Electrical Engineering of Shanghai Jiaotong University established a joint media computing laboratory, which will combine the advantages of both parties in new retail scenarios and multimedia technology to promote the innovation and development of media computing technology and help artificial intelligence. The landing of the scene.