HMS Core joins hands with Xiamen University to build AR augmented reality technology

The HMS Core AR Engine team teamed up with the School of Information of Xiamen University to communicate face-to-face with professional students about industry development and cutting-edge achievements. The two parties will jointly compile industry knowledge textbooks, guide students to develop AR game practice, and cultivate replicable teaching models and resources for future AR and VR talent training.

I come from the School of Information, Xiamen University, and my own research direction is closely related to AR and VR, which is to provide the next generation of new interactive methods for augmented reality and virtual reality. I have been teaching the course of augmented reality technology application in our school since 2018. This course is now open to students who are senior year undergraduates in the software engineering department. Now there are more than 200 students taking this course in total.

Q1: Please introduce the teaching characteristics of Xiamen University and the implementation of cooperation with HMS Core?

A1: Our teaching characteristics can be summed up as teaching and research two-wheel drive, and the demand for integration of production and education . First of all, let’s talk about two-wheel drive for teaching and research. My own research field is this field, so I will pay special attention to it. On the one hand brings the cutting-edge research results into the classroom to tell you about the latest papers published in academia in the past two years, so as to help you look forward to some black technologies in the future. On the other hand, I will also take the initiative to invite some outstanding undergraduates to enter the laboratory for more in-depth training by participating in scientific research projects. So far, we have achieved some good results and cultivated some good and outstanding students. Students, such as our undergraduate students as the first author, have published conference papers in the top conference ISMAR in the field of augmented reality and CHI, the top conference in the field of human-computer interaction. Many of the students I mentored went to famous domestic and international schools for graduate studies, and of course some went to leading companies in the industry. On the other hand, is about the integration of production and education, so we must focus on the cooperation with our HMS Core. We first compiled a textbook with HMS Core and Beihang University. The name of this textbook is Augmented Reality Technology and Application. This textbook was also selected as the first batch of recommended textbooks by the Software Engineering Teaching Steering Committee of Higher Education Institutions of the Ministry of Education. Then we also had many in-depth exchanges with the HMS Core team, and discussed how to provide students with a better learning experience in the augmented reality course. We invited the small partners of the HMS Core augmented reality development team to make a special trip from Shanghai to Xiamen for Let us introduce HMS Core AR Engine , then through this in-depth communication with industry experts, we can let students know more about industry needs and development trends, and it is easier to stimulate students' enthusiasm for learning.

Q2: During the teaching process, what innovative experience "empowerment" and innovative stories have inspired students?

A2: Our classmates have done a lot of interesting projects in the Augmented Reality course, for example, there are some very interesting interactive games, moving the Super Mario from our childhood to the real scene and the three-dimensional space. , to be an augmented reality version of Super Mario, as well as such online museums for young children, as well as applications for professional knowledge learning such as fire protection knowledge, popular science, chemical biology, etc., and meet the landing needs in actual scenarios It improves everyone's learning efficiency and makes augmented reality more interesting and interactive as a game. In fact, it is also the starting point for me to set up an augmented reality course, hoping that augmented reality can benefit the majority of users.

Q3: What is your next development plan in AR? Are you considering further in-depth cooperation with HMS Core?

A3: First of all, the next work plan includes both scientific research and teaching. In terms of scientific research, my own research work will definitely be carried out in-depth around the human-computer interaction in the field of VR and AR. At the same time, in terms of teaching, I will continue to maintain in-depth cooperation with HMS Core. In terms of construction, we have reached an all-round cooperation with HMS Core. The goal of our collaboration is to build a replicable augmented reality curriculum and to extend our curriculum model and resources to undergraduate and vocational colleges across the country. In 2019, the Ministry of Education officially announced that the application of virtual reality technology can be used as an independent admissions major, which means that virtual reality will be able to have undergraduate students in the future. Before, other partners in other industries actually did not have many students. If the virtual reality major emerges as a major, there will be a large number of undergraduate training needs, so there is an urgent need for rich teaching resources, so we will carry out in-depth cooperation with HMS Core, including HMS Core AR Engine , the engine development department and the HMS Core Developer Alliance work together. On the one hand, it is to build more abundant teaching resources, and on the other hand, it is to copy the teaching resources of our cooperative model to other universities, so that more students can come into contact with AR Engine, become familiar with AR Engine, and eventually become AR Engine and HMS. Core developer.

Q4: From your professional research, what do you think of the current hot "metaverse"?

A4: The metaverse can be said to be the hottest word on the Internet this year, but the development law of emerging technology curves, I think the metaverse should still be in a rising bubble period at this stage. If the metaverse can be implemented, I think it should still be implemented mainly by augmented reality at this stage. Augmented reality should become a more practical technology with real commercial value, then this technology will be accompanied by self-enhancement on the one hand. In reality, some core technologies, such as 3D tracking scanning, including scene understanding, are constantly improving. On the other hand, the entire industry is constantly exploring the business model and the continuous input of such talents. On the one hand, I think that if we finally work together, we should be able to help augmented reality realize the real industrialization. I think that in the future, all such smart applications for our basic necessities of life will appear more in the form of augmented reality, rather than in the interface of the sliding menu that everyone has now. This It should be a relatively advanced development of augmented reality. I think augmented reality should originate from the beginning of the metaverse.

for more details >>

Visit Huawei Developer Alliance official website
Get the development guidance document
Huawei Mobile Services open source warehouse address: GitHub , Gitee

Follow us to know the latest technical information of HMS Core for the first time~