Conference Review丨How to practice game user experience optimization, see what the big guys say (with PPT download)

Lead
On November 3, 2021 Tencent Digital Ecology Conference was held in Wuhan. During this conference [Game Session], Tencent WeTest Product Director Zhou Kejing gave a keynote speech on "Practice and Application of Game User Experience in Performance Optimization", sharing how players are paying more attention to game experience and how Tencent WeTest can help games Manufacturers deal with quality issues in the process of game development and operation.

Game experience has become an important factor affecting the reputation of game users
Zhou Kejing said that the development of the mobile Internet has nurtured a mature growth environment for mobile games. The current gameplay is becoming more and more diverse. Open world, massive details, high-definition graphics, etc. are all important game elements pursued by players, thus improving the rendering performance and quality of the game client. Put forward higher requirements. At the same time, players are less and less tolerant of issues such as freezes, crashes, and crashes that occur during the game.

Zhou Kejing, Product Director of Tencent WeTest, released the "Mobile Game Quality Protection Plan"

In terms of the improvement and guarantee of the game experience, the game project team often conducts several rounds of testing from the early stage of development, but is limited by limited test equipment and test cases, and it is difficult to cover real player game scenarios for simulation. Zhou Kejing said that according to WeTest's practical project experience statistics, about 20% of performance problems cannot be found in the R&D and testing phase, and will eventually be exposed to the external network environment. Sometimes, these seemingly minor problems can cause immeasurable losses to game products.

Faced with these problems, game manufacturers often choose traditional methods such as manual collection of multi-channel player feedback and player screen recording. But on the one hand, players are not professional game practitioners, and the feedback they give is often subjective and perceptual descriptions, which sometimes do not reflect the actual operation of the client. Secondly, player feedback is often lagging, and even if the problem is successfully reproduced, it is difficult to assess the scope of the impact that has been caused. At the same time, with the development of new gameplay and technology, the game development team also needs to evaluate and verify the performance of the new gameplay technology on the player's device in advance. Nowadays, the diversified and complicated environment puts forward higher requirements for performance.

WeTest mobile game quality protection program helps the birth of boutique games
Tencent's WeTest platform is a quality cloud platform born out of games, and it develops along with the growth of Tencent games. Over the years, rich experience accumulation, business demands and scene precipitation have made WeTest more in line with industry characteristics in product creation and technology research and development. The WeTest quality cloud platform can provide diversified product services and solutions built from the three levels of laaS, PaaS, and SaaS, covering quality assurance in various fields such as security testing, performance testing, functional testing, and testing expert services, and covering game product development A tool chain for all stages of the operation period.

For the field of game testing, WeTest has developed a mobile game quality protection program based on game performance testing experience. This solution covers client performance, such as the detection of stalls, heat, memory/CPU, network and other dimensions, as well as the analysis capabilities of abnormal issues such as crashes, ANRs, and errors; using in-depth quality data acquisition and big data analysis Ability to provide a full range of quality monitoring, data analysis, and business insight services for the game business.

(1) Performance index data level
Tencent WeTest has constructed 6 categories, 30+ quality indicators, and scientifically uses data to "measure" game quality.
1. In terms of data analysis and statistics for game characteristics, WeTest provides mobile game performance big data reporting and analysis capabilities to help projects pass data (such as: FPS average, FPS jitter, freeze, low frame rate and other dimension indicators) real-time observation Client-side performance, quickly locate problems, and break through performance bottlenecks.
2. WeTest provides big data analysis capabilities in dimensions such as version/custom game scenes/models/image quality, comprehensively detects core performance data indicators such as frame rate/stutter/network delay/CPU frequency/memory, and can provide second-by-second /Frame-level user game field performance data analysis.
3. Provide multi-dimensional quality indicator monitoring such as player hardware portrait distribution statistics, business retention analysis, and business insight analysis capabilities.

(2) Abnormal error monitoring capability
According to the characteristics of the game engine, Tencent WeTest has also made many breakthroughs in the acquisition and reporting of abnormal client crash problems, and it also has a certain degree of originality in the industry. for example:
1. Realize the monitoring capability of NativeOOM.
2. Simultaneously capture the memory information (PSS, VSS, video memory, Footprint information) at the time of the crash.
3. Support the ability of UE4 engine to report errors.
4. Support Unity Mono Managed stacktrace, etc.

(3) Business insight analysis level
Tencent WeTest can build a multi-dimensional player hardware profile analysis, and provide gamers with "user retention analysis", "release overseas", "new gameplay", "new gameplay", and "new gameplay" based on the distribution of dozens of hardware dimensions such as models, systems, and simulators. Guidance at the value level such as "feature model selection" assists business judgment and decision making, allowing game customers to better understand the distribution of their user groups on models.

Concluding remarks
Tencent's WeTest mobile game quality guard solution is based on long-term experience in guaranteeing game quality services, which can help games analyze and locate experience problems caused by performance. Constructed a closed loop from real-time data monitoring to performance early warning to data scene-based positioning and final verification and comparison, allowing the data to speak for the quality of the game, and assisting the game party to quickly discover and solve problems.

At present, Tencent's WeTest mobile game quality solution has served hundreds of mobile games inside and outside Tencent, and the daily processing data volume on the WeTest platform has reached tens of billions of levels, escorting the performance quality and gaming experience of many star games. At the same time, taking into account the scenario of the game going overseas, Tencent WeTest's complete product service supports the deployment of services in multiple mainstream regions around the world, and flexibly supports global distribution needs. There is no need to worry about data compliance when the game goes overseas, and it provides stable, efficient and convenient testing services for domestic games going overseas. .

Fill out the application form below to receive exclusive materials for the mobile game quality protection program for free.
Tencent WeTest Mobile Game Quality Protection Program Conference Information Application Form

If you have business needs, please consult customer service for details
Customer Service Tel: [phone]-22126
Customer Service QQ: 2467787701
Working hours (Monday to Friday 9:30-18:30)

About Tencent WeTest
Tencent WeTest is a one-stop quality open platform officially launched by Tencent. More than ten years of experience in quality management, dedicated to quality standard construction and product quality improvement. Tencent WeTest provides mobile developers with excellent R&D tools such as compatibility testing, cloud real machine, performance testing, security protection, etc., and provides solutions for more than 100 industries, covering the testing needs of products at various stages of R&D and operation, and has undergone thousands of products. . The gold medal expert team guarantees the quality of your products 360 degrees through 5 dimensions and 41 indicators.

Follow Tencent WeTest to learn more popular test products:
WeTest Tencent Quality Open Platform-Focus on games to improve quality