Dewu App Order Configuration Copywriting Test Right Shift Practice

1. Background

The copy in the order details page of the Dewu App version has a corresponding copy configuration value in the background of the unified closing copy to optimize the information display effect of the order details page.

Based on the breadth and complexity of the transaction-side business, relying only on people still has certain limitations. When faced with such business characteristics, the function-based + technology-assisted approach is also applied more. For this demand, Dewu friends also try to use more methods to ensure online quality as much as possible. Next, we will introduce the practice of shifting the test to the right of the order side of the configuration copy test.

2. Analytical thinking

2.1 Introduction to Requirements

In the version iteration of Dewu App, in order to improve the user experience, the product side proposes new requirements for order details page optimization, defines client module components, formulates information display specifications for each module, reorganizes all the copywriting on the order details page, and builds a copywriting configuration. In the background, the header copy of the order details page is supported to be configurable, which is convenient for users to clearly understand the order details.

Features include:

• Support flexible configuration of all order status node copywriting
• Basic copy of the configuration of each status node of the order
• Special order types support differentiated copywriting configuration
• Copy support variable parameter optional

Value logic:

• Hit the grayscale, take the corresponding order node configuration
• There is a configuration of differentiated copy under the order status node, and the differentiated copy is selected.
• No differentiated copy is configured, and the basic copy is taken.

2.2 Test Strategy

Based on the characteristics of multiple order types and multiple business processes on the order side, the test strategy adopted this time is: one type of test for the same order with the same process + special order type focus coverage.

2.3 Difficulties and pain points of order configuration copywriting testing

• Status of order business: There are dozens of existing order types on the order side, and there are many existing forward order statuses, and some orders have their own special business processes.
• As the intermediate link of the transaction, the interaction between the upstream and downstream of the order side and its own business system is relatively complex, and the perception of the change point is not timely.
• Online and offline configurations are inconsistent.
• Involving the needs of all order types, most of the testing strategies currently used are: one type of test for the same order with the same process + special order type focus coverage + automated case regression coverage, it is not realistic to rely solely on manpower for full regression.
• There are many technical transformation projects, and there are currently many functions in the online grayscale. When the full grayscale is not completed, the test needs to cover the old and new versions at the same time.

2.4 Optimization of copywriting quality assurance methods

The breadth of business and testing difficulties and pain points involved in this new demand, research and development and testing have also been reviewed, and the current difficulties and pain points have been analyzed and discussed, leading to the following attempts:

(1) In the follow-up test, the key coverage strategy of the special process order type remains unchanged, and the development proposes that the test environment retains the most complex configuration.
(2) The display of automatic verification copywriting needs to cover the full amount of scenes.
(3) New script attempts for all online order types and all node texts are added to the business monitoring platform.

3. Optimizing Practices

The behavior of users is unpredictable, so it needs to be considered strictly at the beginning of code design, and basic processing of all possible scenarios must be done at the bottom. Similarly, for testing, various scenarios that may occur need to be considered. Based on the above In the case of difficult pain points and limited resources, the testing side also needs to consider more solutions. details as follows:

3.1 Scheme Analysis

(1) The test environment retains the most complex copy configuration

After discussion, this solution is not feasible. Some fields only have specific order types. After all of them are configured with the most complex copy, some order types will be displayed as ${xxxx}, which confuses the test. In the end, the copy that is now configured by default to be consistent with the online is adopted.

(2) Verification of the way of automated script for interface testing

The use of automated scripts for interface testing has been discussed and found to have the following advantages and disadvantages:

(3) Add scripts to the business monitoring platform to achieve online early grayscale

The advantages and disadvantages of the self-developed business monitoring platform to realize the advanced grayscale scheme are as follows:

3.2 Practice

In view of the fact that the online real configuration cannot be covered and the configured content is checked abnormally, combining the advantages and disadvantages of the above two solutions, adding scripts to the business monitoring platform can just achieve the coverage of this part of the scene. In the subsequent iteration planning, similar There are still a lot of functions. After discussion, it was decided to add a business monitoring script to the verification of such functions to check online data and give an alarm. After going online, it can be grayed out in advance to find problems.

3.2.1 Business Monitoring Platform

Dewu is a self-developed platform for data and status verification. The data flow is as follows:

3.2.2 Script Implementation

Through the business monitoring platform, establish a rule that Feishu will alert if the return value copy contains abnormal data, and find the problem in time. The specific implementation is as follows:

• Write data verification scripts on the business monitoring platform
• Through the platform to monitor the data that hits grayscale after going online, the script implements the abnormal data returned by the check interface that contains "$" (the variable is not parsed if $ is included)
• Configure monitoring rules to detect abnormal data in time
• Print out the error message and send an alarm in time to the online Feishu alarm group
• There are the most complete order types and data of various statuses online, print the copywriting of various order types and various statuses, and check the correctness of the copywriting display.

3.2.3 Logic Diagram

3.2.4 Alarm

At present, Feishu alarms are most commonly used in online alarms. The alarms are as follows:

3.2.5 Follow-up planning

The business monitoring platform currently supports inspection and alarms for asset loss prevention. After the subsequent platform functions support scenarios are added, more scenarios can be satisfied, and some manual tests can be replaced to improve test efficiency.

If the business monitoring platform can support the pre-release environment, the configuration center can synchronize the online configuration of the pre-release environment, and can verify the changes in the pre-release environment. The business monitoring platform can support designated machine access, extract the stream after release, and check the correctness of the copy online.

3.2.6 Prospects of Configuration Copywriting Test

By adding scripts to the business monitoring platform, the copywriting test can be moved to the right, and then moved to the pre-release or online. With the most complete online data and online real configuration, the real copywriting of various order types and various states can be obtained. At the same time, the time loss of data creation is greatly reduced, and the service quality is guaranteed while improving efficiency.

5. Summary

Although the copywriting is small, the experience is not good. In the face of the deep and wide-ranging business interaction on the order side, how to test efficiently and effectively is a question that every test partner of the order group is constantly thinking about and exploring, including the current application automation case , traffic recording and playback, asset loss prevention monitoring and other methods are all powerful tools for regression testing, which together ensure quality. The solution is still iterating, and our test exploration has not stopped. Likewise, our testing strategies and technical means are constantly being optimized, and quality assurance is the responsibility of the entire team. Friends with other ideas are welcome to share their experiences.

*Text/Kelly
@德物科技public account