community started with connecting, and it also achieved with connecting
———Chen Yanshan
ApacheCon is the official global series of conferences of the Apache Software Foundation (ASF). As a prestigious open source feast, ApacheCon has attracted much attention in the open source community and is also one of the well-known activities in the early days of the open source movement.
As early as 1998, before the establishment of ASF, ApacheCon had attracted participants at all levels to explore "tomorrow's technology" in more than 300 Apache projects and their different communities. Also in this session, developers who developed HTTPD services gathered together and decided to establish the Apache Software Foundation.
ApacheCon is held once a year, usually in Europe or North America. It is an excellent opportunity for Apache developers to communicate, discuss, and meet offline. It is also a rare occasion for sharing ideas and exciting ideas. Through hands-on practice, keynote speeches, actual case studies, training, hackathons, etc., showcase the latest development and emerging innovations of the Apache project.
This year, in order to better serve the fast-growing Apache users and contributors in the Asia-Pacific region, the ApacheCon Organizing Committee and the Apache Software Foundation are pleased to announce that the first ApacheCon online conference for the Asia-Pacific region will be held in August 2021. Held online from 6th to 8th.
In order to let everyone know more about open source and ApacheCon Asia, SegmentFault will interview some Track Chairs or conference lecturers to let you know the stories behind the preparations for the conference and the stories of these experts.
Today, what we bring to you is an interview with Chen Yanshan, a software development engineer in the Iaas product department of China Mobile Cloud Competence Center.
The following is the content of the interview with Chen Yanshan by SegmentFault Sifei:
Chen Yanshan
Chen Yanshan is currently working in the IaaS product department of China Mobile Cloud Competence Center. Has been engaged in the design and development of distributed storage software architecture, and has been deeply involved in the construction and development process of mobile cloud. He has rich practical experience in the field of distributed storage. At present, the mobile cloud has provided EB-level storage for the entire network. Individuals are currently focusing on object storage delivery orchestration and traffic management construction, and are thinking about implementing object storage traffic management based on the Apache APISIX seven-layer gateway, and achieving further architecture upgrades.
The story of Chen Yanshan’s first exposure to open source
It is also a coincidence that I also have a relationship with Apache. The first time I came into contact with open source was the Hadoop and HBase projects under Apache. At that time, HBase was also used as the metadata storage engine for our object storage products.
At that time, our object storage EOS was still in the first generation of self-research, which used NoSQL database HBase to realize the columnar KV storage of metadata, and used MapReduce for computing services. During this period, I was mainly responsible for the development and optimization of the metadata storage engine. At the same time, we are also maintaining an online cluster with more than 300 nodes. With the increase in user business volume, the system has also experienced some problems. The most impressive thing to me is that HBase metadata has gradually become the bottleneck of system access under frequent writing and deleting scenarios. Because Hbase uses lexicographic order by default, when objects are frequently written to or deleted from the same object bucket, the HRegionServer node where the Region is hosted in the background will have hot issues of read and write access, and Major Compact or Region Split is frequently executed. Operation, but these background actions not only consume a lot of host resources, but also block IO requests, directly affecting user services. The most obvious feeling is that the average latency soars, and even the request response timeout occurs. In order to solve this performance bottleneck, we finally solved the hot issue of HRegionServer through the hash transformation of the metadata key and the pre-planned allocation of the number of HRegion, and the system read and write performance increased by 80%. Although the technology stack of our products switched over time, the experience of studying HDFS and HBase has benefited me so far, and it also gave me a new understanding of open source culture.
When participating in open source and contributing to the Apache community, what are the personal and company gains?
Open source is actually an inheritance and development of the concept of sharing. For me personally, participating in open source and participating in Apache's excellent open source projects can not only learn excellent code, but also learn some excellent architecture design ideas. By comparing multiple open source projects horizontally, you will find some common design problems, and you can avoid known risks as much as possible in the future system architecture design and optimize the architecture design. At the same time, I think participating in community contribution is still a window of self-exhibition, which can enhance one's personal brand and reputation, and be able to meet some like-minded people and industry leaders to further improve oneself.
The firewood gathering is high. For the company, participation in open source brings gains mainly in two aspects: one is the ability to use the power of community talents to continuously polish its products and bring substantial benefits to the company; the other is the ability to expand The company's influence in the industry and brand value promotion. Our EOS object storage is also based on open source, but at the same time we also uphold the concept of originating from open source and giving back to the community, while polishing our products, we simultaneously build a good ecological periphery. Because only by continuously investing in the open source community, can we attract more developers to participate, form a positive gain, and achieve a win-win situation.
Chen Yanshan understands "The Apache Way"?
The "Apache Way" in my mind is a community culture with openness, tolerance, sharing and collaboration, that is, the Community Over Code community advocated by the Apache community is greater than the code culture. Open and inclusive. My understanding is that the community is completely open, with neither time nor geographic boundaries. Everyone can participate in community projects as equal and free, and can contribute their own wisdom and strength to community projects. Here, your submission can be a large feature, or a small bug fix, or document writing, or technology sharing, etc. In short, everything that is conducive to the development of community culture is welcome and respected. Sharing and collaboration, the community begins with connection, but also accomplishes with connection. It is precisely because of the existence of the open source community that a group of like-minded people can be willing to share and collaborate together, embrace the community, and do a sentimental and meaningful thing together.
Chen Yanshan and ApacheCon Asia
The topic of my sharing this time is the application and practice of Apache APISIX in China Mobile's public cloud object storage EOS, which is related to API/microservice technology. First introduced the overall construction process of China Mobile’s public cloud and the development and evolution of its object storage products, and then explained why we chose Apache APISIX as our load balancing gateway, and also shared the best of Apache APISIX in mobile cloud EOS products. Practice and application. During the period, we talked about how to use Apache APISIX to help us solve actual production problems. At the same time, what practical work we did based on this, and finally made some planning instructions for our future architecture evolution.
I hope that after listening to my sharing, the audience will first have a more comprehensive understanding of China Mobile, recognize China Mobile’s efforts to internalize its technical capabilities, and understand the cloud service brand "Mobile Cloud" ; At the same time, I also hope that everyone can further understand and join the excellent open source gateway project of Apache APISIX, how to use APISIX to correctly handle the traditional north-south traffic and east-west traffic between services.
Join us in ApacheCon Asia!
Openness and tolerance, sharing and collaboration, let's join the ApacheCon Asia technology feast!
About China Mobile Cloud Competence Center
China Mobile Cloud Competence Center, also known as "China Mobile (Suzhou) Software Technology Co., Ltd." Ecological convergent, promote China Mobile's cloud business market share to enter the first camp of domestic cloud service providers within three years. The "Mobile Cloud" brand also fully leverages the advantages of cloud-network integration, personal services, customizable, safe and controllable advantages to create a "smart cloud around you" in the 5G era, and provide a "strong engine" for the industry's digital transformation and development.
At present, our object storage EOS team has been continuously recruiting people. Interested students can contact me by email at chenyanshan@cmss.chinamobile.com and look forward to your joining.
In addition, many positions in the IaaS product department where our team is located are also in continuous recruitment, and there are multiple positions in distributed storage/cloud native/virtualization/edge computing/kernel open to R&D and architects! Interested parties are welcome to contact me.
ApacheCon Asia full agenda address:
https://www.apachecon.com/acasia2021/zh/sessions.html
Register address now:
https://hopin.com/events/apachecon-asia-2021
**粗体** _斜体_ [链接](http://example.com) `代码` - 列表 > 引用。你还可以使用@来通知其他用户。