Passed unanimously! Linkis, an open source project of Weizhong, enters Apache incubation

On August 2, Linkis, the open source project of WeBank, officially passed the voting resolution of the top international open source organization Apache Software Foundation (ASF for short), and became an ASF incubator project with a unanimous vote.

Linkis is the second ASF project of WeBank. Since then, WeBank has become one of the few companies with two or more ASF projects (including incubation and graduated). At the beginning of the year, the EventMesh project also entered the ASF incubator with a unanimous pass. This time Linkis became the ASF incubator project to further confirm WeBank’s determination to embrace open source and open governance, and to become an open source ecological construction in the field of financial technology. The leader’s vision has taken another big step forward.

Take you to know Linkis

Linkis project introduction

The computing middleware Linkis is developed and open sourced by the WeBank big data team. It serves as a unified entry for the underlying computing storage engine of the big data platform and a governance control tool for computing operations. Through the standardized interfaces (REST, JDBC, WebSocket, etc.) provided by Linkis, It can quickly connect to various underlying engines (Spark, Presto, Flink, etc.), and realize cross-engine context sharing, unified job and engine management and orchestration functions, and solve the "computing governance" problem in a standardized and reusable way.

Linkis current community development status

Since Linkis was open sourced in July 2019, the number of contributors has reached 51 people, and it has been applied in various industries including finance, the Internet, and communications. It has accumulated more than 700 trial companies and 1000+ sandbox trial users. Many companies have used Linkis as a unified entry point for the underlying computing storage engine of the big data platform, and a powerful tool for the management and control of computing requests/tasks.

Linkis's development history and future vision

The Linkis project was open sourced on GitHub and Gitee in July 2019. From the first 0.5.0 version to the latest version 1.0.2, WeBank and many teams from the community have made many new features and new features for Linkis. Additions, functional enhancements, and bug fixes, such as docking with multiple underlying computing storage engines such as Presto/ES/Flink, adding new features such as context services and computing orchestration. After two years of open source community construction, Linkis has become an influential open source project in the field of big data in the industry, and has gradually formed an extensive application ecosystem.

Di Shuai, head of WeBank's big data platform and initiator of the Linkis project, said:

In today's complex distributed environment, the communication, coordination, and governance of application services have formed mature solutions from SOA to microservices, and many practices for decoupling different services from ESB to Service Mesh.

However, when application services need to communicate with the underlying engine, the situation is different. Engines are isolated from each other, and the client-server tight coupling model is everywhere. Each upper-level application must directly connect and access various underlying engines in a tightly coupled manner to solve the "computing governance" problem on its own, including maintaining different client environments, submitting jobs, monitoring job status, obtaining output, and handling a large number of concurrent customers End examples, observe Bad Job, adapt to engine version changes, etc.

This is because there is a lack of a common "computing middleware" layer between many upper-level applications and countless underlying engines to handle all these "computing governance" affairs in a standardized and reusable way. This is why we started the Linkis project.

Message from Champion

Champion Linkis the Apache project, is open TOC atom Open Source Foundation Chairman (Technical Oversight Committee), Apache Software Foundation Member, Apache Hadoop PMC & Committer and Apache NuttX, YuniKorn other items tutors blocking Junping said: "The open-source micro-public banks Linkis is a very distinctive computing middleware project, which effectively solves the connection, access and reuse problems of the tools and applications in the foreground and the storage and computing engine in the background. This time it successfully entered the Apache Foundation project The incubation signifies that Linkis has joined the world's most dynamic big data open source family represented by Hadoop and Spark. We look forward to the early graduation of the Linkis project and become another top Apache project from China!"

Looking forward to your arrival

Entering the Apache incubator means that Linkis is one step closer to becoming a top open source community product, but it also means that it must follow "The Apache Way", uphold a more compatible and inclusive mentality, and meet more opportunities and challenges. Welcome more developers to participate in the construction of the community, so that the community will continue to develop healthily. Developers are welcome to follow Linkis and build a world-class open source project together.

Warehouse address :

https://github.com/WeBankFinTech/Linkis (will be migrated to the Apache organization later, you can search for Linkis to obtain)

https://gitee.com/WeBank/Linkis

mailing list :

[e-mail]

[e-mail]

(After sending any content to the mailbox, follow the reply to subscribe to the mailing list)

Community Communication :