Apache Flink Meetup 7.10 Beijing Station, Flink x TiDB special session is waiting for you!

Introduction of July 10th, Apache Flink Meetup Beijing Station, see or leave~

Flink, widely popular in recent years, is one of the most recognized big data computing engines; TiDB, as an open source NewSQL database, is also well received by the industry for its excellent horizontal scalability and high availability characteristics. So when Flink encounters TiDB, what kind of spark will it burst?

Apache Flink Community Meetup Beijing Station is here

July 10 | Beijing |

Flink x TiDB Special

This Meetup will be jointly organized by the Flink community and the TiDB community. As always, we have invited technical experts from various industries, 5 technical experts from Alibaba, TiDB, 360, Zhihu, and Netease will share how to achieve accurate and stable real-time computing services and how to build real-time data warehouses around Flink and TiDB. The best practice of data link, how to use the characteristics of both to complete the closed-loop delivery of end-to-end real-time computing, and the perception and practice of Flink SQL and Flink-CDC architecture.

■ Activity highlights

• There are a lot of practical dry goods. What kind of sparks can the combination of Flink + TiDB create? Let’s see how technical experts focus on real-time data business support, real-time data warehouse, end-to-end real-time computing and other scenarios. Use theory and practice to analyze Flink + TiDB in various scenarios. The application of the scene.
• The form of activities is diversified, offline and online are simultaneously opened, in the same city, you can participate in offline Meetup face-to-face communication, and you can also watch the live broadcast online in different places. Don’t miss the exciting content
• Rich peripherals are waiting for you, and you will have the opportunity to get a lot of exquisite peripherals customized by the Flink community!

Special thanks to 360 for providing the venue
**■ Event agenda
**

▼ Register now▼

https://1712399719478.huodongxing.com/event/6601410216600

஑᩻ग़ Fli

Guests and topic introduction

"JFlink on TiDB-Convenient and reliable real-time data business support"

Lin Jia

NetEase Interactive Entertainment Technology Center Real-time Development Engineer

Apache Flink Contributor

[Guest Profile]

Lin Jia, head of real-time business of NetEase Interactive Entertainment Billing Data Center, is the main program of real-time development framework JFlink-SDK and real-time business platform JFlink.

[Lecture Introduction]

In the real-time computing field in recent years, Flink has become the most popular open source framework; TiDB's convenient and reliable HTAP converged distributed features make it widely used in data center services. This sharing will start from data center computing cases, combine the design philosophy of the data center real-time framework JFlink-SDK and the use of TiDB, and discuss how to achieve accurate and stable real-time computing services in actual business scenarios.

"Flink + TiDB, experience the beauty of real-time data warehouse"

Wang

TiDB Community Department Architect

[Guest Profile]

Wang Tianyi, TiDB community department architect. He has worked in Fidelity Investment and Softbank Investment, has rich experience in database high-availability solution design, and has in-depth research on the high-availability architecture and database ecology of TiDB, Oracle, PostgreSQL, MySQL and other databases.

【Introduction】

The evolution of real-time data warehouse-lambada architecture

-Kappa architecture

-The basic technology stack architecture of the current real-time data warehouse

TiDB + Flink build a data link for real-time data warehouse

-TiDB infrastructure and scalability

-TiDB + Flink real-time data warehouse architecture

Best practices of TiDB + Flink

"TiDB x Flink end-to-end real-time computing"

Know the basic research and development architect; TiDB community TOC chairman

TiKV Maintainer

[Guest Profile]

Sun Xiaoguang, the architect of Zhihu's basic R&D team, has long been engaged in distributed system-related R&D work and focuses on cloud native technology.

【Introduction】

Flink is commonly used for real-time computing in high real-time scenarios, while TiDB is widely used in OLTP transaction scenarios under the large data level. TiDB's excellent horizontal scalability makes it an ideal downstream database storage for Flink real-time computing tasks, and better meets the storage requirements of real-time computing results with high throughput and low latency. And Flink's extremely strong scalability can also provide sufficient computing power for TiDB clusters with continuous high-throughput writes, and provide sufficient guarantee for the real-time performance of large-traffic data calculations. In the past when the native TiDB Flink streaming computing capability was lacking, users needed to adopt roundabout methods to use tools designed for MySQL to achieve streaming or batch computing of TiDB data. This not only increases the extra burden on learning, but also makes it difficult to make full use of the unique architecture features of TiDB to improve the overall efficiency of the system. In the process of the transition from Zhihu's overall online database system to TiDB, we urgently feel the importance of the TiDB x Flink native batch-streaming integrated solution. This sharing will introduce some of Zhihu's work in the integration of TiDB x Flink batch and flow, and take the actual business as an example to introduce how to make full use of the characteristics of the two to complete the closed-loop delivery of end-to-end real-time computing.

"Flink SQL in 360 Practice"

Zhang

Apache Hudi Contributor , 360 big data platform R&D engineer

[Guest Profile]

Zhang Chaoming, 360 big data platform research and development engineer. I love technology and am very interested in big data-related technologies, especially fascinated by the principles and development of real-time computing. Currently working in the 360 System Department, participating in the implementation and promotion of real-time computing related technologies within the company, and responsible for the productization and optimization of Flink SQL.

[Lecture Introduction]

With the continuous development of the company’s search, finance, advertising, games and other businesses, it has become an urgent need to promote faster iteration of business value through real-time computing. As the main real-time computing engine currently promoted in the company, Flink is also increasing in the company. It is widely used. In order to speed up development efficiency and reduce the learning cost of developers, we actively encourage users to use Flink SQL for job development.

This sharing will focus on the productization process of Flink SQL in 360, and share some of our insights, practices and improvements on Flink SQL.

"Detailed Flink-CDC"

Xu

Apache Flink Contributor

Alibaba Senior Development Engineer

[Introduction to the lecturer]

Xu Bangjiang (Xue Jin), senior development engineer at Alibaba, focuses on Flink SQL engine development.

[Lecture Introduction]

How to connect the data in the database to the data warehouse/data lake is a key aspect that needs to be considered in the construction of the data warehouse. This sharing compares the advantages and disadvantages of the traditional data synchronization solution and the Flink-CDC data synchronization solution, analyzes the advantages of the Flink-CDC architecture, shares the Flink-CDC 2.0 design solution, and explains in detail the lock-free design and full-stage concurrent design.

event registration

■ Event details

• Time: July 10th 13:30-17:30
• Venue: Release Hall, Building A, Building 360, Building 2, No. 6, Jiuxianqiao Road, Chaoyang District, Beijing
• Registration link: https://1712399719478.huodongxing.com/event/6601410216600
• Live viewing: https://developer.aliyun.com/live/246905

GitHub address

https://github.com/apache/flink

Welcome everyone to give Flink likes and send stars~

Copyright Statement: content of this article is contributed spontaneously by Alibaba Cloud real-name registered users, and the copyright belongs to the original author. The Alibaba Cloud Developer Community does not own its copyright and does not assume corresponding legal responsibilities. For specific rules, please refer to the "Alibaba Cloud Developer Community User Service Agreement" and the "Alibaba Cloud Developer Community Intellectual Property Protection Guidelines". If you find suspected plagiarism in this community, fill in the infringement complaint form to report it. Once verified, the community will immediately delete the suspected infringing content.