Migrate self-built Hive data warehouse to Alibaba Cloud Databricks across versions

Introduction to customers build their own Hadoop clusters in IDC or public cloud environments to build data warehouses and analysis systems, and after purchasing Alibaba Cloud Databricks data insight clusters, data warehouse data and metadata migration and Hive version revisions are involved.

Direct best practice: [ self-built Hive data warehouse cross-version migration to Alibaba Cloud Databricks Data Insight ]
Best Practice Channel: [ Best Practice Channel ]
There are a wealth of best practices for enterprise cloud migration. Starting from typical scenarios, we provide a series of project practice solutions to lower the threshold for enterprise cloud migration while meeting your needs!

Scene description

After customers build their own Hadoop clusters in IDC or public cloud environments to build data warehouses and analysis systems, and purchase Alibaba Cloud Databricks data insight clusters, it involves the migration of data warehouse data and metadata, as well as the revision and update of the Hive version.

Practical advantage

• The fully managed Spark cluster is free of operation and maintenance, saving labor costs.
• Databricks Data Insight is deeply integrated with other Alibaba Cloud products (OSS, RDS, MaxCompute, EMR), and supports the input and output of these products as data sources.
• Using the Databricks Runtime commercial engine has a performance improvement of 3-5 times compared to the open source Spark.

Product List

• Databricks data insights
• Cloud server ECS
• File storage HDFS
• Object storage OSS
• VPC

Business architecture

Direct access to best practices"

Copyright statement: content of this article is contributed spontaneously by Alibaba Cloud real-name registered users. The copyright belongs to the original author. The Alibaba Cloud Developer Community does not own its copyright and does not assume corresponding legal responsibilities. For specific rules, please refer to the "Alibaba Cloud Developer Community User Service Agreement" and the "Alibaba Cloud Developer Community Intellectual Property Protection Guidelines". If you find suspected plagiarism in this community, fill in the infringement complaint form to report it. Once verified, the community will immediately delete the suspected infringing content.