Huawei Cloud Ranks No. 1 in China's Big Data Platform Market Again
Jul 26, 2023 GMT+08:00
According to the China Big Data Platform Market Shares, 2022 report recently released by IDC (a world-leading provider of IT market research and consulting services), Huawei Cloud was ranked No. 1 in China's big data platform market (covering both on-premises and public cloud services) in 2022. This was the third time that Huawei Cloud took the No. 1 spot in this market.
The report also showed that, thanks to the FusionInsight intelligent data lake solution, which can be deployed on-premises using Huawei Cloud Stack, Huawei Cloud has a market share greater than the sum of the closest three competitors put together, making it No. 1 in China's on-premises big data deployment market. In China's public cloud service market of big data, Huawei Cloud grew market share by 53.1%, the highest growth among all vendors.
In addition, the report mentioned that big data within enterprises was becoming more distributed, diverse, and real-time. Over the past few years, many organizations in the big data market have re-evaluated their existing data lakes, data warehouses, and data integration capabilities and sought ways to upgrade or reinvent data management architectures. Integrating intelligent tech with data has become a new market trend. In the coming few years, it will be a hot topic in the market to infuse machine learning into an underlying big data platform using an innovative architecture.
Huawei has been investing in big data for 14 years and has extensive experience in serving many sectors like government, finance, carriers, enterprises, and Internet. Huawei proposed many innovative concepts related to big data, such as lakehouse, batch-stream convergence, and data-AI convergence:
· Industry's first to propose the lakehouse concept: In 2020, Huawei Cloud designed a lakehouse architecture. With a lakehouse architecture, all data is imported into a lake and processed layer by layer, and diverse workloads can share the same copy of any of the data in the lake. The lakehouse architecture has been put into use by state-owned banks and joint-stock banks. It is underpinned by Huawei Cloud's intelligent data lake solution, FusionInsight. FusionInsight provides MapReduce Service (MRS), a cloud native data lake. A single MRS cluster can contain more than 60,000 nodes. FusionInsight helps customers transform their traditional big data and data warehouse solutions into layered deployments in a single, unified lake combined with a series of diverse marts. It also adds intelligence to data. Plus, FusionInsight boasts a wide range of cloud services: Data Warehouse Service (DWS) providing a high-performance cloud data warehouse, Graph Engine Service (GES) supporting trillion-edge analysis, Trusted Intelligent Computing Service (TICS), and Data Lake Insight (DLI) enabling auto scaling with a serverless architecture.
· Finely-honed batch-stream convergence: Huawei Cloud MRS provides batch-stream convergence based on a lakehouse architecture. It enables real-time, quasi-real-time, and offline data processing using a unified data model. Data can be imported to lakes with a latency down to just a few seconds. The offline and real-time data processing paths that were previously separate have been unified, which supercharges the efficiency of processing massive volumes of data and simplifies integration links. This means more efficient development and slashed data governance costs. The Huawei MetaERP system uses batch-stream convergence of MRS to deliver real-time computing for service monitoring, analytics, and control. The innovative architecture promotes accurate multi-currency fund accounting with consistent data.
· Leading customers to a future of data-AI convergence: In 2022, Huawei Cloud launched a data-AI convergence solution. It provides three-layer resource pooling, unified metadata, a unified workbench, and AI4Data. These four innovative capabilities facilitate comprehensive convergence between big data and AI:
· Three separate layers for the storage, cache, and compute pools unify resources across different data lakes, data warehouses, and AI platforms into one resource pool for data-AI convergence, which makes the resource performance closer to that of integrated storage and compute.
· LakeFormation manages metadata, controls data access, and manages the entire data lifecycle of all applications in a single, unified center. It enables a single, unified copy of data to be easily shared among data lakes, data warehouses, and AI platforms. It empowers you to use data with better agility.
· A unified workbench combining data analytics with AI development enables seamless connection and collaboration between DataOps and MLOps. End-to-end operations, from development and testing to deliveries and rollout, can be done on this workbench, which drives faster innovation in data-AI convergence.
· AI4Data makes data more intelligent. It makes the entire data development and governance process intelligent, from management of master data, metadata, and data models to data quality check and data security protection.
With its leading tech and extensive industry-specific expertise, Huawei Cloud FusionInsight has been chosen by many government and enterprise customers:
· Industrial and Commercial Bank of China (ICBC) used Huawei Cloud FusionInsight to establish a unified data lake for their entire bank. The modern lakehouse architecture was used for modeling, with the efficiency far better than the traditional data warehouse architecture. The largest data lake of ICBC now supports more than 2,000 nodes where over 300 big data applications are running and more than 300,000 batch computing tasks are handled per day.
· Bank of Communications leveraged Huawei Cloud FusionInsight to establish a comprehensive, unified, and clean data foundation. Using this foundation, they launched a full-link real-time data lake, which shortened the time needed for reporting from 8 hours to 2 hours. The lakehouse-based DaaS platform developed by Bank of Communications using Huawei Cloud FusionInsight was named Best Big Data Application in 2022 by The Asian Banker.
· China Three Gorges Corporation (CTG) leveraged Huawei Cloud FusionInsight to deploy a lakehouse architecture that unifies data lakes and warehouses into one real-time data lake. The data lake turned OT and IT data from the entire corporation into data assets. MRS also helped CTG create big data models and analytics applications for power generation. 11 major station applications, covering operations, device maintenance, and production, now support real-time data analytics. Faults are detected ahead of time and rectified promptly.
Huawei Cloud FusionInsight provides big data services to more than 3,500 customers worldwide. More than 400,000 FusionInsight nodes have been delivered. The largest cluster houses more than 10,000 nodes in commercial use and has generated more than 700 PB of data. Huawei works with more than 800 partners and is always helping customers accelerate digital transformation and intelligent upgrade.
* Sources:
IDC's report: China Big Data Platform Market Shares, 2022
IDC's report: China Big Data Platform Market Shares, 2021H1
IDC's report: China Big Data Platform Market Shares, 2020