郭慈, 廖振松. Research and practice on big data platform technology based on the core structures of Spark[J]. 2016, 29(10): 40-45. DOI: 10.13992/j.cnki.tetas.2016.10.009.
基于Spark核心架构的大数据平台技术研究与实践
摘要
湖北移动自搭建企业级大数据中心以来
整合了O域、B域、M域的数据
形成了标准化、开放式、集中化的数据中心平台。深入研究Hadoop及Spark等生态圈软件的底层技术
构建以Spark为核心的统一数据存取、处理、分析、实时计算的大数据平台
创新性地提出5项关键技术解决方案
攻克了业界公布的众多难题
为企业众多机构提供技术支持与服务支撑。
Abstract
Since building the large enterprise big data center
Hubei Mobile integrates data from domain O
domain B and domain M
forms the standardization
open and centralizes data center platform. Hubei Mobile delves into the Hadoop and Spark the underlying technology
ecosystem software
builds a big data platform based on Spark as the core of the unifi ed data access
processing
analysis
real-time calculation
and innovatively puts forward fi ve key technology solutions
to conquer the industry published numerous problems
which bring many institutions for the enterprise to provide technical support and service support.