Application and Exploration of Computing Architecture Based on Big Data Platform

DOI

10.2991/cecs-18.2018.83How to use a DOI?

Keywords

Hadoop; UGC; system architecture; hierarchical model; neural network; customer value.

Abstract

To discuss how to provide a reliable platform for processing big data, by studying some sub projects in core technology and its ecological environment, an extensible big data application system architecture used for processing large scale data sets is implemented. In addition, the architecture is organized into four levels in the form of hierarchical model: platform layer, data layer, business logic layer, and application layer. From the angle of hierarchy, the optimization of Hadoop and HBase, MapReduce programming mode, Mahout technology details and clustering algorithm are discussed. In combination with the customer value hierarchy model and neural network classification model, a distributed brand value model is proposed and successfully deployed on the framework application layer. As a result, it improves the research and implementation of the whole system architecture. Finally, the research contents of each layer are summarized, and the future research directions of the corresponding parts are discussed.

Copyright

© 2018, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Yan Hou
PY  - 2018/07
DA  - 2018/07
TI  - Application and Exploration of Computing Architecture Based on Big Data Platform
BT  - Proceedings of the 2018 International Symposium on Communication Engineering & Computer Science (CECS 2018)
PB  - Atlantis Press
SP  - 486
EP  - 491
SN  - 2352-538X
UR  - https://doi.org/10.2991/cecs-18.2018.83
DO  - 10.2991/cecs-18.2018.83
ID  - Hou2018/07
ER  -