Architectural Design Of Data Stream-Based Big Data Real-Time Analysis System

DOI

10.2991/jimec-17.2017.34How to use a DOI?

Keywords

Data stream, Big data, Real-time computing (RT computing), Architectural design.

Abstract

Conducting the RT analysis of large-scale data stream severely challenges the IT hardware facilities and system Architecture. To cope with the needs of large-scale RT analysis, the article analyzes and compares the mainstream open-source technology and then designs the system architecture that consists of data collection, data distribution,real-time computing, persistent storage, resource allocation and scheduling.

Copyright

© 2017, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Qiang Liu
AU  - Junmin Lv
AU  - Xun Yuan
AU  - Renyi Luo
AU  - Dekui Lv
PY  - 2017/10
DA  - 2017/10
TI  - Architectural Design Of Data Stream-Based Big Data Real-Time Analysis System
BT  - Proceedings of the 2017 2nd Joint International Information Technology, Mechanical and Electronic Engineering Conference (JIMEC 2017)
PB  - Atlantis Press
SP  - 153
EP  - 156
SN  - 2352-538X
UR  - https://doi.org/10.2991/jimec-17.2017.34
DO  - 10.2991/jimec-17.2017.34
ID  - Liu2017/10
ER  -