Research of a MapReduce Communication Data Stream Processing Model

DOI

10.2991/ccis-13.2013.7How to use a DOI?

Keywords

Cloud Computing; Hadoop; Hive; MapReduce; Workflow

Abstract

In this paper, we propose CDS-MR , a MapReduce deep service analysis system based on Hive/Hadoop frameworks. Normally, the job of the switch is to transmit data. There is a tendency to put more capability into the switch, such as retain or query pass by data. Thus we definitely need to think about what can be kept in working storage and how to analysis it. Obviously, the ordinary database cannot handle the massive dataset and complex ad-hoc query. MapReduce is a popular and widely used fine grain parallel runtime, which is developed for high performance processing of large scale dataset.

Copyright

© 2013, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Yang Wenchuan
AU  - Jia Bei
PY  - 2013/11
DA  - 2013/11
TI  - Research of a MapReduce Communication Data Stream Processing Model
BT  - Proceedings of the The 1st International Workshop on Cloud Computing and Information Security
PB  - Atlantis Press
SP  - 28
EP  - 31
SN  - 1951-6851
UR  - https://doi.org/10.2991/ccis-13.2013.7
DO  - 10.2991/ccis-13.2013.7
ID  - Wenchuan2013/11
ER  -