Arana: A Cross-domain Workflow Scheduling System
- DOI
- 10.2991/icwcsn-16.2017.72How to use a DOI?
- Keywords
- workflow; cross-domain; big data; close to data; schedule
- Abstract
Single data center is difficult to meet current demands of data storage and computing resources, leading to data broadly stored in different data centers far from each other geographically. Cross-domain big data processing usually requires data from other data centers across different network. Since the network environment is extremely complex and large amount of data is required for computing, time spent in data transmission is unacceptable, resulting in slow scheduling. In this paper, we propose a cross-domain workflow scheduling system called Arana. By moving program close to data and integrating popular big data processing platform, this system enables user to complete computing with cross-domain data without transferring.
- Copyright
- © 2017, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Jian-Hua Gu AU - Xue-Yuan Lan AU - Ying Hao AU - Yu-Tong Hu PY - 2016/12 DA - 2016/12 TI - Arana: A Cross-domain Workflow Scheduling System BT - Proceedings of the 3rd International Conference on Wireless Communication and Sensor Networks (WCSN 2016) PB - Atlantis Press SP - 334 EP - 337 SN - 2352-538X UR - https://doi.org/10.2991/icwcsn-16.2017.72 DO - 10.2991/icwcsn-16.2017.72 ID - Gu2016/12 ER -