An Optimal Task-Scheduling Strategy for Large-Scale Astronomical Workloads using In-transit Computation Model
- DOI
- 10.2991/ijcis.11.1.45How to use a DOI?
- Keywords
- Task Scheduling; In-transit Computation; Load Distribution; Fog Computing; Genetic Algorithm
- Abstract
The Sloan Digital Sky Survey (SDSS) has been one of the most successful sky surveys in the history of astronomy. To map the universe, SDSS uses their telescopes to take pictures of the sky over the whole survey area. Now the total SDSS data volume is larger than 125 TB since every night telescopes produce about 200 GB of data. To improve the processing efficiency of such large-scale astronomical data, we develop an optimal task-scheduling strategy by using in-transit computation model under fog computing. Within the proposed strategy, we design a global optimization technique to derive an optimal load distribution among heterogeneously computational resources. Finally, we conduct various experiments to illustrate the correctness and effectiveness of the proposed strategy. Experimental results show that it can significantly decrease the processing time of large-scale workloads.
- Copyright
- © 2018, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article under the CC BY-NC license (http://creativecommons.org/licences/by-nc/4.0/).
Download article (PDF)
View full text (HTML)
Cite this article
TY - JOUR AU - Xiaoli Wang AU - Bharadwaj Veeravalli AU - Omer F. Rana PY - 2018 DA - 2018/01/22 TI - An Optimal Task-Scheduling Strategy for Large-Scale Astronomical Workloads using In-transit Computation Model JO - International Journal of Computational Intelligence Systems SP - 600 EP - 607 VL - 11 IS - 1 SN - 1875-6883 UR - https://doi.org/10.2991/ijcis.11.1.45 DO - 10.2991/ijcis.11.1.45 ID - Wang2018 ER -