Proceedings of the 2015 International Conference on Computer Science and Intelligent Communication

<Previous Article In Volume
Next Article In Volume>

An Optimizational Scheme of Dealing with Massive Small Files based on HDFS

Authors
Yongsheng Du
Corresponding Author
Yongsheng Du
Available Online July 2015.
DOI
10.2991/csic-15.2015.23How to use a DOI?
Keywords
Massive small files, File merge, HDFS
Abstract

This paper delves the hadoop distributed file system-HDFS, and presents a new file combining, indexing and extracting scheme to alleviate the question that HDFS cannot perform well when facing with massive small files instead of the perfect efficiency of dealing with big files in order, which could reduce the usage of memory of Namenode and improve the I/O performance in HDFS.

Copyright
© 2015, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

<Previous Article In Volume
Next Article In Volume>
Volume Title
Proceedings of the 2015 International Conference on Computer Science and Intelligent Communication
Series
Advances in Computer Science Research
Publication Date
July 2015
ISBN
978-94-62520-84-4
ISSN
2352-538X
DOI
10.2991/csic-15.2015.23How to use a DOI?
Copyright
© 2015, the Authors. Published by Atlantis Press.
Open Access
This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Cite this article

risenwbib
TY  - CONF
AU  - Yongsheng Du
PY  - 2015/07
DA  - 2015/07
TI  - An Optimizational Scheme of Dealing with Massive Small Files based on HDFS
BT  - Proceedings of the 2015 International Conference on Computer Science and Intelligent Communication
PB  - Atlantis Press
SP  - 99
EP  - 102
SN  - 2352-538X
UR  - https://doi.org/10.2991/csic-15.2015.23
DO  - 10.2991/csic-15.2015.23
ID  - Du2015/07
ER  -