An efficient Join-Engine to the SQL query based on Hive with Hbase

DOI

10.2991/asei-15.2015.196How to use a DOI?

Keywords

Hbase; Hive; multi-join; Join Engine

Abstract

Hbase combine Hive application platform can analysis of huge amounts of data easily. And querying on multi-join is the bottleneck of restricting the performance. To solve this problem designing a Join Engine between Hbase and Hive. It can read Hbase data and complete multiple table joins and optimization in advance to queries. Using the Join Engine can reduce the time of mapreduce process to data sort and shuffle, effectively improve the efficiency of Hbase combine Hive queries. The experimental results show that the solution with Join Engine can obviously shorten the query time in multi-table join, support the Hbase quasi real-time application.

Copyright

© 2015, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Zhi-cheng Zhao
AU  - Yi Jiang
PY  - 2015/05
DA  - 2015/05
TI  - An efficient Join-Engine to the SQL query based on Hive with Hbase
BT  - Proceedings of the 2015 International conference on Applied Science and Engineering Innovation
PB  - Atlantis Press
SP  - 991
EP  - 996
SN  - 2352-5401
UR  - https://doi.org/10.2991/asei-15.2015.196
DO  - 10.2991/asei-15.2015.196
ID  - Zhao2015/05
ER  -