UPM Institutional Repository

An efficient schema transformation technique for data migration from relational to column-oriented databases


Citation

Zaidi, Norwini and Ishak, Iskandar and Sidi, Fatimah and Affendey, Lilly Suriani (2022) An efficient schema transformation technique for data migration from relational to column-oriented databases. Computer Systems Science & Engineering, 43 (3). 1175 - 1188. ISSN 0267-6192

Abstract

Data transformation is the core process in migrating database from relational database to NoSQL database such as column-oriented database. However, there is no standard guideline for data transformation from relational database to NoSQL database. A number of schema transformation techniques have been proposed to improve data transformation process and resulted better query processing time when compared to the relational database query processing time. However, these approaches produced redundant tables in the resulted schema that in turn consume large unnecessary storage size and produce high query processing time due to the generated schema with redundant column families in the transformed column-oriented database. In this paper, an efficient data transformation technique from relational database to column-oriented database is proposed. The proposed schema transformation technique is based on the combination of denormalization approach, data access pattern and multiple-nested schema. In order to validate the proposed work, the proposed technique is implemented by transforming data from MySQL database to HBase database. A benchmark transformation technique is also performed in which the query processing time and the storage size are compared. Based on the experimental results, the proposed transformation technique showed significant improvement in terms query processing time and storage space usage due to the reduced number of column families in the column-oriented database.


Download File

Full text not available from this repository.
Official URL or Download Paper: https://www.techscience.com/csse/v43n3/47678

Additional Metadata

Item Type: Article
Divisions: Faculty of Computer Science and Information Technology
DOI Number: https://doi.org/10.32604/csse.2022.021969
Publisher: Tech Science Press
Keywords: Data migration; Data transformation; Column-oriented database; Relational database; Big data
Depositing User: Ms. Nur Faseha Mohd Kadim
Date Deposited: 18 Mar 2024 04:43
Last Modified: 18 Mar 2024 04:43
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.32604/csse.2022.021969
URI: http://psasir.upm.edu.my/id/eprint/100235
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item