Please use this identifier to cite or link to this item:
https://www.um.edu.mt/library/oar/handle/123456789/93706| Title: | HTAP with reactive streaming ETL |
| Authors: | Vella, Joseph G. Nezval, Vitezslav Camilleri, Carl |
| Keywords: | OLAP technology Database management Transaction systems (Computer systems) Linked data Databases Processing (Computer program language) |
| Issue Date: | 2021 |
| Publisher: | IGI Global |
| Citation: | Camilleri, C., Vella, J. G., & Nezval, V. (2021). HTAP with reactive streaming ETL. Journal of Cases on Information Technology (JCIT), 23(4), 1-19. |
| Abstract: | In database management systems (DBMSs), query workloads can be classified as online transactional processing (OLTP) or online analytical processing (OLAP). These often run within separate DBMSs. In hybrid transactional and analytical processing (HTAP), both workloads may execute within the same DBMS. This article shows that it is possible to run separate OLTP and OLAP DBMSs and still support timely business decisions from analytical queries running off fresh transactional data. Several setups to manage OLTP and OLAP workloads are analysed. Then, benchmarks on two industry standard DBMSs empirically show that, under an OLTP workload, a row-store DBMS sustains a 1000 times higher throughput than a columnar DBMS, whilst OLAP queries are more than four times faster on a columnar DBMS. Finally, a reactive streaming ETL pipeline is implemented which connects these two DBMSs. Separate benchmarks show that OLTP events can be streamed to an OLAP database within a few seconds. |
| URI: | https://www.um.edu.mt/library/oar/handle/123456789/93706 |
| Appears in Collections: | Scholarly Works - FacICTCIS |
Files in This Item:
| File | Description | Size | Format | |
|---|---|---|---|---|
| HTAP_with_reactive_streaming_ETL(2021).pdf | 2.29 MB | Adobe PDF | View/Open |
Items in OAR@UM are protected by copyright, with all rights reserved, unless otherwise indicated.