Definitions
Hybrid transactional and analytical processing (HTAP) refers to system architectures and techniques that enable modern database management systems (DBMS) to perform real-time analytics on data that is ingested and modified in the transactional database engine. It is a term that was originally coined by Gartner where Pezzini et al. (2014) highlight the need of enterprises to close the gap between analytics and action for better business agility and trend awareness.
Overview
The goal of running transactions and analytics on the same data has been around for decades, but has not fully been realized due to technology limitations. Today, businesses can no longer afford to miss the real-time insights from data that is in their transactional system as they may lose competitive edge unless business decisions are made on latest data Footnote 1 or fresh data Footnote 2. As a...
This is a preview of subscription content, log in via an institution to check access.
Notes
- 1.
Analytics on latest data implies allowing the query to run on any desired level of isolations including dirty read, committed read, snapshot read, repeatable read, or serializable.
- 2.
Analytics on fresh data implies running queries on a recent snapshot of data that may not necessarily be the latest possible snapshot when the query execution began or a consistent snapshot.
References
Ailamaki A, DeWitt DJ, Hill MD, Skounakis M (2001) Weaving relations for cache performance. In: VLDB, pp 169–180
Alagiannis I, Idreos S, Ailamaki A (2014) H2O: a hands-free adaptive store. In: SIGMOD, pp 1103–1114
Appuswamy R, Karpathiotakis M, Porobic D, Ailamaki A (2017) The case for heterogeneous HTAP. In: CIDR
Arulraj J, Pavlo A, Menon P (2016) Bridging the archipelago between row-stores and column-stores for hybrid workloads. In: SIGMOD, pp 583–598
Barber R, Huras M, Lohman G, Mohan C, Mueller R, Özcan F, Pirahesh H, Raman V, Sidle R, Sidorkin O, Storm A, Tian Y, Tözun P (2016) Wildfire: concurrent blazing data ingest and analytics. In: SIGMOD’16, pp 2077–2080
Barber R, Garcia-Arellano C, Grosman R, Müller R, Raman V, Sidle R, Spilchen M, Storm AJ, Tian Y, Tözün P, Zilio DC, Huras M, Lohman GM, Mohan C, Özcan F, Pirahesh H (2017) Evolving databases for new-gen big data applications. In: Online Proceedings of CIDR
Dittrich J, Jindal A (2011) Towards a one size fits all database architecture. In: CIDR
Duggan J, Elmore AJ, Stonebraker M, Balazinska M, Howe B, Kepner J, Madden S, Maier D, Mattson T, Zdonik S (2015) The BigDAWG polystore system. SIGMOD Rec 44(2):11–16
Goel AK, Pound J, Auch N, Bumbulis P, MacLean S, Färber F, Gropengiesser F, Mathis C, Bodner T, Lehner W (2015) Towards scalable real-time analytics: an architecture for scale-out of OLxP workloads. PVLDB 8(12):1716–1727
Grund M, Krüger J, Plattner H, Zeier A, Cudré-Mauroux P, Madden S (2010) HYRISE – a main memory hybrid storage engine. In: PVLDB, pp 105–116
Hassan MS, Kuznetsova T, Jeong HC, Aref WG, Sadoghi M (2017) Empowering in-memory relational database engines with native graph processing. CoRR abs/1709.06715
Lahiri T, Chavan S, Colgan M, Das D, Ganesh A, Gleeson M, Hase S, Holloway A, Kamp J, Lee TH, Loaiza J, Macnaughton N, Marwah V, Mukherjee N, Mullick A, Muthulingam S, Raja V, Roth M, Soylemez E, Zait M (2015) Oracle database in-memory: a dual format in-memory database. In: ICDE, pp 1253–1258. https://doi.org/10.1109/ICDE.2015.7113373
Larson PA, Birka A, Hanson EN, Huang W, Nowakiewicz M, Papadimos V (2015) Real-time analytical processing with SQL server. PVLDB 8(12):1740–1751
Makreshanski D, Giceva J, Barthels C, Alonso G (2017) BatchDB: efficient isolated execution of hybrid OLTP+OLAP workloads for interactive applications. In: SIGMOD’17, pp 37–50
Najafi M, Sadoghi M, Jacobsen H (2015) The FQP vision: flexible query processing on a reconfigurable computing fabric. SIGMOD Rec 44(2):5–10
Najafi M, Zhang K, Sadoghi M, Jacobsen H (2017) Hardware acceleration landscape for distributed real-time analytics: virtues and limitations. In: ICDCS, pp 1938–1948
Neumann T, Mühlbauer T, Kemper A (2015) Fast serializable multi-version concurrency control for main-memory database systems. In: SIGMOD, pp 677–689
Pezzini M, Feinberg D, Rayner N, Edjali R (2014) Hybrid transaction/analytical porcessing will foster opportunities for dramatic business innovation. https:// www.gartner.com/doc/2657815/hybrid-transactionanal ytical-processing-foster-opportunities
Pilman M, Bocksrocker K, Braun L, Marroquín R, Kossmann D (2017) Fast scans on key-value stores. PVLDB 10(11):1526–1537
Pirk H, Funke F, Grund M, Neumann T, Leser U, Manegold S, Kemper A, Kersten ML (2013) CPU and cache efficient management of memory-resident databases. In: ICDE, pp 14–25
Plattner H (2009) A common database approach for OLTP and OLAP using an in-memory column database. In: SIGMOD, pp 1–2
Psaroudakis I, Wolf F, May N, Neumann T, Böhm A, Ailamaki A, Sattler KU (2014) Scaling up mixed workloads: a battle of data freshness, flexibility, and scheduling. In: TPCTC 2014, pp 97–112
Ramamurthy R, DeWitt DJ, Su Q (2002) A case for fractured mirrors. In: VLDB’02, pp 430–441
Sadoghi M, Ross KA, Canim M, Bhattacharjee B (2013) Making updates disk-I/O friendly using SSDs. PVLDB 6(11):997–1008
Sadoghi M, Canim M, Bhattacharjee B, Nagel F, Ross KA (2014) Reducing database locking contention through multi-version concurrency. PVLDB 7(13):1331–1342
Sadoghi M, Bhattacherjee S, Bhattacharjee B, Canim M (2016a) L-store: a real-time OLTP and OLAP system. CoRR abs/1601.04084
Sadoghi M, Ross KA, Canim M, Bhattacharjee B (2016b) Exploiting SSDs in operational multiversion databases. VLDB J 25(5):651–672
Sikka V, Färber F, Lehner W, Cha SK, Peh T, Bornhövd C (2012) Efficient transaction processing in SAP HANA database: the end of a column store myth. In: SIGMOD’12, pp 731–742
Stonebraker M, Cetintemel U (2005) “One size fits all”: an idea whose time has come and gone. In: ICDE, pp 2–11
Teubner J, Woods L (2013) Data processing on FPGAs. Synthesis lectures on data management. Morgan & Claypool Publishers, San Rafael
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this entry
Cite this entry
Giceva, J., Sadoghi, M. (2018). Hybrid OLTP and OLAP. In: Sakr, S., Zomaya, A. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_179-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-63962-8_179-1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-63962-8
Online ISBN: 978-3-319-63962-8
eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering
Publish with us
Chapter history
-
Latest
Hybrid Transactional and Analytical Processing- Published:
- 24 May 2022
DOI: https://doi.org/10.1007/978-3-319-63962-8_179-2
-
Original
Hybrid OLTP and OLAP- Published:
- 19 February 2018
DOI: https://doi.org/10.1007/978-3-319-63962-8_179-1