Abstract
The Blink project’s ambitious goals are to answer all Business Intelligence (BI) queries in mere seconds, regardless of the database size, with an extremely low total cost of ownership. It takes a very innovative and counter-intuitive approach to processing BI queries, one that exploits several disruptive hardware and software technology trends. Specifically, it is a new, workload-optimized DBMS aimed primarily at BI query processing, and exploits scale-out of commodity multi-core processors and cheap DRAM to retain a (copy of a) data mart completely in main memory. Additionally, it exploits proprietary compression technology and cache-conscious algorithms that reduce memory bandwidth consumption and allow most SQL query processing to be performed on the compressed data. Ignoring the general wisdom of the last three decades that the only way to scalably search large databases is with indexes, Blink always performs simple, “brute force” scans of the entire data mart in parallel on all nodes, without using any indexes or materialized views, and without any query optimizer to choose among them. The Blink technology has thus far been incorporated into two products: (1) an accelerator appliance product for DB2 for z/OS (on the “mainframe”), called the IBM Smart Analytics Optimizer for DB2 for z/OS, V1.1, which was generally available in November 2010; and (2) the Informix Warehouse Accelerator (IWA), a software-only version that was generally available in March 2011. We are now working on the next generation of Blink, called BLink Ultra, or BLU, which will significantly expand the “sweet spot” of Blink technology to much larger, disk-based warehouses and allow BLU to “own” the data, rather than copies of it.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ailamaki, A., DeWitt, D.J., Hill, M.D., Skounakis, M.: Weaving relations for cache performance. In: VLDB 2001, pp. 169–180 (2001)
Borkar, S., Chien, A.A.: The Future of Microprocessors. Comm. of the ACM 54(5), 67–77 (2011)
Beier, F., Stolze, K., Sattler, K.-U.: Autonomous Workload-driven Reorganization of MMDBS Data Structures. In: 6th International Workshop on Self-Managing Data Bases (SMDB 2011), Hanover, Germany (2011)
Boncz, P.A., Zukowski, M., Nes, N.: MonetDB/X100: Hyper-Pipelining Query Execution. In: CIDR 2005, pp. 225–237 (2005)
Grund, M., Krüger, J., Plattner, H., Zeier, A., Cudré-Mauroux, P., Madden, S.: HYRISE - A Main Memory Hybrid Storage Engine. PVLDB 4(2), 105–116 (2010)
Holloway, A.L., Raman, V., Swart, G., DeWitt, D.J.: How to barter bits for chronons: compression and bandwidth trade offs for database scans. In: SIGMOD 2007, pp. 389–400 (2007)
IBM Corp., IBM Smart Analytics Optimizer for DB2 for z/OS V1.1 User’s Guide, IBM Corp., Tech. Rep. (November 2010)
Johnson, R., Raman, V., Sidle, R., Swart, G.: Row-Wise Parallel Predicate Evaluation. In: VLDB 2008, pp. 622–634 (2008)
Kemper, A., Neumann, T.: HyPer: A hybrid OLTP&OLAP main memory database system based on virtual memory snapshots. In: ICDE 2011, pp. 195–206 (2011)
Qiao, L., Raman, V., Reiss, F., Haas, P., Lohman, G.: Main-Memory Scan Sharing for Multi-core CPUs. In: VLDB 2008 (2008)
Raman, V., Swart, G.: How to wring a table Dry: Entropy Compression of Relations and Querying Compressed Relations. In: VLDB 2006 (2006)
Raman, V., Swart, G., Qiao, L., Reiss, F., Dialani, V., Kossmann, D., Narang, I., Sidle, R.: Constant-time Query Processing. In: ICDE 2008, pp. 60–69 (2008)
Stonebraker, M., Abadi, D.J., Batkin, A., Chen, X., Cherniack, M., Ferreira, M., Lau, E., Lin, A., Madden, S., O’Neil, E.J., O’Neil, P.E., Rasin, A., Tran, N., Zdonik, S.B.: C-Store: A Column-oriented DBMS. In: VLDB 2005, pp. 553–564 (2005)
Stolze, K., Beier, F., Sattler, K.-U., Sprenger, S., Grolimund, C.C., Czech, M.: Architecture of a Highly Scalable Data Warehouse Appliance Integrated to Mainframe Database Systems. In: Database Systems for Business, Technology, and the Web (BTW 2011) (2011)
Schmuck, F., Haskin, R.: GPFS: A Shared-Disk File System for Large Computing Clusters. In: FAST 2002: Proceedings of the 1st USENIX Conference on File and Storage Technologies, pp. 19–29. USENIX Association, Berkeley (2002)
http://www.sigmod.org/publications/sigmod-record/1109/pdfs/08.industry.inkster.pdf
http://www.vertica.com/wpcontent/uploads/2011/01/VerticaArchitectureWhitePaper.pdf
Willhalm, T., Popovici, N., Boshmaf, Y., Plattner, H., Zeier, A., Schaffner, J.: SIMD-Scan: Ultra Fast in-Memory Table Scan using on-Chip Vector Processing Units. In: PVLDB 2009, pp. 385–394 (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Barber, R. et al. (2012). Blink: Not Your Father’s Database!. In: Castellanos, M., Dayal, U., Lehner, W. (eds) Enabling Real-Time Business Intelligence. BIRTE 2011. Lecture Notes in Business Information Processing, vol 126. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33500-6_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-33500-6_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33499-3
Online ISBN: 978-3-642-33500-6
eBook Packages: Computer ScienceComputer Science (R0)