Thursday, March 31, 2016

Tableau has acquired HyPer high performance database system

Tableau has announced the acquisition of HyPer, in-memory, high performance database system designed for simultaneous, high performance OLTP and OLAP processing.

Hyper high-performance database system will be integrated into Tableau’s product offerings and bring a host of new capabilities to Tableau customers such as faster analysis of large data sizes, richer analytics, enhanced data integration and data transformation as well as support for semi-structured and unstructured data.

Tableau is highly optimized and works quite fast in many applications but in applications where you need to read large volumes of data, like hundreds of millions or billions of rows, it can get dramatically slow (yes there are some illustrations of Tableau with large datasets but they are very isolated, single report demos and in a real life dashboard things can get pretty slow if you need to reaf more than 100 million rows). There are some other tools also available in the market with native Tableau data connections. Most notable and famous of these is EXASOL in-memory analytic database management software.

Like Tableau, HyPer grew out of a research project. started in 2010 by professors Dr. Thomas Neumann and Dr. Alfons Kemper, chair of at the Technical University of Munich (TUM) Database Group. Four of the project’s Ph.D. students, Tobias Muehlbauer, Wolf Roediger, Viktor Leis and Jan Finis, will join the Tableau family, focused on integrating Hyper into Tableau products.[1]

Here is a detailed definition of Tableau's new HyPer in the project website :

"HyPer is a main-memory-based relational DBMS for mixed OLTP and OLAP workloads. It is a so-called all-in-one New-SQL database system that entirely deviates from classical disk-based DBMS architectures by introducing many innovative ideas including machine code generation for data-centric query processing and multi-version concurrency control, leading to exceptional performance. HyPer’s OLTP throughput is comparable or superior to dedicated transaction processing systems and its OLAP performance matches the best query processing engines — however, HyPer achieves this OLTP and OLAP performance simultaneously on the same database state. Current research focuses on extending HyPer’s functionality beyond OLTP and OLAP processing to exploratory workflows that are deeply integrated into the database kernel by utilizing HyPer’s pioneering compilation infrastructure."[2]

Tableau HyPer high performance database system


[1] - Welcome, Hyper team, to the Tableau community!
[2] - http://hyper-db.com/