About
The goal of the ERIS project is to construct a highly adaptive in-memory storage engine that is able to scale-up on modern and future single-box server systems that expose massive NUMA effects. To achieve these goals, ERIS is designed in a modular way. The core component is the storage engine that is programmable via a low-level programming interface, which is based on C++ that is enhanced by specialized library functions. On top of this programming interface, users can run several domain-specific langages (DSL) such as the traditional declarative SQL. To cope with the variety of data formats of todays applications, ERIS allows to plug-in additional storage format modules to ensure that the data of different data models can be stored an processed efficiently.
Another central requirement of modern applications is the ability of a data management platform to adapt itself when being exposed to changing workloads. Thus, ERIS offers multiple adaptivity facilities. First, ERIS allows resource adaptivity, which allows the storage engine to be elastic at runtime (e.g., switching off cores or adjust core frequencies) to save computation power and to enable energy efficiency as well as proportionality. As a second form of adaptivity, ERIS allows to adapt the placement of data at runtime to actively colocate data and computation resources. Finally, ERIS allows storage adaptivty meaning that the storage format of data objects can be exchanged at runtime to adapt the storage engine to current needs of the workload. All adaptivity instruments are controlled via a control loop, which is based on the concept of a reactive control loop. The control loop monitors the storage engine and decides how to adapt the system.
Traditional database systems usually rely on a transaction-oriented architecture (TORA). On such an architecture, data objects are accessed concurrently by different transctions and require a high latching overhead to be synchronized. Another negative asapect of the TORA approach is that the actual data of data objects is scattered over the multiple memory banks of NUMA systems, which causes a high number of remote memory accesses that face costs in terms of a reduced memory bandwidth and an increased memory latency.
To cope with those NUMA effects, which are likely to become an escalating problem on server systems, ERIS is based on a data-oriented architecture (DORA), where each hardware thread runs an Autonomnous Execution Unit (AEU) that is exclusively responsible for disjoint partitions of data objects. Using this approach, computation resources run on the same socket as tha data is located on and data object partitions do not need to be synchronized. However, such an approach requires advanced communication between the individual AEUs as well as an agile partitioning scheme to cope with varying workloads.
Project Website
Open Student Topics
- Beleg/Bachelor/Diplom/Master: Evaluation of GRU Acceleration for Message Passing on SGI UV Systems.The SGI UV platform is a massively parallel server system consisting of 64+ sockets with a hundrets of CPU cores in total. Such a platform exhibits strong NUMA effects, which add high costs for transferring data from one socket to another depending on the distance between them. The goal of this thesis is to leverage the GRU acceleration protocol of the SGI UV platform to increase throughput and decrease the latency of the message passing system of ERIS.
- Beleg/Bachelor/Diplom/Master: Evaluation of Access Pathes for Flexible Storage ArchitecturesERIS implelemts a flexible storage manager that is able to orchestrate several access pathes on a partition level. This storage manager depends on a high variety of available access path modules to choose the best storage configuration for the current workload of the system. The goal of this thesis is to implement additional access path modules and to evaluate and predict their performance for varying data characteristics.
- Weitere Themen auf Anfrage (thomas.kissinger@tu-dresden.de)
Related Student Theses
Optimierung der ERIS-Datenbank durch das Global Register Unit.
Eric Lübke June 5th, 2016 until March 28th, 2017
Diplom ThesisSupervision: Thomas Kissinger, Dirk Habich
Lightweight compression algorithms and interfaces for flexible storage architectures
Paul Peschel July 1st, 2015 until January 9th, 2015
Master ThesisSupervision: Thomas Kissinger, Patrick Damme
@article{,
author = {Wolfgang Lehner and Dirk Habich and Thomas Kissinger and Annett Ungeth\"{u}m},
title = {Energy Elasticity on Heterogeneous Hardware using Adaptive Resource Reconfiguration LIVE},
booktitle = {Proceedings of the 2016 International Conference on Management of Data, SIGMOD Conference 2016, San Francisco, CA, USA, June 26 - July 01, 2016},
year = {2016},
isbn = {978-1-4503-3531-7},
pages = {2173--2176},
url = {http://doi.acm.org/10.1145/2882903.2899390},
publisher = {\"{o}zcan, Fatma; Koutrika, Georgia \& Madden, Sam}
}@article{,
author = {Dirk Habich and Johannes Luong and Thomas Kissinger and Wolfgang Lehner},
title = {Towards Programmability of a NUMA-Aware Storage Engine},
booktitle = {Proceedings of the LWA 2015 Workshops: KDML, FGWM, IR, and FGDB, Trier, Germany, October 7-9, 2015.},
series = {CEUR Workshop Proceedings},
volume = {1458},
year = {2015},
pages = {391--402},
url = {http://ceur-ws.org/Vol-1458/H01_CRC78_Habich.pdf},
publisher = {Bergmann, Ralph; G\"{o}rg, Sebastian \& M\"{u}ller, Gilbert}
}@article{,
author = {Wolfgang Lehner and Dirk Habich and Thomas Kissinger},
title = {Plan Operator Specialization using Reflective Compiler Techniques},
booktitle = {Datenbanksysteme f\"{u}r Business, Technologie und Web (BTW), 16. Fachtagung des GI-Fachbereichs Datenbanken und Informationssysteme"' (DBIS)},
volume = {241},
year = {2015},
isbn = {978-3-88579-635-0},
pages = {363--382},
url = {http://subs.emis.de/LNI/Proceedings/Proceedings241/article8.html}
}@article{,
author = {Ismail Oukid and Wolfgang Lehner and Thomas Kissinger and Thomas Willhalm and Peter Bumbulis},
title = {Instant Recovery for Main Memory Databases},
booktitle = {CIDR 2015, Seventh Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 4-7, 2015. Online Proceedings},
year = {2015},
url = {http://www.cidrdb.org/cidr2015/Papers/CIDR15_Paper13.pdf}
}@article{,
author = {Wolfgang Lehner},
title = {Cache-Efficient Aggregation: Hashing Is Sorting},
booktitle = {Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data, Melbourne, Victoria, Australia, May 31 - June 4, 2015},
year = {2015},
isbn = {978-1-4503-2758-9},
pages = {1123--1136},
url = {http://doi.acm.org/10.1145/2723372.2747644},
publisher = {Sellis, Timos K.; Davidson, Susan B. \& Ives, Zachary G.}
}@article{,
author = {Till Kolditz and Thomas Kissinger and Benjamin Schlegel and Dirk Habich and Wolfgang Lehner},
title = {Online bit flip detection for in-memory B-trees on unreliable hardware},
booktitle = {Proceedings of the Tenth International Workshop on Data Management on New Hardware},
series = {DaMoN '14},
year = {2014},
month = {6},
isbn = {978-1-4503-2971-2},
location = {Snowbird, Utah},
pages = {5},
numpages = {9},
url = {http://doi.acm.org/10.1145/2619228.2619233},
acmid = {2619233},
publisher = {ACM},
address = {New York, NY, USA}
}@article{,
author = {Oliver Arnold and Sebastian Haas and Gerhard Fettweis and Benjamin Schlegel and Thomas Kissinger and Tomas Karnagel and Wolfgang Lehner},
title = {HASHI: An Application Specific Instruction Set Extension for Hashing},
booktitle = {International Workshop on Accelerating Data Management Systems Using Modern Processor and Storage Architectures - ADMS 2014, Hangzhou, China, September 1, 2014.},
year = {2014},
pages = {25--33},
url = {http://www.adms-conf.org/2014/adms14_arnold.pdf},
publisher = {Bordawekar, Rajesh; Lahiri, Tirthankar; Gedik, Bugra \& Lang, Christian A.}
}@article{,
author = {Wolfgang Lehner and Dirk Habich and Benjamin Schlegel and Thomas Kissinger and Tim Kiefer},
title = {ERIS: A NUMA-Aware In-Memory Storage Engine for Analytical Workload},
booktitle = {International Workshop on Accelerating Data Management Systems Using Modern Processor and Storage Architectures - ADMS 2014, Hangzhou, China, September 1, 2014.},
year = {2014},
pages = {74--85},
url = {http://www.adms-conf.org/2014/adms14_kissinger.pdf},
publisher = {Bordawekar, Rajesh; Lahiri, Tirthankar; Gedik, Bugra \& Lang, Christian A.}
}@article{,
author = {Wolfgang Lehner and Thomas Kissinger},
title = {Energy-Efficient Databases Using Sweet Spot Frequencies},
booktitle = {Proceedings of the 7th IEEE/ACM International Conference on Utility and Cloud Computing, UCC 2014, London, United Kingdom, December 8-11, 2014},
year = {2014},
isbn = {978-1-4799-7881-6},
pages = {871--876},
url = {http://dx.doi.org/10.1109/UCC.2014.142}
}@article{,
author = {Wolfgang Lehner and Thomas Kissinger},
title = {Dynamic fine-grained scheduling for energy-efficient main-memory queries},
booktitle = {Tenth International Workshop on Data Management on New Hardware, DaMoN 2014, Snowbird, UT, USA, June 23, 2014},
year = {2014},
isbn = {978-1-4503-2971-2},
pages = {1},
url = {http://doi.acm.org/10.1145/2619228.2619229},
publisher = {Kemper, Alfons \& Pandis, Ippokratis}
}@article{,
author = {Wolfgang Lehner and Benjamin Schlegel and Thomas Kissinger},
title = {An application-specific instruction set for accelerating set-oriented database primitives},
booktitle = {International Conference on Management of Data, SIGMOD 2014, Snowbird, UT, USA, June 22-27, 2014},
year = {2014},
isbn = {978-1-4503-2376-5},
pages = {767--778},
url = {http://doi.acm.org/10.1145/2588555.2593677},
publisher = {Dyreson, Curtis E.; Li, Feifei \& \"{o}zsu, M. Tamer}
}@article{,
author = {Wolfgang Lehner and Hannes Voigt and Thomas Kissinger},
title = {SMIX: self-managing indexes for dynamic workloads},
booktitle = {Conference on Scientific and Statistical Database Management, SSDBM '13, Baltimore, MD, USA, July 29 - 31, 2013},
year = {2013},
isbn = {978-1-4503-1921-8},
url = {http://doi.acm.org/10.1145/2484838.2484862},
publisher = {Szalay, Alex; Budavari, Tamas; Balazinska, Magdalena; Meliou, Alexandra \& Sacan, Ahmet}
}@article{,
author = {Wolfgang Lehner and Dirk Habich and Benjamin Schlegel and Thomas Kissinger},
title = {Query processing on prefix trees live},
booktitle = {Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD 2013, New York, NY, USA, June 22-27, 2013},
year = {2013},
isbn = {978-1-4503-2037-5},
pages = {1105--1108},
url = {http://doi.acm.org/10.1145/2463676.2463682},
publisher = {Ross, Kenneth A.; Srivastava, Divesh \& Papadias, Dimitris}
}@article{,
author = {Wolfgang Lehner and Dirk Habich and Benjamin Schlegel and Thomas Kissinger},
title = {QPPT: Query Processing on Prefix Trees},
booktitle = {CIDR 2013, Sixth Biennial Conference on Innovative Data Systems Research, Asilomar, CA, USA, January 6-9, 2013, Online Proceedings},
year = {2013},
url = {http://www.cidrdb.org/cidr2013/Papers/CIDR13_Paper3.pdf}
}@article{,
author = {Wolfgang Lehner and Benjamin Schlegel and Thomas Kissinger and Tim Kiefer},
title = {pcApriori: scalable apriori for multiprocessor systems},
booktitle = {Conference on Scientific and Statistical Database Management, SSDBM '13, Baltimore, MD, USA, July 29 - 31, 2013},
year = {2013},
isbn = {978-1-4503-1921-8},
url = {http://doi.acm.org/10.1145/2484838.2484879},
publisher = {Szalay, Alex; Budavari, Tamas; Balazinska, Magdalena; Meliou, Alexandra \& Sacan, Ahmet}
}@article{,
author = {Wolfgang Lehner and Hannes Voigt and Tobias J\"{a}kel and Thomas Kissinger},
title = {Pack Indexing for Time-Constrained In-Memory Query Processing},
booktitle = {Datenbanksysteme f\"{u}r Business, Technologie und Web (BTW), 15. Fachtagung des GI-Fachbereichs Datenbanken und Informationssysteme"' (DBIS)},
volume = {214},
year = {2013},
isbn = {978-3-88579-608-4},
pages = {149--163},
url = {http://www.btw-2013.de/proceedings/Pack\%20Indexing\%20for\%20TimeConstrained\%20InMemory\%20Query\%20Processing.pdf}
}@article{,
author = {Wolfgang Lehner and Dirk Habich and Thomas Kissinger},
title = {BUZZARD: a NUMA-aware in-memory indexing system},
booktitle = {Proceedings of the ACM SIGMOD International Conference on Management of Data, SIGMOD 2013, New York, NY, USA, June 22-27, 2013},
year = {2013},
isbn = {978-1-4503-2037-5},
pages = {1285--1286},
url = {http://doi.acm.org/10.1145/2463676.2465342},
publisher = {Ross, Kenneth A.; Srivastava, Divesh \& Papadias, Dimitris}
}
A high-throughput in-memory index, durable on flash-based SSD: insights into the winning solution of the SIGMOD programming contest 2011.
@article{,
author = {Wolfgang Lehner and Dirk Habich and Benjamin Schlegel and Thomas Kissinger and Matthias B\"{o}hm},
title = {A high-throughput in-memory index, durable on flash-based SSD: insights into the winning solution of the SIGMOD programming contest 2011},
journal = {SIGMOD Record},
volume = {41},
year = {2012},
pages = {44--50},
url = {http://doi.acm.org/10.1145/2380776.2380788}
}@article{,
author = {Wolfgang Lehner and Hannes Voigt and Thomas Kissinger},
title = {SMIX Live \&\#8211; A Self-Managing Index Infrastructure for Dynamic Workloads},
booktitle = {IEEE 28th International Conference on Data Engineering (ICDE 2012), Washington, DC, USA (Arlington, Virginia), 1-5 April, 2012},
year = {2012},
isbn = {978-0-7695-4747-3},
pages = {1225--1228},
url = {http://dx.doi.org/10.1109/ICDE.2012.9},
publisher = {Kementsietsidis, Anastasios \& Salles, Marcos Antonio Vaz}
}@article{,
author = {Wolfgang Lehner and Dirk Habich and Benjamin Schlegel and Thomas Kissinger},
title = {KISS-Tree: smart latch-free in-memory indexing on modern architectures},
booktitle = {Proceedings of the Eighth International Workshop on Data Management on New Hardware, DaMoN 2012, Scottsdale, AZ, USA, May 21, 2012},
year = {2012},
isbn = {978-1-4503-1445-9},
pages = {16--23},
url = {http://doi.acm.org/10.1145/2236584.2236587},
publisher = {Chen, Shimin \& Harizopoulos, Stavros}
}@article{,
author = {Wolfgang Lehner and Hannes Voigt and Tobias J\"{a}kel and Thomas Kissinger},
title = {Adaptive Index Buffer},
booktitle = {Workshops Proceedings of the IEEE 28th International Conference on Data Engineering, ICDE 2012, Arlington, VA, USA, April 1-5, 2012},
year = {2012},
isbn = {978-1-4673-1640-8},
pages = {308--314},
url = {http://dx.doi.org/10.1109/ICDEW.2012.39},
publisher = {Kementsietsidis, Anastasios \& Salles, Marcos Antonio Vaz}
}
