Description
Leader of the group Database Architectures: Stefan Manegold.
We, the Database Architectures (DA) research group of CWI, are well known as a top data systems research group, active in the broad area of data (management) systems and infrastructure for supporting data science. Our research group has a strong international reputation in academia and industry for pioneering column store technology, fast compression methods, vectorized query execution, on-line query-driven indexing (cracking), adaptive caching, and integration of statistical languages and analysis in database management systems.
We develop, distribute and maintain the MonetDB open-source system, and we have spawned multiple spin-off companies, including Data Distilleries, VectorWise and MonetDB Solutions. Our team also operates a self-built cluster, SciLens, that – unlike many other computer clusters – is bandwidth-optimized and thus better suited as a data-science infrastructure. We pride ourselves on revealing the real problems in our discipline and coming up with revolutionary solutions that are frequently ahead of their time.
Vacancies
PhD Students in the areas of Big Data Management and Analysis Architectures and Data Science Engineering Technologies
Three fully funded PhD positions are available to work under the direction of prof. Stefan Manegold on big data management technology with a particular focus on hardware-conscious data structures and algorithms in distributed and cloud environments as well as the integration of data mining and machine learning into large-scale data management systems.
News
CWI-spin-off Dataspex biedt big data-oplossingen voor de astronomie
Centrum Wiskunde & Informatica (CWI) heeft een nieuwe spin-off gelanceerd: Dataspex. Het nieuwe bedrijf biedt big data management-oplossingen voor de astronomie.
Mark Raasveldt wins Student Research Competition at SIGMOD 2018
Mark Raasveldt, PhD student at CWI’s Database Architecture (DA) group, won the Student Research Competition at the SIGMOD 2018 conference for his work titled "MonetDBLite: An Embedded Analytical Database".
Hardman new chair Amsterdam Data Science, Boncz joins Supervisory Board
As of January 2018, CWI researcher Lynda Hardman is the new chair of the management team of Amsterdam Data Science. Peter Boncz, CWI researcher and part of the CWI management team, will join the ADS Supervisory Board.
CWI Database Architecture researchers awarded with best paper runner up award at SSDBM
Researchers of CWI's Database Architecture group have been awarded with a best paper runner up award at 29th International Conference on Scientific and Statistical Database Management (SSDBM 2017) in Chicago. The researchers received the award for their paper 'Multi Hypothesis CSV-parsing' by authors Till Döhmen, Hannes Mühleisen and Peter Boncz.
Members
Associated Members
Publications
-
Raasveldt, M, & Mühleisen, H.F. (2020). Data Management for Data Science - Towards Embedded Analytics. In Proceedings of the Conference on Innovative Data Systems Research.
-
Holanda, P.T, Raasveldt, M, Manegold, S, & Mühleisen, H.F. (2019). Progressive Indexes: Indexing for interactive data analysis. Proceedings of the VLDB Endowment, 12(13), 2366–2378. doi:10.14778/3358701.3358705
-
Kruit, B.B, Boncz, P.A, & Urbani, J. (2019). Extracting novel facts from tables for Knowledge Graph completion. In Proceedings of ISWC 2019 (pp. 364–381). doi:10.1007/978-3-030-30793-6_21
-
Lang, H, Passing, L.K, Kipf, A, Boncz, P.A, Neumann, T, & Kemper, A. (2019). Make the most out of your SIMD investments: counter control flow divergence in compiled query pipelines. VLDB Journal. doi:10.1007/s00778-019-00547-y
-
Holanda, P.T, & Mühleisen, H.F. (2019). Relational queries with a tensor processing unit. In Proceedings of the 15th International Workshop on Data Management on New Hardware. doi:10.1145/3329785.3329932
-
Uta, A, Ghit, B, Dave, A, & Boncz, P.A. (2019). [Demo] Low-latency spark queries on updatable data. In Proceedings of the ACM SIGMOD International Conference on Management of Data (pp. 2009–2012). doi:10.1145/3299869.3320227
-
De Leo, D, & Boncz, P.A. (2019). Packed Memory Arrays – Rewired. In Proceedings of the IEEE International Conference on Data Engineering (ICDE) (pp. 830–841). doi:10.1109/ICDE.2019.00079
-
Raasveldt, M, Holanda, P.T, & Manegold, S. (2019). DevUDf: Increasing UDF development efficiency through IDE integration. It works like a PyCharm!. In Proceedings of the International Conference on Extending Database Technology (pp. 558–561). doi:10.5441/002/edbt.2019.55
-
Kipf, A, Kipf, T, Radke, B, Leis, V, Boncz, P.A, & Kemper, A. (2019). Learned cardinalities: Estimating correlated joins with deep learning. In CIDR 2019 - 9th Biennial Conference on Innovative Data Systems Research.
-
Bereta, K, Koubarakis, M, Manegold, S, Stamoulis, G, & Demir, B. (2018). From big data to big information and big knowledge: The case of Earth observation data. In Proceedings of the International Conference on Information and Knowledge Management (CIKM) (pp. 2293–2294). doi:10.1145/3269206.3274270
Software
MonetDB: high-performance query processing against very large databases
MonetDB is a relational database management system (DBMS) providing high performance on complex queries against large databases.
Current projects with external funding
-
RelationalAI-CWI Research Agreement ()
-
Actian Research Grant II (ACTIAN II)
-
Cross-Industry Predictive Maintenance Optimization Platform (CIMPLO)
-
Data Mining on High Volume Simulation Output (DAMIOSO)
-
Databricks CWI Research Agreement (Databricks)
-
Facebook Research Grant (Facebook)
-
Min.VWS Bestrijding Covid-19
-
Research agreeement CWI - Databricks - vervolg contract (None)
-
Process mining for multi-objective online control (PROMIMOOC)
-
The SciLens-II Infrastructure, Big Data at work (Scilens-II)
-
Structure-aware Querying & Information Retrieval on Evolving Large Graphs (SQIREL-GRAPHS)
Related partners
-
Actian Corporation
-
BMW Munich
-
Databricks
-
LIACS Institute
-
MonetDB B.V.
-
Neo Technology AB
-
OBI4wan B.V.
-
RelationalAI
-
Spinque
-
Tata Steel
-
WizeNoze B.V.
-
Facebook
-
Ministerie van Volksgezondheid, Welzijn en Sport