Skip to main content

Holistic Benchmarking of Big Linked Data

Deliverables

D1.1.1 Preliminary community member list, use cases, and datasets

This document details the preliminary state of the community, listing which parties are involved and which parties have expressed interest. It categorizes possible use cases, mentioning the interested parties. Use cases are linked to a list of datasets, which describes their contents, purpose, size, and expected growth. This document serves as a basis for further discussion and growth of the community, and as a precursor of the intermediary document D1.1.2.

D9.2.1 Annual Public Report of the first year

Report on the project’s progress, targeting the general public. The report will focus on the impact of the conducted work as well as exemplifying the contribution and importance of the HOBBIT project towards facing these challenges during the first year.

D8.2 First dissemination report

After the first half of the project we will summarize the dissemination work and evaluated our efforts against the defined KPIs. In case we do not achieve our goals, we strive to develop suitable methods to reach our objects until project end.

D7.3.1 First challenge results overview

This deliverable is the overview report of the first campaign, which will present the best technologies developed during this campaign and summarize the main outcomes and achievements.

D1.3.2 Final Association mission statement and business scenarios

When the formation of the association is coming to a conclusion, a final version of the mission statement is to be released, detailing a) how the association will continue after the end of the project and b) how the association intends to be self-sustaining. In order to substantiate point b), 3 to 5 business scenarios will be analyzed with a concrete implementation plan using the benchmarking platform.

D2.1 Detailed Architecture of the HOBBIT Platform

This deliverable will be a report that will describe the results of T2.1. The architecture of the HOBBIT platform as well as the technologies used to ensure variable and scalable deployment will be described in detail in this paper. Moreover, the structure of the code repository for the platform will be explained. This will ensure that third-party contributions can be made early on in the project

D1.4 Reachout Strategy Plan

Setting up the association in T1.3 requires finding the right members, which will be contacted early on in the project. This document will describe concrete strategies the partners will use to attract members for the association. In particular, we consider two types of strategies. On the one hand, we want to participate in and promote existing challenges, in which medium and large companies are involved. On the other hand, we want to integrate challenge datasets into the HOBBIT platform, and launch open calls towards industry and academia to stimulate the usage of these datasets. Potential users can be convinced by providing temporary free access to the platform, as well as technical support.

D9.2.2 Annual Public Report of the second year

Report on the project’s progress, targeting the general public. The report will focus on the impact of the conducted work as well as exemplifying the contribution and importance of the HOBBIT project towards facing these challenges during the second year.

D1.1.3 Final community member list, use cases, and datasets

At the end of T1.1, the community will have matured sufficiently to generate an updated version of D1.1.2 with the final list of members, use cases, and datasets. Based on the feedback of the first review, we will compile the finalized version of the document. A dedicated section will specify differences from D1.1.2, in particular whether parties who expressed interest have joined and what their motivations were for (not) doing so. Any new use cases will satisfy the same requirements as in D1.1.2.

D2.3.2 Second Maintenance and Update report of the HOBBIT Platform

The second maintenance reports will summarize the execution of the second series of challenges from the perspective of the deployed platform. The focus will be on a careful analysis of the measures for the platform and the suggestions for future extensions of the platform.

D8.4 Standardization report

In a short report, we sum up our observations regarding related standardization efforts (T8.3) and potential support on the part of HOBBIT.

D7.4 Second workshop proceedings

This deliverable includes the workshop proceedings for the second campaign.

D1.2.2 Requirements specification from the association

One of the initial tasks of the association is to decide to what extent the requirements from D1.2.1 are relevant for the next phase. Furthermore, the existence of a prototype will allow to verify how the requirements of D.1.2.1 have been translated into practice, allowing a) adjustments where necessary b) the identification of additional requirements that were not considered at first by the community.

D7.2.2 Second workshop organization report

This deliverable includes a report focusing on the organization of the workshops.

D1.1.2 Intermediate community member list, use cases, and datasets

Based on the discussion on the preliminary version of the document (D.1.1.1), we incorporate feedback from the different partners to produce an intermediary community list that will serve as direct input for the first review. Each of the use cases will be validated and supported by at least two other members beside the use case submitter, in order to identify those use cases with maximum impact. All considered datasets will be validated in at least two use cases, and it will be clear how they can be obtained, and what the considerations are (privacy, license, practical usage aspects).

D7.2 First workshop proceedings

This deliverable includes the workshop proceedings for the first campaign.

D7.1.3 Second Preparations report

This deliverable presents the state of the preparations for the organization of the second series of evaluation campaigns and the second series of workshops (i.e., provide the number of interested parties for the challenge, baseline results etc.) including the preparations for the proceedings of the second series of workshops. The report will also cover an overview of second evaluations of the platform for its use in the challenges.

D8.3 Final dissemination report

With the project end, will summarize all dissemination efforts and verify them against the defined KPIs. All these information are included in the final dissemination report.

D7.2.1 First workshop organization report

This deliverable includes a report focusing on the organization of the workshops.

D7.4.2 Second challenge evaluation

This deliverable will summarize the evaluation of the second campaign and their organization, based on participants reviews.

D7.4.1 First challenge evaluation

This deliverable will summarize the evaluation of the first campaign and their organization, based on participants reviews.

D1.2.1 Requirements specification from the community

The community documents the desired specifications for the benchmarking platform, based on joint discussions, and in particular the F2F meeting around M4. This serves as a direct input for T2.2 in which the first iteration of the platform is built.

D9.1 Project Management Plan

The core management handbook and structure that will provide guidelines for the project manager and the project members to follow during the full cycle of the project. The handbook will set out the governance, project calendar, cluster and work package description and reporting roles and responsibilities for all partners. Moreover, it will define the communication mechanisms for the project’s partners and the templates for reporting and formal communication of the project’s activities and outcomes.

D1.3.1 Preliminary Association mission statement and business scenarios

Before the association starts in M25, an initial mission statement is to be released, outlining a strategy for how the association intends to continue after the end of the project. At least 3 business scenarios will be analyzed, and a direction will be indicated for how the association can handle them. Each scenario will be analyzed pertaining to strengths, weaknesses, opportunities, and threats. The scenarios are to be supported by datasets in the HOBBIT platform (D1.1.2).

D7.3.2 Second challenge results overview

This deliverable is the overview report of the second campaign, which will present the best technologies developed during this campaign and summarize the main outcomes and achievements.

D9.2.3 Annual Public Report of the third year

Report on the project’s progress, targeting the general public. The report will focus on the impact of the conducted work as well as exemplifying the contribution and importance of the HOBBIT project towards facing these challenges during the third year.

D9.3 Quality Assurance & Risk Assessment Plan

It will incorporate details on the quality assurance processes adopted within the HOBBIT project. It will define all processes and instruments to be used for the regular quality monitoring and risk assessment in the form of a handbook for project partners.

D7.1 First Preparations report

This deliverable presents the state of the preparations for the organization of the first series of evaluation campaigns and the first series of workshops (i.e., provide the number of interested parties for the challenge, baseline results etc.) including the preparations for the proceedings of the first series of workshops. The report will also cover an overview of first evaluations of the platform for its use in the challenges.

D2.3.1 First Maintenance and Update report of the HOBBIT Platform

The first of two maintenance reports will summarize the execution of the first series of challenges from the perspective of the deployed platform. Bottlenecks (if any) will be identified and mitigation solutions will be presented. Analysis results (number of tasks carried out, throughput for different benchmarks, etc.) will be presented and summarize the performance of the platform.

D3.1.2 Second Version of the Data Extraction Benchmark for Sensor Data

This deliverable will describe the second version of the extraction benchmark for semi-structured sensor data streams. Moreover, improved baseline implementations provided by HOBBIT will be presented.

D4.1.2 Second version of the linking benchmark

This deliverable will describe the second version of the linking benchmark for linked data with time series. Improved baseline implementations provided by HOBBIT will be presented.

D5.2.1 First version of the Versioning Benchmark

This deliverable will describe the first version of the versioning benchmark for linked data with time series. Baseline implementations provided by HOBBIT will be presented.

D4.2.1 First version of the data analytics benchmark

This deliverable will describe the first version of the data analytics benchmark for the structured machine learning benchmark. Baseline implementations provided by HOBBIT will be presented.

D6.2.1 First Version of the Faceted Browsing Benchmark

This deliverable will describe the first version of the faceted browsing benchmark for combinations of geospatial, temporal and structured data streams. Moreover, baseline implementations provided by HOBBIT will be presented.

D4.2.2 Second version of the data analytics benchmark

This deliverable will describe the second version of the data analytics benchmark for the structured machine learning benchmark. Baseline implementations provided by HOBBIT will be presented.

D2.2.2 Second version of the HOBBIT Platform

This report will be the second of two software reports for the HOBBIT platform. Like in the first report, we will make the software and its code available online as well as provide a text report presenting the updated structure of the platform. The user manual for the integration of novel benchmarks will be extended with an updated evaluation. The report will be used as a manifesto by the HOBBIT organization (see WP1) to invite more parties into the organization.

D5.1.2 Second version of the Data Storage Benchmark

This deliverable will provide an extension of the first benchmark in which more complex interdependencies between the generated data items will be modelled (e.g., second-order collocations between entities). This benchmark will also allow running typical data analytics queries as well as bulk loading and querying scenarios on a variety of storage solutions.

D5.1.1 First version of the Data Storage Benchmark

This deliverable will provide a first version of the storage benchmark that will allow running typical data analytics queries on a variety of data stores (incl. NoSQL databases and native triple stores). Typical bulk loading scenarios will also be supported.

D5.2.2 Second version of the Versioning Benchmark

This deliverable will describe the second version of the versioning benchmark for linked data with time series. Baseline implementations provided by HOBBIT will be presented.

D6.1.2 Second Version of the Question Answering Benchmark

This deliverable will describe the second version of the question answering benchmark for structured and statistical data streams. Moreover, improved baseline implementations provided by HOBBIT will be presented.

D4.1.1 First version of the linking benchmark

This deliverable will describe the first version of the linking benchmark for linked data with time series. Baseline implementations provided by HOBBIT will be presented.

D3.2.1 First Version of the Data Extraction Benchmark for unstructured data

This deliverable will describe the first version of the benchmark for unstructured data streams. Moreover, baseline implementations provided by HOBBIT will be presented.

D3.2.2 Second Version of the Data Extraction Benchmark for unstructured data

This deliverable will describe the second version of the extraction benchmark for unstructured data streams. Moreover, improved baseline implementations provided by HOBBIT will be presented.

D6.1.1 First Version of the Question Answering Benchmark

This deliverable will describe the first version of the question answering benchmark structured and statistical data streams. Moreover, baseline implementations provided by HOBBIT will be presented.

D3.1.1 First Version of the Data Extraction Benchmark for Sensor Data

This deliverable will describe the first version of the extraction benchmark for semi-structured sensor data streams. Moreover, baseline implementations provided by HOBBIT will be presented.

D6.2.2 Second Version of the Faceted Browsing Benchmark

This deliverable will describe the second version of the faceted browsing benchmark for combinations of geospatial, temporal and structured data streams. Moreover, improved baseline implementations provided by HOBBIT will be presented.

D8.5.2 Intermediate data management plan

Based on the feedback on the initial plan, more concrete descriptions are added for specific types of incoming and outgoing data. The plan will be enriched with examples of datasets already in the system. We will additionally regulate reuse and exploitation, and specify how data curation and preservation will happen, and detail which data is shared with what external parties, and how such a process takes place.

D8.5.1 Initial data management plan

As part of the pilot for open access to research data, we will provide a Data Management Plan in accordance to the H2020 Guidelines on Data Management, which will detail how we deal with data throughout the project. In particular, we need to explain what (types of) datasets will be incorporated into the HOBBIT platform, and how we will ensure anonymization and licensing issues. An overview of the different types data that will be generated by the platform will be included, as well as the data formats, standards, and conventions to store and exchange this data. This initial plan will highlight the important categories and challenges in a generic way.

D8.5.3 Final data management plan

The intermediary data management plan will be validated against the needs and practices that have become clear during the project. Any updates to the data management plan of D8.5.2 will be clearly indicated and motivated. Particular emphasis will be given to data generated by the system, as the amount of this data will have increased significantly since the first version of this document. Finally, we will consider whether a deletion strategy is appropriate for parts of the incoming or outgoing data.

D8.1.1 Initial online presence

By M1 the domain and first version of the online presence of the Web page will go live. An initial press release will be created informing about the project and the project objectives.

D8.1.2 Project fact sheet, press releases and online presence

This deliverable comprises the initial promotion material, e.g., the fact sheet, the update website and first social media channels that could be used for the marketing of HOBBIT. A second press release (PR) will be prepared that will be translated to the partners’ national languages. The PR text will inform about the actual status, milestones and inform about the online channels. By M3 the full functionality of the website will be ready and connected with the other social media channels. A short report will summarize the initial efforts and document the dissemination KPIs.

D2.2.1 First version of the HOBBIT Platform

This report will be the first of two reports for the HOBBIT platform. In addition to the software and its code being made available online, we will provide a text report presenting (1) the structure of the platform as well as a user manual for the integration of novel benchmarks and (2) an evaluation of the platform itself. The report will be used to request contributions from third parties.

Publications

Extending LargeRDFBench for Multi-Source Data at Scale for SPARQL Endpoint Federation

Author(s): Hasnainb, A., Saleem, M., Ngonga Ngomo, A.-C., Rebholz-Schuhmann, D.
Published in: Published as part of the book “Emerging Topics in Semantic Technologies. ISWC 2018 Satellite Events. E. Demidova, A.J. Zaveri, E. Simperl (Eds.), Issue October 8–12, 2018, 2018, Page(s) 28-44
DOI: 10.3233/978-1-61499-894-5-203

Introducing the HOBBIT platform into the Ontology Alignment Evaluation Campaign

Author(s): Jiménez-Ruiz, E., Saveta, T., Zamazal, O., Hertling, S., Röder, M., Fundulaki, I., Ngomo, A.-C.N., Sherif, M.A., Annane, A., and others
Published in: Proceedings of the Ontology Matching Workshop 2018 co-located with the 17th International Semantic Web Conference (ISWC 2018), Issue October 8–12, 2018,, 2018, Page(s) 49-60

RDF2PT: Generating Brazilian Portuguese Texts from RDF Data.

Author(s): Moussallem, D., Thiago Castro Ferreira, M.Z., Cavalcanti, M.C., Xexéo, G., Neves, M., Ngonga Ngomo, A.-C.
Published in: The 11th edition of the Language Resources and Evaluation Conference, (LREC 2018), Issue May 7-12, 2018, 2018

LIdioms: A Multilingual Linked Idioms Data Set

Author(s): Moussallem, D., Sherif, M.A., Esteves, D., Zampieri, M., Ngonga Ngomo, A.-C.
Published in: Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018), Issue May 7-12, 2018, 2018

On Extracting Relations using Distributional Semantics and a Tree Generalization.

Author(s): R. Speck, and A. Ngonga Ngomo.
Published in: Proceedings of the 21th International Conference on Knowledge Engineering and Knowledge Management (EKAW'2018) (2018)., Issue November 12–16, 2018, 2018

HOBBIT Link Discovery Benchmarks at Ontology Matching 2017

Author(s): Roder, M., Saveta, T., Fundulaki, I., Ngonga Ngomo, A.-C
Published in: Proceedings of Ontology Matching (OM 2017) co-located with the 16th International Semantic Web Conference (ISWC 2017), Issue October 21-25, 2017, 2017, Page(s) 209-210

Benchmarking Link Discovery Systems for Geo-Spatial Data

Author(s): Saveta, T., Flouris, G., Fundulaki, I., Ngonga Ngomo, A.-C
Published in: Proceedings of BLINK 2017 colocated with the 16th International Semantic Web Conference (ISWC 2017), Issue October 21-25, 2017, 2017

Benchmarking RDF Storage Solutions with IGUANA




Joint Proceedings of BLINK2017: 2nd International Workshop on Benchmarking Linked Data and NLIWoD3: Natural Language Interfaces for the Web of Data co-located with 16th International Semantic Web Conference

Author(s): Usbeck, R., Ngomo, A.-C.N., Kim, J.-D., Choi, K.-S., Cimiano, P., Fundulaki, I., Krithara
Published in: 16th International Semantic Web Conference (ISWC 2017), Issue October 21-25, 2017, 2017

A high-performance approach to string similarity using most frequent K characters

Author(s): Andre Valdestilhas, Tommaso Soru, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of Ontology Matching (OM 2017) co-located with the 16th International Semantic Web Conference (ISWC 2017), Issue October 21-25, 2017, 2017, Page(s) 1-12

Federated SPARQL Query Processing Via CostFed.




Question Answering Over Linked Data: What is Difficult to Answer? What affects the F scores?

Author(s): Saleem, M., Dastjerdi, S.N., Usbeck, R., Ngomo, A.-C.N.
Published in: Proceedings of Natural Language Interfaces workshop (NLIWOD 2017) co-located with the 16th International Semantic Web Conference (ISWC 2017), Issue October 21-25, 2017, 2017

LOG4MEX: A Library to Export Machine Learning Experiments

Author(s): Esteves, D., Moussallem, D., Soru, T., Baron Neto, C., Lehmann, J., Ngonga Ngomo, A.-C., Duarte, J.C
Published in: WI '17 Proceedings of the International Conference on Web Intelligence, Issue August 23-26, 2017, 2017

An evaluation of models for runtime approximation in link discovery

Author(s): Kleanthi Georgala, Michael Hoffmann, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of the International Conference on Web Intelligence - WI '17, Issue August 23 - 26, 2017, 2017, Page(s) 57-64
DOI: 10.1145/3106426.3106428

Benchmarking Faceted Browsing Capabilities of Triplestores

Author(s): Henning Petzka, Claus Stadler, Georgios Katsimpras, Bastian Haarmann, Jens Lehmann
Published in: Proceedings of the 13th International Conference on Semantic Systems - Semantics2017, Issue September 11-14, 2017, 2017, Page(s) 128-135
DOI: 10.1145/3132218.3132242

Ensemble Learning of Named Entity Recognition Algorithms using Multilayer Perceptron for the Multilingual Web of Data

Author(s): René Speck, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of the Knowledge Capture Conference on - K-CAP 2017, 2017, Page(s) 1-4
DOI: 10.1145/3148011.3154471

GENESIS - a generic RDF data access interface

Author(s): Timofey Ermilov, Diego Moussallem, Ricardo Usbeck, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of the International Conference on Web Intelligence - WI '17, Issue August 23 - 26, 2017, 2017, Page(s) 125-131
DOI: 10.1145/3106426.3106514

MAG - A Multilingual, Knowledge-base Agnostic and Deterministic Entity Linking Approach

Author(s): Diego Moussallem, Ricardo Usbeck, Michael Röeder, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of the Knowledge Capture Conference on - K-CAP 2017, 2017, Page(s) 1-8
DOI: 10.1145/3148011.3148024

Holistic and scalable ranking of RDF data

Author(s): Axel-Cyrille, Ngonga Ngomo, Michael Hoffmann, Ricardo Usbeck, Kunal Jha
Published in: 2017 IEEE International Conference on Big Data (Big Data), Issue 11-14 Dec. 2017, 2017, Page(s) 746-755
DOI: 10.1109/bigdata.2017.8257990

SPBv: Benchmarking Linked Data Archiving Systems

Author(s): Vassilis Papakonstantinou, Giorgos Flouris, Irini Fundulaki, Kostas Stefanidis, Yannis Roussakis
Published in: Proceedings of BLINK 2017 colocated with the 16th International Semantic Web Conference (ISWC 2017), Issue October 21-25, 2017, 2017

Assessing Linked Data Versioning Systems: The Semantic Publishing Versioning Benchmark

Author(s): Vassilis Papakonstantinou, Irini Fundulaki and Giorgos Flouris
Published in: Proceedings of the 12th International Workshop on Scalable Semantic Web Knowledge Base Systems co-located with 17th International Semantic Web Conference (ISWC 2018), and also in Book: Emerging Topics in Semantic Technologies. ISWC 2018 Satellite Events. E. Demidova, A.J. Zaveri, E. Simperl (Eds.), Issue October 9, 2018, 2018

The DEBS 2018 Grand Challenge

Author(s): Vincenzo Gulisano, Zbigniew Jerzak, Pavel Smirnov, Martin Strohbach, Holger Ziekow, Dimitris Zissis
Published in: Proceedings of the 12th ACM International Conference on Distributed and Event-based Systems - DEBS '18, Issue June 25 - 29, 2018, 2018, Page(s) 191-194
DOI: 10.1145/3210284.3220510

The DEBS 2017 Grand Challenge

Author(s): Vincenzo Gulisano, Zbigniew Jerzak, Roman Katerinenko, Martin Strohbach, Holger Ziekow
Published in: Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems - DEBS '17, 2017, Page(s) 271-273
DOI: 10.1145/3093742.3096342

Benchmarking Virtuoso 8 at the Mighty Storage Challenge 2018: Training Results

Author(s): Spasić, M., Jovanovik, M
Published in: 15th Extended Semantic Web Conference (ESWC 2018), Issue June 3-7, 2018, 2018

Named Entity Recognition in Twitter using Images and Text.

Author(s): Esteves, D., Peres, R., Lehmann, J., Napolitano, G.:
Published in: Proceedings of the 3rd International Workshop on Natural Language Processing for Informal Text (NLPIT 2017), Issue June 5-8, 2017, 2017

OM-2017: Proceedings of the Twelfth International Workshop on Ontology Matching

Author(s): Shvaiko , Pavel; Euzenat , Jérôme; Jiménez-Ruiz , Ernesto; Cheatham , Michelle; Hassanzadeh , Oktie
Published in: OM 2017 - Proceedings of the Twelfth International Workshop on Ontology Matching co-located with the 16th International Semantic Web Conference (ISWC 2017), Issue October 21-25, 2017, 2017, ISSN 1613-0073

Generating SPARQL Query Containment Benchmarks Using the SQCFramework.




MEX Interfaces - Automating Machine Learning Metadata Generation

Author(s): Diego Esteves, Pablo N. Mendes, Diego Moussallem, Julio Cesar Duarte, Amrapali Zaveri, Jens Lehmann
Published in: Proceedings of the 12th International Conference on Semantic Systems - SEMANTiCS 2016, 2016, Page(s) 17-24
DOI: 10.1145/2993318.2993320

RADON - Rapid Discovery of Topological Relations.

Author(s): M. Sherif, K. Dreßler, P. Smeros, A. Ngonga Ngomo
Published in: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI 2017), 2017, Page(s) 175-181, ISSN 2159-5399

Requirements to Modern Semantic Search Engines.

Author(s): Ricardo Usbeck, Michael R?der, Peter Haase, Artem Kozlov, Muhammad Saleem, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of 7th International Conference on Knowledge Engineering and the Semantic Web (KESW 2016), 2016, Page(s) 328-343
DOI: 10.1007/978-3-319-45880-9_25

Detecting Similar Linked Datasets Using Topic Modelling,

Author(s): Michael R?der, Axel-Cyrille Ngonga Ngomo, Ivan Ermilov, Andreas Both
Published in: Proceedings: The Semantic Web. Latest Advances and New Domains - 13th International Conference (ESWC 2016),, 2016, Page(s) 3-19
DOI: 10.1007/978-3-319-34129-3_1

DBtrends - Exploring Query Logs for Ranking RDF Data

Author(s): Edgard Marx, Amrapali Zaveri, Diego Moussallem, Sandro Rautenberg
Published in: Proceedings of the 12th International Conference on Semantic Systems - SEMANTiCS 2016, Issue September 12-15, 2016, 2016, Page(s) 9-16
DOI: 10.1145/2993318.2993322

All That Glitters is not Gold - Rule-Based Curation of Reference Datasets for Named Entity Recognition and Entity Linking,

Author(s): K. Jha, M. Röder, A. Ngonga Ngomo.
Published in: Proceedings OF the Semantic Web. Latest Advances and New Domains: 14th International Conference, (ESWC 2017),, Issue May 28 - June​ 1, 2017, 2017

An Effient Approach for the Generation of Allen Relations,

Author(s): K. Georgala, M. Sherif, A. Ngomo
Published in: Proceedings of ECAI 2016 - 22nd European Conference on Artificial Intelligence, - Including Prestigious Applications of Artificial Intelligence (PAIS 2016)},, Issue Volume 285, August 29 - September 2, 2016, 2016, Page(s) 948-956
DOI: 10.3233/978-1-61499-672-9-948

Scalable Link Discovery for Modern Data-Driven Applications,

Author(s): K. Georgala
Published in: Proceedings of the 15th International Semantic Web Conference (ISWC 2016) 2016, Doctoral Consortium Track,, Issue October 17-21, 2016, 2016

TAIPAN: Automatic Property Mapping for Tabular Data

Author(s): Ivan Ermilov, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of 20th International Conference on Knowledge Engineering and Knowledge Management (EKAW 2016), Issue November 19-23, 2016,, 2016, Page(s) 163-179
DOI: 10.1007/978-3-319-49004-5_11

UPSP: Unique Predicate-based Source Selection for SPARQL Endpoint Federation.

Author(s): E. Cem Ozkan, M. Saleem, E. Dogdu, A.Ngonga Ngomo
Published in: Proceedings of the 3rd International Workshop on Dataset PROFIling and fEderated Search for Linked Data (PROFILES '16) co-located with the 13th ESWC 2016 Conference, Issue Volume 1597, 30 May 2016, 2016

How well does your instance matching system perform? Experimental evaluation with LANCE.

Author(s): Tzanina Saveta, Evangelia Daskalaki, Giorgos Flouris, Irini Fundulaki, Axel-Cyrille Ngonga Ngomo
Published in: Proceedings of the Workshop on Benchmarking Linked Data (BLINK 2016) co-located with the 15th International Semantic Web Conference (ISWC 2016), Issue Volume 1700, October 18, 2016, 2016, Page(s) 26-33, ISSN 1613-0073

Versioning for Linked Data: Archiving Systems and Benchmarks

Author(s): Vassilis Papakonstantinou, Giorgos Flouris, Irini Fundulaki, Kostas Stefanidis, Giannis Roussakis.
Published in: Proceedings of the Workshop on Benchmarking Linked Data (BLINK} 2016) co-located with the 15th International Semantic Web Conference (ISWC 2016), Issue Volume 1700, October 18, 2016, 2016, ISSN 1613-0073

An RDF Dataset Generator for the Social Network Benchmark with Real-World Coherence

Author(s): Mirko Spasic, Milos Jovanovik, Arnau Prat-Perez
Published in: Proceedings of the Workshop on Benchmarking Linked Data (BLINK} 2016) co-located with the 15th International Semantic Web Conference (ISWC 2016), Issue Volume 1700, October 18, 2016, 2016, Page(s) 18 - 25

HOBBIT: Holistic Benchmarking for Big Linked Data

Author(s): A. Ngonga Ngomo, M. Röder.
Published in: EU networking session at Extended Semantic Web Conference (ESWC 2016), Issue June 1, 2016, 2016

DBtrends : Publishing and Benchmarking RDF Ranking Functions

Author(s): Edgard Marx, Amrapali Zaveri, Mofeed Mohammed, Sandro Rautenberg, Jens Lehmann, Axel-Cyrille Ngonga Ngomo, Gong Cheng
Published in: 2nd International Workshop on Summarizing and Presenting Entities and Ontologies (SumPre 2016) co-located with the 13th Extended Semantic Web Conference (ESWC 2016),, Issue May 30, 2016, 2016

PoDiGG: A Public Transport RDF Dataset Generator

Author(s): Ruben Taelman, Ruben Verborgh, Tom De Nies, Erik Mannens
Published in: Proceedings of the 26th International Conference on World Wide Web Companion, Issue 26, April 03-07, 2017, 2017, Page(s) 843-844

The Scalable Question Answering Over Linked Data (SQA) Challenge 2018

Author(s): Giulio Napolitano, Ricardo Usbeck, Axel-Cyrille Ngonga Ngomo
Published in: Semantic Web Challenges - 5th SemWebEval Challenge at ESWC 2018, Heraklion, Greece, June 3–7, 2018, Revised Selected Papers, Issue 927, 2018, Page(s) 69-75
DOI: 10.1007/978-3-030-00072-1_6

$$SPgen $$: A Benchmark Generator for Spatial Link Discovery Tools

Author(s): Tzanina Saveta, Irini Fundulaki, Giorgos Flouris, Axel-Cyrille Ngonga-Ngomo
Published in: The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, Monterey, CA, USA, October 8–12, 2018, Proceedings, Part I, Issue 11136, 2018, Page(s) 408-423
DOI: 10.1007/978-3-030-00671-6_24

Open Knowledge Extraction Challenge 2018

Author(s): René Speck, Michael Röder, Felix Conrads, Hyndavi Rebba, Catherine Camilla Romiyo, Gurudevi Salakki, Rutuja Suryawanshi, Danish Ahmed, Nikit Srivastava, Mohit Mahajan, Axel-Cyrille Ngonga Ngomo
Published in: Semantic Web Challenges - 5th SemWebEval Challenge at ESWC 2018, Heraklion, Greece, June 3–7, 2018, Revised Selected Papers, Issue 927, 2018, Page(s) 39-51
DOI: 10.1007/978-3-030-00072-1_4

MOCHA2018: The Mighty Storage Challenge at ESWC 2018

Author(s): Kleanthi Georgala, Mirko Spasić, Milos Jovanovik, Vassilis Papakonstantinou, Claus Stadler, Michael Röder, Axel-Cyrille Ngonga Ngomo
Published in: Semantic Web Challenges - 5th SemWebEval Challenge at ESWC 2018, Heraklion, Greece, June 3–7, 2018, Revised Selected Papers, Issue 927, 2018, Page(s) 3-16
DOI: 10.1007/978-3-030-00072-1_1

Eaglet – a Named Entity Recognition and Entity Linking Gold Standard Checking Tool

Author(s): Kunal Jha, Michael Röder, Axel-Cyrille Ngonga Ngomo
Published in: The Semantic Web: ESWC 2017 Satellite Events, Issue 10577, 2017, Page(s) 149-154
DOI: 10.1007/978-3-319-70407-4_28

MOCHA2017: The Mighty Storage Challenge at ESWC 2017

Author(s): Kleanthi Georgala, Mirko Spasić, Milos Jovanovik, Henning Petzka, Michael Röder, Axel-Cyrille Ngonga Ngomo
Published in: Semantic Web Challenges, Issue 769, 2017, Page(s) 3-15
DOI: 10.1007/978-3-319-69146-6_1

7th Open Challenge on Question Answering over Linked Data (QALD-7)

Author(s): Ricardo Usbeck, Axel-Cyrille Ngonga Ngomo, Bastian Haarmann, Anastasia Krithara, Michael Röder, Giulio Napolitano
Published in: Semantic Web Challenges, Issue 769, 2017, Page(s) 59-69
DOI: 10.1007/978-3-319-69146-6_6

Open Knowledge Extraction Challenge 2017

Author(s): René Speck, Michael Röder, Sergio Oramas, Luis Espinosa-Anke, Axel-Cyrille Ngonga Ngomo
Published in: Semantic Web Challenges, Issue 769, 2017, Page(s) 35-48
DOI: 10.1007/978-3-319-69146-6_4

Dynamic Planning for Link Discovery

Author(s): Kleanthi Georgala, Daniel Obraczka, Axel-Cyrille Ngonga Ngomo
Published in: The Semantic Web, Issue 10843, 2018, Page(s) 240-255
DOI: 10.1007/978-3-319-93417-4_16

EARL: Joint Entity and Relation Linking for Question Answering over Knowledge Graphs

Author(s): Mohnish Dubey, Debayan Banerjee, Debanjan Chaudhuri, Jens Lehmann
Published in: The Semantic Web – ISWC 2018 - 17th International Semantic Web Conference, Monterey, CA, USA, October 8–12, 2018, Proceedings, Part I, Issue 11136, 2018, Page(s) 108-126
DOI: 10.1007/978-3-030-00671-6_7

Formal Query Generation for Question Answering over Knowledge Bases

Author(s): Hamid Zafar, Giulio Napolitano, Jens Lehmann
Published in: The Semantic Web, Issue 10843, 2018, Page(s) 714-728
DOI: 10.1007/978-3-319-93417-4_46

Supporting Sustainable Publishing and Consuming of Live Linked Time Series Streams

Author(s): Julian Andres Rojas Melendez, Gayane Sedrakyan, Pieter Colpaert, Miel Vander Sande, Ruben Verborgh
Published in: The Semantic Web: ESWC 2018 Satellite Events - ESWC 2018 Satellite Events, Heraklion, Crete, Greece, June 3-7, 2018, Revised Selected Papers, Issue 11155, 2018, Page(s) 148-152
DOI: 10.1007/978-3-319-98192-5_28

Benchmarking Virtuoso 8 at the Mighty Storage Challenge 2018: Challenge Results

Author(s): Milos Jovanovik, Mirko Spasić
Published in: Semantic Web Challenges - 5th SemWebEval Challenge at ESWC 2018, Heraklion, Greece, June 3–7, 2018, Revised Selected Papers, Issue 927, 2018, Page(s) 24-35
DOI: 10.1007/978-3-030-00072-1_3

MOCHA 2017 as a Challenge for Virtuoso

Author(s): Mirko Spasić, Milos Jovanovik
Published in: Semantic Web Challenges, Issue 769, 2017, Page(s) 21-32
DOI: 10.1007/978-3-319-69146-6_3

On the Effect of Geometries Simplification on Geo-spatial Link Discovery

Author(s): Abdullah Fathi Ahmed, Mohamed Ahmed Sherif, Axel-Cyrille Ngonga Ngomo
Published in: Procedia Computer Science, Issue 137, 2018, Page(s) 139-150, ISSN 1877-0509
DOI: 10.1016/j.procs.2018.09.014

LargeRDFBench: A billion triples benchmark for SPARQL endpoint federation

Author(s): Muhammad Saleem, Ali Hasnain, Axel-Cyrille Ngonga Ngomo
Published in: Journal of Web Semantics, Issue 48, 2018, Page(s) 85-125, ISSN 1570-8268
DOI: 10.1016/j.websem.2017.12.005

Machine Translation using Semantic Web Technologies: A Survey

Author(s): Diego Moussallem, Matthias Wauer, Axel-Cyrille Ngonga Ngomo
Published in: Journal of Web Semantics, Issue 51, 2018, Page(s) 1-19, ISSN 1570-8268
DOI: 10.1016/j.websem.2018.07.001

Benchmarking question answering systems

Author(s): Ricardo Usbeck, Michael Röder, Michael Hoffmann, Felix Conrads, Jonathan Huthmann, Axel-Cyrille Ngonga-Ngomo, Christian Demmler, Christina Unger
Published in: Semantic Web, Issue 10/2, 2019, Page(s) 293-304, ISSN 1570-0844
DOI: 10.3233/sw-180312

GERBIL – Benchmarking Named Entity Recognition and Linking consistently

Author(s): Michael Röder, Ricardo Usbeck, Axel-Cyrille Ngonga Ngomo
Published in: Semantic Web, Issue 9/5, 2018, Page(s) 605-625, ISSN 1570-0844
DOI: 10.3233/sw-170286

Poster Abstract: Real-time load prediction with high velocity smart home data stream

Author(s): Christoph Doblander, Martin Strohbach, Holger Ziekow, Hans-Arno Jacobsen
Published in: Computer Science - Research and Development, Issue 33/1-2, 2018, Page(s) 233-234, ISSN 1865-2034
DOI: 10.1007/s00450-017-0364-5

Dealing with Data Quality in Smart Home Environments—Lessons Learned from a Smart Grid Pilot

Author(s): Alessandro Leonardi, Holger Ziekow, Martin Strohbach, Panayotis Kikiras
Published in: Journal of Sensor and Actuator Networks, Issue 5/1, 2016, Page(s) 5, ISSN 2224-2708
DOI: 10.3390/jsan5010005

BENGAL: An Automatic Benchmark Generator for Entity Recognition and Linking

Author(s): Ngomo, A.-C.N., Röder, M., Moussallem, D., Usbeck, R., Speck, R
Published in: CoRR (2017), 2017

Real-time Load Prediction with High Velocity Smart Home Data Stream

Author(s): Doblander, C., Strohbach, M., Ziekow, H., Jacobsen, H.-A
Published in: Computer Science - Research and Development, Issue Volume 33, Issue 1–2, 2018, Page(s) 233–234, ISSN 1865-2034

LITMUS: An Open Extensible Framework for Benchmarking RDF Data Management Solutions

Author(s): Thakkar, Harsh; Dubey, Mohnish; Sejdiu, Gezim; Ngomo, Axel-Cyrille Ngonga; Debattista, Jeremy; Lange, Christoph; Lehmann, Jens; Auer, Sören; Vidal, Maria-Esther
Published in: CoRR, Issue 1, 2016

Using Multi-Label Classification for Improved Question Answering

Author(s): Usbeck, Ricardo; Hoffmann, Michael; Röder, Michael; Lehmann, Jens; Ngomo, Axel-Cyrille Ngonga
Published in: CoRR, Issue 1, 2017

SPARQL Querying Benchmarks

Author(s): M. Saleem, R. Usbeck, M. Röder, A. Ngonga Ngomo.
Published in: Tutorial at the 15th International Semantic Web Conference (ISWC 2016), Issue October 17-21, 2016, 2016

Link Discovery - Algorithms, Approaches and Benchmarks

Author(s): Axel-Cyrille Ngonga Ngomo, Irini Fundulaki and Mohamed Ahmed Sherif.
Published in: Tutorial at the 15th International Semantic Web Conference (ISWC 2016), Issue October 17-21, 2016, 2016

Federated Query Processing: Challenges and Opportunities

Author(s): A. Ngonga Ngomo, M. Saleem.
Published in: Keynote at PROFILES at Extended Semantic Web Conference (ESWC 2016), Issue Volume 1597, 30 May 2016, 2016

Assessing the performance of RDF Engines: Discussing RDF Benchmarks.

Author(s): I. Fundulaki, A. Kementsietsidis
Published in: Tutorial at Extended Semantic Web Conference (ESWC 2016), 2016

Techreport for GERBIL 1.2.2 - V1

Author(s): M. Röder, R. Usbeck, A. Ngonga Ngomo
Published in: Issue February 21, 2016, 2016