The goal of the SEALS project is to provide an independent and extensible infrastructure that allows the remote evaluation of semantic technologies and, therefore, the objective comparison of the different existing semantic technologies. This will allow researchers and users to effectively compare the available technologies, helping them to select appropriate technologies and advancing the state of the art through continuous evaluation.
The SEALS Platform will provide an integrated set of semantic technology evaluation services and test suites. They will be used in two public and world-wide evaluation campaigns. The results of these evaluation campaigns will be used to create semantic technology roadmaps identifying sets of efficient and compatible tools for developing large-scale semantic applications.
The semantic technology evaluation services will initially be available for five different types of technologies (ontology engineering tools, storage and reasoning systems, matching tools, semantic search tools, and semantic web service tools) and for different evaluation criteria (interoperability, scalability, etc.). The platform will provide easy and free access to the evaluation services and to the results of the evaluations performed.