Community Area
Bookmark
News
- Latest software release for the SEALS Semantic Search Tool Theme
- Invitation to participate in SEALS evaluation campaign for semantic search tools
- Online Evaluation of Ontology Matching Systems
- SEALS sponsors best evaluation paper at ESWC 2010
- 1st International Evaluation Campaign for Semantic Technologies launched
SEALS evaluation campaigns Storage and Reasoning
| Storage and Reasoning Systems Evaluation Campaign 2010 |
|
Storage and Reasoning Systems Evaluation Campaign 2010 Description logic based systems evaluationOrganizers:
------------------------------------------------------------------------------------------------ Click here for the latest evaluation campaign newsUpdates to this evaluation campaign will be announced here and per RSS. Overview of the Evaluation CampaignSemantic technologies are at the heart of the future Web providing ways to express knowledge and data so that it can be properly exploited. These technologies will empower a new class of Information and Communication Technologies much more scalable, interoperable, and with a higher degree of process automation support that will fulfil the needs of an emergence market that will exceed $10 billion by 2010. Description logic based systems (DLBSs) evaluation aims at accessing interoperability and performance of one of the core building blocks of semantic technologies vision namely description logic reasoners. This evaluation, thus, serves several purposes: Evaluation scenariosThe overall objective of evaluation campaign is to evaluate DLBSs standard inference services: classification, class satisfiability, ontology satisfiability and logical entailment. Evaluation datasetsThe challenge uses a set of state of the art ontologies for evaluation. The set includes OWL 2 test cases repository, ontologies from Gardiner suite, various versions of the GALEN ontology, ontologies that have been created in EU funded projects SEMINTEC, VICODI, AEO and the SNOMED CT ontology. Evaluation materialsDLBSs are expected to support OWL 2 language and provide interface to their functionalities through either OWL-API or a set of evaluation interfaces which will be provided by the SEALS evaluation platform. For more details about the planned interfaces, please refer to the SEALS project deliverable 11.1. How do I get involved?Participation is open to developers interested in evaluating their tool or to anyone who wants to evaluate a certain tool. Participants are just expected to collaborate in the connection of their tool with the SEALS Platform, which will be the infrastructure that will run all the evaluations automatically. Besides checking their results and comparing with others, once the tool is connected to the SEALS Platform participants will also be able to run the evaluations on their own with these and future test data. The first step is to join the SEALS Community. Once you have your community login, you will be able to register your tools for the evaluation campaign. Users with tools registered to the evaluation campaign will receive notifications as further details and services of the SEALS platform become available. Timeline and eventsThe evaluation campaign will take place during 2010. The concrete timeline of the whole evaluation campaign is the following: May 2010 Registration opens |
