Full-day Workshop

 

 

The consistent evaluation of semantic technologies is critical not only for future scientific progress but also for their widespread industrial adoption. Such evaluation needs to address development quality (correctness or robustness) as well as deployment qualities (interoperability or scalability). While the community is evolving towards a more thorough evaluation of semantic technologies, the field's inherent dynamism makes the evaluation of semantic technologies a difficult task: as previous evaluation methods and techniques become obsolete, new ones have to be developed as fast as semantic technologies evolve. IWEST workshop aims are twofold: (1) to discuss the current trends and future challenges of evaluating semantic technologies, and (2) to support communication and collaboration with the goal of aligning the various evaluation efforts within the community and accelerating innovation in all the associated fields as has been the case with both the TREC benchmarks in information retrieval and the TPC benchmarks in database research. In line with the goals of the workshop, we will also incorporate the results of the 1st International Evaluation Campaign for Semantic Technologies - a wide-ranging evaluation campaign which has been organised by the Semantic Evaluation At Large Scale (SEALS) Initiative.