What is SEALS?

The SEALS Project is developing a reference infrastructure known as the SEALS Platform to facilitate the formal evaluation of semantic technologies. This allows both large-scale evaluation campaigns to be run (such as the International Evaluation Campaigns for Semantic Technologies) as well as ad-hoc evaluations by individuals or organizations.

Use of the SEALS Platform and associated technologies is free of charge and all code is Open Source (Apache 2.0). 

The 2011 Evaluation Campaign

The 1st SEALS Evaluation Campaign is now closed, but SEALS is pleased to announce the 2nd campaign opening in July 2011. It is open to all and will focus on benchmarking five core technology areas on the basis of a number of criteria such as Interoperability, Scalability, Usability, Conformance to standards and Efficiency.

Each areaʼs campaign will be largely automated and executed on the SEALS Platform thus reducing the overhead normally associated with such evaluations. More information...

Why get involved?

Broadly speaking, the benefits are threefold. Firstly, participation in the evaluation campaigns provides you with a respected and reliable means of benchmarking your semantic technologies. It provides an independent mechanism for demonstrating your toolʼs abilities and performance to potential adopters / customers.

Secondly, since you will have perpetual, free-of-charge access to the SEALS Platform, it gives you the highly valuable benefit of being able to regularly (and confidentially) assess the strengths and weaknesses of your tool relative to your competitors as an integral part of the development cycle.

Thirdly, your participation benefits the wider community since the evaluation campaign results will be used to create ʻroadmapsʼ to assist adopters new to the field to determine which technologies are best suited to their needs thus improving general semantic technology market penetration. 

How to get involved

Joining the SEALS Community is easy and poses no obligations. Indeed, by being a member of the community you receive the latest information about the evaluation campaign including details of newly published data sets, tips and advice on how to get the most out of your participation and the availability of results and analyses. Join now!

Find out more

More information about SEALS and the evaluation campaign can be found using the menu to the left.

If you would like to contact us directly:

• SEALS Coordinator: Asuncioń Gómez-Pérez
• Evaluation Campaign Coordinator: Fabio Ciravegna