SEALS

European Commission Directorate-General For The Information Society And Media

Description

Framework Programme 7 (2007-2013) : research infrastructures projects
Research policy and organisation
Information policy
Target audience: Scientific

Informations

• Publié par: EUROPEAN-COMMISSION-DIRECTORATE-GENERAL-FOR-THE-INFORMATION-SOCIETY-AND-MEDIA
• Nombre de lectures: 7
• Langue: English

Extrait

Framework Programme 7 (2007-2013)

Research infrastructures projets

European Commission

Information Society and Media

continued overleaf

Project acronym:

SEALS

Project n°:

RI-238975

Project type:

CP-CSA

Start date:

01/06/2009

Duration:

36 months

Total budget:

4 708 826 €

Funding from the EC:

3 500 000 €

Total funded effort in person-month:

467

Web site:

www.seals-project.eu

Contact person:

Asunción Gómez-Pérez

email: [e-mail]

tel.: [phone]

fax.: [phone]

Project participants:

UPM

ES

USFD

UK

FZI

DE

UIBK

AT

INRIA

FR

UMA

DE

UZH

CH

STI2

AT

OU

UK

OXF

UK

Keywords:

Infrastructure, evaluation, benchmarking,

semantic technologies

SemanticEvaluationAtLargeScale-RI

Summary:

The SEALS project aims to address two key challenges: the creation of

a lasting reference infrastructure for semantic technology evaluation (the SEALS

Platform) and the continuous evaluation of semantic technologies at a large scale via

public world-wide evaluation campaigns.

The SEALS Platform will be an independent, open, scalable, extensible and sustainable

infrastructure that will allow the remote evaluation of semantic technologies by

providing an integrated set of evaluation services and test suites. The SEALS Platform

will be used in two public world-wide evaluation campaigns and the results of these

evaluation campaigns will be employed in creating semantic technology roadmaps,

identifying sets of efficient and compatible tools for developing large-scale semantic

applications.

The semantic technology evaluation services will initially be available for five different

types of technologies (ontology engineering tools, storage and reasoning systems,

matching tools, semantic search tools, and semantic web service tools) and for different

evaluation criteria (interoperability, scalability, etc.). The platform will provide easy and

free access to the evaluation services and to the results of the evaluations performed,

allowing researchers and users to effectively compare the available technologies,

helping them to select appropriate technologies and advancing the state of the art

through continuous evaluation.

Objectives:

To accomplish the vision of the SEALS project, the following scientific

and technological objectives have to be achieved:

•

To develop the SEALS Platform and its services.

•

To define the evaluations to be executed automatically using the SEALS

Platform.

•

To implement the different evaluations as services of the SEALS Platform.

•

To develop the SEALS methodology for the continuous evaluation of semantic

technologies.

•

To organize and execute two public evaluation campaigns including the best-in-

class semantic technologies.

•

To identify semantic technology roadmaps by analyzing the evaluation results

produced in the evaluation campaigns.

•

To construct a sustainable worldwide reference community for semantic

technology evaluation.

Action plan:

During a period of three years, the SEALS project will follow a two-phase

spiral lifecycle model, being each phase delimited by one of the two planned world-

wide evaluation campaigns that will provide valuable feedback to the work done.

In the first phase, the first public SEALS Evaluation Campaign will be defined and

executed with the first prototype of the SEALS Platform and the first version of the

evaluations, data sets, and software components for automatic evaluation. The results

of this evaluation campaign will allow identifying semantic technology roadmaps and

new requirements.

In the second phase of the project, the second public SEALS Evaluation Campaign will

be carried out taking into account the lessons learnt in the first phase and the results of

the evaluations performed in the SEALS Platform and its components. This process

will lead to the development of a second prototype of the SEALS Platform and a second

set of evaluations, data sets and components for automatic evaluation. The results of

the second evaluation campaign will produce new semantic technology roadmaps and

a basis for future evaluation campaigns.