Test Suites for NLP Applications

Informations projet

TSNLP

N° de convention de subvention: LRE62089

Projet clôturé

Date de début 1 Decembre 1993

Date de fin 1 Août 1995

Financé au titre de

• Specific programme of research and technological development (EEC) in the field of telematic systems in areas of general interest - Linguistic research and engineering -, 1990-1994

Coût total

Aucune donnée

Contribution de l’UE

Aucune donnée

Coordonné par

University of Essex
United Kingdom

CORDIS fournit des liens vers les livrables publics et les publications des projets HORIZON.

Les liens vers les livrables et les publications des projets du 7e PC, ainsi que les liens vers certains types de résultats spécifiques tels que les jeux de données et les logiciels, sont récupérés dynamiquement sur OpenAIRE .

Résultats exploitables

Guidelines and a methodology for the construction of diagnostic data

The project involves defining guidelines and a methodology for the construction of diagnostic data (test suites) and designing and implementing related tools. The guidelines will be validated by constructing application-specific diagnostic data for French, German and English and testing the data on a number of applications ranging from parsers through grammar checkers to controlled language checkers. In addition to devising guidelines, the project investigates techniques and design and implement tools that will facilitate the construction, use and manipulation of test suites, such as a database for storing and manipulating test data, and tools for the (semi)automatic generation of test suites. An advantage of automation is that this allows dynamic test suite construction, where test data can be replaced by new data which tests the same phenomena. In this way, it may be possible to overcome one of the problems that sometimes crops up in system evaluation, namely that developers can tune their application so that it deals with static test data. The project has designed a methodology for the construction of test suites and produced a database of parallel test suites in three languages of some 4000 annotated items per language, with particular reference to three application types: parsers, grammar checkers and controlled language checkers. The test material is relevant to any developer or user of systems with grammar components who wish to test, benchmark or evaluate those systems. The test suites are fully documented and mounted on a database for ease of access and manipulation. Particular attention has been paid to the design and implementation of an efficient annotation scheme.