On top of the alignment API, there is an evaluation API and an implementation described here. It is included in the Alignment toolkit

Evaluating

For demonstrating the use of the API, we implement it and use it through a particular processor (fr.inrialpes.exmo.align.util.EvalAlign) which:

Running the program is achieved through:
$ java -cp lib/procalign.jar fr.inrialpes.exmo.align.util.EvalAlign
Require two alignement filenames
usage: EvalAlign [options] file1 file2
options are:
        --debug[=n] -d[=n]              Report debug info at level ,
        --impl[=classname] -i classname Use classname for implementing Evaluator
        --help -h                       Print this message
or ($CWD is the current directory)
$ java -cp lib/procalign.jar fr.inrialpes.exmo.align.util.EvalAlign file://localhost$CWD/result/align1.owl file://localhost$CWD/result/align2.owl 

Implementing and extending the API

A (default) impplementation of this API can be found in the fr.inrialpes.exmo.align.impl package.

Adding new evaluations methods amounts to create a new Evaluator class implementing the interface. Generally, this can extend the proposed fr.inrialpes.exmo.align.impl.BasicEvaluator class.

The BasicEvaluator has the good taste of defining the storage sructures for alignment, but this is all.

The PRecEvaluatir class extends the BasicEvaluatir by computing a very basic Precision/Recall rate.


http://co4.inrialpes.fr/align/align.html

$Id: eval.html,v 1.1 2004/04/05 12:35:42 euzenat Exp $