DetEval - The GUI version

Back to the main page for the DetEval software.

You need to cite the IJDAR paper in all publications which describe work for which you used the DetEval tool.

Startup

At startup a main window is shown with an empty plot area. Evaluation is started by loading a ground truth file (button "Set groundtruth.xml") as well as a set of detection result files, where each file corresponds to a single parameter setting of the detection algorithm (button "Add new set of xml files").

ROC curves

As soon as all files are loaded, evaluation is run and a ROC curve is displayed, which gives different precision measures against different Recall values:

Evaluation criteria - thresholds on overlap

In the default settings, each object is considered as detected if at least 80% of the ground truth area has been detected (called "area recall") AND if the detection is sufficently tight, i.e. if the correctly detected ground truth area represents at least 40% of the area of the detected rectangle (called "area precision"). These default settings can be controlled with the two sliders at the right side of the main windows. Moving the sliders (or changing the contents of the edit boxes below) will immediatey rerun the evaluation and update the ROC curve.

These criteria can be controlled in further detail in the command line version of the tool.

Evaluation curves

The dependence of detection performance on the evaluation criteria described above, i.e. the dependence of object precision and object recall on area precision and area recall can be illustrated using plots. This plots are calculated for a single detection parameter setting, i.e. for a single file of the set of XML detection files which have been loaded. Clicking on one of the files in the listbox on the left side of the main window will display the evaluation plots.

The Tr plot window displays object recall and precision against varying area recall with a fixed area precision. The Tp plot window displays object recall and precision against varying area precision with a fixed area recall.

Exporting the curves to PDF or PNG

You need to cite the IJDAR paper in all publications which describe work for which you used the DetEval tool.

Back to the main page for the DetEval software.