TASK 3        Text Area Detection                                                                                       

Jolion & Wolf metric and ICDAR 2003 Metric

Run

J&W Metric (Tr=0.4 ; Tp = 0.6)

3 Best runs

Ponctual (Hmean)

Integration (Hmean)

 

Run 1

0.605313

Overall recall = 64.9

Overall precision = 50.7

Final single performance value = 56.9

Run1 = CMM cmm04

Run2 = CMM cmm03

Run3 = CMM cmm02

Run 2

0.584094

Overall recall = 63.5

Overall precision = 49.2

Final single performance value = 55.5

Run 3

0.582745

Overall recall = 63.0

Overall precision = 49.5

Final single performance value = 55.4

Run 4

0.575404

Overall recall = 60.4

Overall precision = 49.8

Final single performance value = 54.6

3 Best teams

 

Run 5

0.209277

Overall recall = 23.3

Overall precision = 21.1

Final single performance value = 22.2

1. CMM (cmm04)

2. CEA (cea01)

 

 

Run

ICDAR 2003 (HMean)

 

Run 1

0.571342

 

Run 2

0.559986

Run 3

0.561931

Run 4

0.554229

 

Run 5

0.268219

 

 

Christian Wolf and Jean-Michel Jolion. Object count/Area Graphs for the Evaluation of Object Detection and Segmentation Algorithms, In International Journal on Document Analysis and Recognition , 8(4)2006, pp. 280-296