Friday 11 July 2014
 
» The Fiber Cup » MICCAI’09 Contest » Results and Conclusions
 
Results and Conclusions

 

Thanks to all contributors, the MICCAI’09 Fiber Cup was a great success! We received a total of 9 submissions (which is really good regarding the short amount of time given to competitors), including one with 2 results, which makes a total of 10 results.

This page gives a brief summary of the results, including the metric scores for each method. We recall that results were evaluated on three metrics: the L2 norm, the difference in tangent, and the difference in curvature. Metrics were evaluated for each of the 16 candidate fibers. The method with the best result gets 3 points, second best gets 2 points, third best gets 1 point and the others get no point. Points are summed up over all fibers and all metrics, giving the final score.

More details on the evaluation methodology in the FiberCup closing remarks presentation.


  • Summary of contributions:
Dataset type: 3x3x3 6x6x6
number of submissions: 9 1


b-values: 650 1500 2000 2650
number of submissions: 0 8 1 1


Models: Tensor Multi-Tensor ODF ODF-SD* PAS Model-Free
number of submissions: 3 2 1 2 1 1


Tractography algorithms: Deterministic Probabilistic Global
number of submissions: 9 0 1

*ODF-SD: ODF with Spherical Deconvolution.


  • Overview of submitted results:
Ground truth All submissions


  • Scoring:

In the tables, F1, F2, …, F16 (row indices) correspond to candidate fibers, while numbers 1, 2, …, 10 (column indices) corresponds to submissions (for a correspondence between submissions number and competitor, see the list of contributors below).

L2 norm
1 2 3 4 5 6 7 8 9 10
F1 4.98 6.91 37.53 44.8 3.01 4.67 2.24 18.06 3.56 4.39
F2 39.65 7.83 16.87 19.12 3.22 21.1 2.37 30.1 34.96 4.37
F3 53.84 2.01 58.46 55.87 4.74 8.75 4.98 17.03 46.24 2.62
F4 6.02 2.25 51.79 34.82 4.36 4.95 2.18 16.87 4.05 1.25
F5 7.36 3.75 41.33 34.32 4.77 43.56 1.98 7.06 10.66 1.81
F6 2.65 6.61 17.55 20.77 54.05 48.31 4.25 54.06 8.07 7.7
F7 71.1 3.61 65.01 63.3 67.03 55.74 5.62 53.87 70.68 67.82
F8 14.77 4.91 15.37 10.86 4.63 4.84 2.11 24.47 4.68 4.16
F9 10.2 5.73 18.93 31.16 18.42 6.08 2.61 18.55 3.64 4.15
F10 9.41 5.37 24.21 38.65 6.45 9.31 5.78 5.95 7.29 4.38
F11 21.51 3.27 45.6 44.47 17.25 2.05 3.36 51.93 8.17 2.63
F12 14.83 4.22 45.14 44.78 4.86 5.44 17.02 56.05 7.91 8.24
F13 20.01 1.65 7.79 6.94 3.78 21.57 4.66 7.02 5.21 2.15
F14 2.94 2.73 17.34 16.69 2.34 4.66 2.56 5.68 3.21 3.83
F15 16.37 2.73 21.27 30.57 2.89 24.65 2.16 21.17 3.53 5.52
F16 14.35 5.31 55.36 52.53 6.01 10.42 5.81 59.64 6.61 6.04
Score 3 24 0 0 14 4 28 1 2 20


Tangent difference
1 2 3 4 5 6 7 8 9 10
F1 21.76 10.83 69.42 65.66 13.42 18.62 9.33 20.11 15.68 31.1
F2 57.92 15.18 57.14 58.76 16.28 65.97 12.38 42.21 33.19 32.98
F3 24.89 9.92 74.59 71.78 9.11 24.09 6.35 10.05 81.85 28.32
F4 32.23 9.65 73.15 24.97 19.77 24.71 5.37 19.8 12.05 19.26
F5 39.44 6.96 69.48 67.86 22.62 62.32 6.2 17.32 35.39 29.71
F6 20.54 11.87 48.52 45.29 56.62 62.6 8.1 63.65 31.74 46.86
F7 27.9 8.32 76.95 76.75 67.49 63.86 11.44 63.19 63.98 65.66
F8 47.82 12.34 37.55 33.41 18.29 16.41 8.26 48.85 16.75 33.27
F9 43.14 11.7 49.68 54.17 46.99 35.2 6.73 16.69 13.05 35.46
F10 29.47 15.21 61.92 67.5 13.01 33.56 12.1 25.52 32.24 34.69
F11 54.87 8 45.18 47.97 45.92 12.23 4.85 63.85 35.05 29.69
F12 45.87 12.02 66.67 58.36 18.91 22.43 46.74 66.62 32.5 43.58
F13 40.51 10.94 22.76 23.84 15.76 40.73 12.75 25.36 23.99 24.89
F14 17.59 13.18 46.67 46.06 16.19 25 14.74 22.54 19.42 27.67
F15 54.2 7.39 51 54.82 11.97 54.41 4.25 15.36 12.79 36.7
F16 38.62 5.44 71.14 59.52 25.49 14.45 7.54 34.06 17.94 27.59
Score 2 35 0 0 11 4 41 1 2 0


Curvature difference
1 2 3 4 5 6 7 8 9 10
F1 0.192090 0.030870 0.487759 0.115127 0.070594 0.059897 0.025350 0.547520 0.173757 0.209874
F2 0.237074 0.054298 0.295938 0.121330 0.076433 0.136940 0.039980 1.401430 0.296428 0.274584
F3 0.110707 0.437153 0.358469 0.120857 0.086352 0.071837 0.021249 0.060191 0.492379 0.235227
F4 0.163107 0.044516 0.238506 0.083095 0.079855 0.085589 0.014065 0.414755 0.178659 0.162110
F5 0.195556 0.060609 0.157886 0.110645 0.091297 0.147999 0.020442 0.157110 0.787576 0.282577
F6 0.178685 0.043200 0.160768 0.067795 0.126881 0.097824 0.026327 2.546310 0.295175 0.484764
F7 0.121081 0.048882 0.288904 0.128260 0.128838 0.064566 0.022992 0.239020 0.279657 0.381329
F8 0.134169 0.049991 0.177319 0.067109 0.066174 0.051239 0.043299 0.198708 0.267511 0.238658
F9 0.346088 0.041078 0.311705 0.090497 0.109614 0.082396 0.016785 0.165022 0.185091 0.322867
F10 0.143171 0.054317 0.073749 0.049144 0.091980 0.085648 0.026207 0.245987 0.424402 0.232870
F11 0.527774 0.021897 0.069657 0.070266 0.110738 0.055050 0.012756 3.598110 0.210147 0.296971
F12 0.188110 0.038112 0.113937 0.070832 0.115901 0.076458 0.032568 0.096766 0.225766 0.278794
F13 0.113420 0.061247 0.123180 0.087264 0.085933 0.072212 0.070287 0.090000 0.273902 0.203200
F14 0.111878 0.256229 0.172445 0.092693 0.082921 0.136472 0.068706 0.087327 0.235044 0.209025
F15 0.422670 0.021063 0.173363 0.116532 0.078300 0.120160 0.010659 0.094674 0.198599 0.306166
F16 0.178738 0.023347 0.251477 0.166984 0.114350 0.065563 0.020795 0.223484 0.255961 0.383827
Score 0 28 0 4 6 8 47 3 0 0


Final score
1 2 3 4 5 6 7 8 9 10
Score 5 87 0 4 31 16 116 5 4 20


  • List of contributors:
1 Depicting Axon Fibers on a Diffusion Phantom by Means of Hybrid DBF-DT data, by A. Ramirez-Manzanares et al.
PDF - 159.4 kb

2 Fiber Tracking on the Fiber Cup Phantom using Constrained Spherical Deconvolution, by B. Jeurissen et al.
PDF - 3.2 Mb

3 Fiber Tracking on the Phantom dataset by Using Sisyphe Software, by Tensaouti et al. (Streamline)
PDF - 375.4 kb

4 Fiber Tracking on the Phantom dataset by Using Sisyphe Software, by Tensaouti et al. (Tensor deflection)
PDF - 375.4 kb

5 Filtered Tractography: Validation on a Physical Phantom, by J. G. Malcolm et al.
PDF - 178.6 kb

6 Fast Persistent Angular Structure Based Streamline Tractography, by K. Sakaie et al.
PDF - 32.7 kb

7 Tracking a Physical Phantom by Global Fibre Reconstruction, by M. Reisert et al.
PDF - 184.6 kb

8 Fiber Challenge - SCI Utah Solution, by S. Gouttard et al.
PDF - 634.7 kb

9 Fiber Cup 2009: Reconstructing Fibers from the Phantom Data, by T.-S Yo et al.
PDF - 403.7 kb

10 Deterministic Tractography using Orientation Distribution Functions Estimated with Probability Density Constraints and Spatial Regularity, by A. Goh.
PDF - 1.2 Mb

 

Fichier PDF - 772.2 kb
 
 
Published on Wednesday 14 October 2009
Update Tuesday 29 June 2010

 
 
 
The others articles in the same section :
 
Published on Monday 27 July 2009
Update Tuesday 29 June 2010
 
Published on Monday 14 September 2009
Update Tuesday 29 June 2010
 
Published on Wednesday 14 October 2009
Update Tuesday 29 June 2010
 

 
Home     |    Site Map     |    Editors area     |    Login
  Mis à jour le vendredi 21 mars 2014