Assessing Tracking Assessment Measures

  • Tahir Nawaz, Fabio Poiesi, and Andra Cavallaro. Assessing Tracking Assessment Measures. In Proceedings of the IEEE International Conference on Image Processing (ICIP), pages 441-445, Paris, France, 2014. doi:10.1109/ICIP.2014.7025088
    [BibTeX] [Abstract]

    We propose a methodology to quantitatively compare the relative performance of tracking evaluation measures. The proposed methodology is based on determining the probabilistic agreement between tracking result decisions made by measures and those made by humans. We use tracking results on publicly available datasets with different target types and varying challenges, and collect the judgments of 90 skilled, semi-skilled and unskilled human subjects using a web-based performance assessment test. The analysis of the agreements allows us to highlight the variation in performance of the different measures and the most appropriate ones for the various stages of tracking performance evaluation.

    @InProceedings{2014-10-NAWAZ,
    author = {Tahir Nawaz and Fabio Poiesi and Andra Cavallaro},
    title = {{Assessing Tracking Assessment Measures}},
    booktitle = {{Proceedings of the IEEE International Conference on Image Processing (ICIP)}},
    date = {2014-10-27/2014-10-30},
    address = {Paris, France},
    doi = {10.1109/ICIP.2014.7025088},
    pages = {441-445},
    abstract = {We propose a methodology to quantitatively compare the relative performance of tracking evaluation measures. The proposed methodology is based on determining the probabilistic agreement between tracking result decisions made by measures and those made by humans. We use tracking results on publicly available datasets with different target types and varying challenges, and collect the judgments of 90 skilled, semi-skilled and unskilled human subjects using a web-based performance assessment test. The analysis of the agreements allows us to highlight the variation in performance of the different measures and the most appropriate ones for the various stages of tracking performance evaluation.},
    year = {2014}
    }

This entry was posted in Dissemination. Bookmark the permalink.

Comments are closed.