Optical Flow refinement using reliable flow propagation

Tan Khoa Mai (1) , Michle Gouiffes (2) , Samia Bouchafa (1)

1 IBISC - Informatique, Biologie Intégrative et Systèmes Complexes
2 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur

This paper shows how to improve optical flow estimation by considering a neighborhood consensus strategy along with a reliable flow propagation method. Propagation takes advantages of reliability measures that are available from local low level image features. In this paper, we focus on color but our method could be easily generalized by considering also texture or gradient features. We investigate the conditions of estimating accurate optical flow and managing correctly flow discontinuities by proposing a variant of the well-known Kanade-Lucas-Tomasi (KLT) approach. Starting from this classical approach, a consensual flow is estimated locally while two additional criteria are proposed to evaluate its reliability. Propagation of reliable flow throughout the image is then performed using a specific distance criterion based on color and proximity. Experiments are conducted within the Middlebury database and show better results than classic KLT and even global methods like the well known Horn and Schunck or Black and Anandan approaches.

Mots clés: local optical flow; reliability measure; propagation of reliable flow

Domaines: Traitement du signal et de l'image [eess.SP]

Tan Khoa Mai, Michle Gouiffes, Samia Bouchafa. Optical Flow refinement using reliable flow propagation. 12th International Conference on Computer Vision Theory and Applications (VISAPP 2017), Feb 2017, Porto, Portugal. (elec. proc.). ⟨hal-01760105⟩