Visual tracking

Introduction

This work deals with the development of the use of a video camera in order to add useful information for tasks of a mobile robot roving in natural environments. When the robot executes a mission, the ground knowledge can be improved adding information other than geometrical, such as color and texture.

Our approach

We have proposed and implemented as a complementary representation, the nominative region model which indicates every region's nature in an image. Using this nominative model of the scene, it is possible to select a specific landmark and to track this object.

A color segmentation algorithm provides a synthetic description of the scene. Regions obtained from the segmentation stage are then characterized by their color and texture and afterward identified to obtain their nature (grass, rocks,...). Probabilistic methods are used to determine the nature of current elements in the environment. Then, one specific landmark is chosen according to its nature and shape and, this representation is tracked through an image sequence. The tracking is done using a comparison between the currently image and the landmark model.

Experiments:

  • Landmark identification and tracking

    This link shows the automatic selection of a landmark based on its nature and shape: a portion of the rock having the largest elongation is selected as the target.

  • Landmark identification tracking and monitoring

    As in the previous case, this link shows the automatic selection of a landmark and the tracking of it. Additionally, this other example presents target tracking monitoring and target loose recovery.

  • Fourier based image motion estimation

    This link shows the estimation of motion parameters using the Fourier transform.

  • Publications

  • Visual Navigation in Natural Environments: From Range and Color Data to a Landmark-based Model, R. Murrieta-Cid, C. Parra, M. Devy. Journal Autonomous Robots Vol. 13 no 2 pp. 143-168, 2002
  • ``Aspectos Dinámicos de la Visión: Seguimiento de Objetos no Rígidos y Estimación de la Rotación de una Cámara'', Rafael Murrieta-Cid, Maurice Briot, Baptiste Marcel and Hector H. Gonzalez. Journal "Computación y Sistemas", Vol. 1 No. 4, pages 201-212, April 1998. .
  • Landmark identification and tracking in natural environment, R. Murrieta-Cid, M. Briot and N. Vandapel. In proc IEEE/RSJ-International Conference on Intelligent Robots and Systems IROS'98, Victoria Canada.
  • A Fourier transform based method for estimation of 2-D translation and rotation: an application to outdoor mobile robotics, V. Ayala-Ramirez, R. Murrieta-Cid and M. Briot, In proc 6th International Symposium on Intelligent Robotic Systems (SIRS'98), Edinburgh Scotland.
  • Calcul de translation et rotation par la transformation de Fourier, B. Marcel, M. Briot and R. Murrieta-Cid, in Journal Traitement du Signal, Vol 14, No 2, 1997.
  • Links to similar research

  • Natural Landmark Based Navigation at Carnegie Mellon University School of Computer Science.