The MAPS : Toward a Novel Mobility Assistance System for Visually Impaired People

Katerine Romeo (1) , Edwige Pissaloux (1) , Simon Gay (2) , Ngoc-Tan Truong (1) , Lilia Djoussouf (1)

1 LITIS - Laboratoire d'Informatique, du Traitement de l'Information et des Systèmes
2 LCIS - Laboratoire de Conception et d'Intégration des Systèmes

This paper introduces the design of a novel indoor and outdoor mobility assistance system for visually impaired people. This system is named the MAPS (Mobility Assistance Path Planning and orientation in Space), and it is based on the theoretical frameworks of mobility and spatial cognition. Its originality comes from the assistance of two main functions of navigation: locomotion and wayfinding. Locomotion involves the ability to avoid obstacles, while wayfinding involves the orientation in space and ad hoc path planning in an (unknown) environment. The MAPS architecture proposes a new low-cost system for indoor–outdoor cognitive mobility assistance, relying on two cooperating hardware feedbacks: the Force Feedback Tablet (F2T) and the TactiBelt. F2T is an electromechanical tablet using haptic effects that allow the exploration of images and maps. It is used to assist with maps’ learning, space awareness emergence, path planning, wayfinding and effective journey completion. It helps a VIP construct a mental map of their environment. TactiBelt is a vibrotactile belt providing active support for the path integration strategy while navigating; it assists the VIP localize the nearest obstacles in real-time and provides the ego-directions to reach the destination. Technology used for acquiring the information about the surrounding space is based on vision (cameras) and is defined with the localization on a map. The preliminary evaluations of the MAPS focused on the interaction with the environment and on feedback from the users (blindfolded participants) to confirm its effectiveness in a simulated environment (a labyrinth). Those lead-users easily interpreted the system’s provided data that they considered relevant for effective independent navigation.

Mots clés: Romeo; visually impaired mobility assistance; tactile tablet; tactibelt; maps' learning; space awareness emergence; path planning; wayfinding

Domaines: Automatique / Robotique

Katerine Romeo, Edwige Pissaloux, Simon Gay, Ngoc-Tan Truong, Lilia Djoussouf. The MAPS : Toward a Novel Mobility Assistance System for Visually Impaired People. Sensors, 2022, 22 (9), pp.3316. ⟨10.3390/s22093316⟩. ⟨hal-03665579⟩