Dynamic Crosswalk Scene Understanding for the Visually Impaired - Université de Rennes Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Neural Systems and Rehabilitation Engineering Année : 2021

Dynamic Crosswalk Scene Understanding for the Visually Impaired

Shishun Tian
  • Fonction : Auteur
  • PersonId : 1095115
Wenbin Zou
  • Fonction : Auteur correspondant
  • PersonId : 1084337

Connectez-vous pour contacter l'auteur
Xia Li
  • Fonction : Auteur
  • PersonId : 948385

Résumé

Independent mobility poses a great challenge to the visually impaired individuals. This paper proposes a novel system to understand dynamic crosswalk scenes, which detects the key objects, such as crosswalk, vehicle, and pedestrian, and identifies pedestrian traffic light status. The indication of where and when to cross the road is provided to the visually impaired based on the crosswalk scene understanding. Our proposed system is implemented on a head-mounted mobile device (SensingAI G1) equipped with an Intel RealSense camera and a cellphone, and provides surrounding scene information to visually impaired individuals through audio signal. To validate the performance of the proposed system, we propose a crosswalk scene understanding dataset which contains three sub-datasets: a pedestrian traffic light dataset with 7447 images, a dataset of key objects on the crossroad with 1006 images and a crosswalk dataset with 3336 images. Extensive experiments demonstrated that the proposed system was robust and outperformed the state-of-the-art approaches. The experiment conducted with the visually impaired subjects shows that the system is practical useful.
Fichier principal
Vignette du fichier
Dynamic_Crosswalk_Scene_Understanding_for_the_Visually_Impaired.pdf (15.02 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03330267 , version 1 (02-06-2023)

Identifiants

Citer

Shishun Tian, Minghuo Zheng, Wenbin Zou, Xia Li, Lu Zhang. Dynamic Crosswalk Scene Understanding for the Visually Impaired. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2021, 29, pp.1478-1486. ⟨10.1109/TNSRE.2021.3096379⟩. ⟨hal-03330267⟩
80 Consultations
20 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More