Shape-aware spatio-temporal descriptors for interaction classification - Calcul des Variations, Géométrie, Image Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Shape-aware spatio-temporal descriptors for interaction classification

Résumé

Many real-world tasks for autonomous agents benefit from understanding dynamic inter-object interactions. Detecting, analyzing and differentiating between the various ways that an object can be interacted with provides implicit information about its function. This can help train autonomous agents to handle objects and understand unknown scenes. We describe a general mathematical framework to analyze and classify interactions, defined as dynamic motions performed by an active object onto a passive one. We factorize interactions via motion features computed in the spatio-temporal domain, and encoded into a global, object-centric signature. Equipped with a similarity measure to compare such signatures, we showcase classification of interactions with a single object. We also propose a novel acquisition setup combining RGBD sensing with a virtual reality (VR) display, to capture interactions with purely virtual objects.
Fichier non déposé

Dates et versions

hal-01884481 , version 1 (01-10-2018)

Identifiants

Citer

Soren Pirk, Olga Diamanti, Boris Thibert, Danfei Xu, Leonidas Guibas. Shape-aware spatio-temporal descriptors for interaction classification. 2017 IEEE International Conference on Image Processing (ICIP), Sep 2017, Beijing, France. ⟨10.1109/ICIP.2017.8297139⟩. ⟨hal-01884481⟩
38 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More