TY - GEN
T1 - Integrating visual and haptic shape information to form a multimodal perceptual space
AU - Gaißert, Nina
AU - Wallraven, Christian
PY - 2011
Y1 - 2011
N2 - In this study we want to address the question to what extent the visual and the haptic modalities contribute to the final formation of a complex multisensory perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Participants were allowed to either see or touch the objects or use both senses to explore the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. By comparing the unimodal perceptual spaces to the multimodal perceptual space we tried to resolve the impact of the visual and the haptic modalities on the combined percept. We found that neither the visual nor the haptic modality dominated the final percept, but rather that the two modalities contributed to the combined percept almost equally. To investigate to which degree these results are transferrable to natural objects, we performed the same visual, haptic, and visuo-haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found almost equal contributions of the visual and the haptic modalities to the combined percept. Our results suggest that multisensory perceptual spaces are based on a complex combination of object information gathered by different senses.
AB - In this study we want to address the question to what extent the visual and the haptic modalities contribute to the final formation of a complex multisensory perceptual space. By varying three shape parameters a physical shape space of shell-like objects was generated. Participants were allowed to either see or touch the objects or use both senses to explore the objects. Similarity ratings were performed and analyzed using multidimensional scaling (MDS) techniques. By comparing the unimodal perceptual spaces to the multimodal perceptual space we tried to resolve the impact of the visual and the haptic modalities on the combined percept. We found that neither the visual nor the haptic modality dominated the final percept, but rather that the two modalities contributed to the combined percept almost equally. To investigate to which degree these results are transferrable to natural objects, we performed the same visual, haptic, and visuo-haptic similarity ratings and multidimensional scaling analyses using a set of natural sea shells. Again, we found almost equal contributions of the visual and the haptic modalities to the combined percept. Our results suggest that multisensory perceptual spaces are based on a complex combination of object information gathered by different senses.
KW - Multimodal perceptual space
KW - computer generated objects
KW - multidimensional scaling
KW - natural objects
UR - http://www.scopus.com/inward/record.url?scp=79961188877&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=79961188877&partnerID=8YFLogxK
U2 - 10.1109/WHC.2011.5945528
DO - 10.1109/WHC.2011.5945528
M3 - Conference contribution
AN - SCOPUS:79961188877
SN - 9781457702976
T3 - 2011 IEEE World Haptics Conference, WHC 2011
SP - 451
EP - 456
BT - 2011 IEEE World Haptics Conference, WHC 2011
T2 - 2011 IEEE World Haptics Conference, WHC 2011
Y2 - 22 June 2011 through 24 June 2011
ER -