ISSN 2041-6695

Volume 2, issue 8 contents

The International Multisensory Research Forum (IMRF) is an annual meeting. The 2011 meeting was held 17‒20 October in Fukuoka, Japan. The conference provides a platform for scientists who are interested in how different senses interact with each other and are integrated. Researchers from many different disciplines, including neuroscience, psychophysics, cognitive psychology, computational modeling, developmental research, and engineering, participate. This year, Yôiti Suzuki was the general chair of the organizing committee, which included members from universities and research institutes in Japan. The following are the abstracts of keynote speakers, symposia, talks, and posters from the conference.

Symposium 1: Multi-sensory integration, sensory substitution technology and visual rehabilitation, Monday 17 October, 9:30 - 11:00

Preserved functional specialization in sensory substitution of the early blind 749
Josef P Rauschecker, Laurent Renier, Paula Plaza, Anne DeVolder

Talk Session 1, Monday 17 October, 11:00 - 12:15

Transferrable learning of multisensory cues in flight simulation 751
Georg F Meyer, Li Wong, Emma Timson, Philip Perfect, Mark White

Consistency between modalities enhances visually induced self-motion (vection) 753
Takeharu Seno, Hiroyuki Ito, Shoji Sunaga, Emi Hasuo, Yoshitaka Nakajima, Masaki Ogawa

Keynote 1, Monday 17 October, 13:30 - 14:30


Poster Session 1, Monday 17 October, 14:30 - 16:30

Auditory influences in V1 of mice induced by varying anesthesia level 755
Rüdiger Land, Andreas Engel, Andrej Kral

Neural architecture of auditory object categorization 756
Yune-Sang Lee, Michael Hanke, David Kraemer, Samuel Lloyd, Richard Granger

Temporal multisensory processing and its relationship to autistic functioning 759
Leslie D Kwakye, Brittany C Schneider, Mark T Wallace

Multisensory enhancement in auditory and visual noise in adults 765
Harriet C Downing, Ayla Barutchu, Sheila Crewther

Audio-visual peripheral localization disparity 766
Ryota Miyauchi, Dae-Gee Kang, Yukio Iwaya, Yôiti Suzuki

A cross-linguistic ERP examination of audiovisual speech perception between English and Japanese 767
Satoko Hisanaga, Kaoru Sekiyama, Tomohiko Igasaki, Nobuki Murayama

Context information on the McGurk effect 770
Masayo Kajimura, Haruyuki Kojima, Hiroshi Ashida

Attention effects on letter-speech sound integration 771
Maria Mittag, Tommi Makkonen, Kimmo Alho, Rika Takegata, Teija Kujala

Self-voice, but not self-face, reduces the McGurk effect 772
Christopher Aruffo, David I Shore

Contribution of prosody in audio-visual integration to emotional perception of virtual characters 774
Ekaterina Volkova, Betty Mohler, Sally Linkenauger, Ivelina Alexandrova, Heinrich H Bülthoff

Recording and validation of audiovisual expressions by faces and voices 775
Sachiko Takagi, Saori Hiramatsu, E M J Huis in't Veld, Beatrice de Gelder, Akihiro Tanaka

Audiovisual modulation of attention towards fearful stimuli 776
Martijn Balsters, Emiel Krahmer, Marc Swerts, Ad Vingerhoets

The effects of anxiety on the recognition of multisensory emotional cues with different cultural familiarity 777
Ai Koizumi, Akihiro Tanaka, Hisato Imai, Eriko Hiramoto, Saori Hiramatsu, Beatrice de Gelder

Individual differences on the McGurk effect: An examination with the autism trait and schizotypal personality 780
Yuta Ujiie, Tomohisa Asai, Akihiro Tanaka, Kaori Asakawa, Akio Wakabayashi

Audio-visual integration of emotional information 781
Penny Bergman, Daniel Västfjäll, Ana Tajadura-Jiménez

Implicit mood induction and scope of visual processing 783
Kei Fuji, Hirotsune Sato, Jun-ichiro Kawahara, Masayoshi Nagai

Relationships between cognitive functions and mood of elders in an institute 784
Michiyo Ando, Nobu Ide, Haruko Kira, Hiroko Kukihara

A basic study on P300 event-related potentials evoked by simultaneous presentation of visual and auditory stimuli for the communication interface 785
Masami Hashimoto, Makoto Chishima, Kazunori Itoh, Mizue Kayama, Makoto Otani, Yoshiaki Arai

Superior temporal activity for the retrieval process of auditory-word associations 787
Toshimune Kambara, Takashi Tsukiura, Rui Nouchi, Yayoi Shigemune, Yukihito Yomogida, Akitake Kanno, Ryuta Kawashima

The sense of verisimilitude has different spatial-temporal characteristics from those producing the sense of presence in the evaluation process of audiovisual contents 789
Takayuki Kanda, Akio Honda, Hiroshi Shibata, Nobuko Asai, Wataru Teramoto, Shuichi Sakamoto, Yukio Iwaya, Jiro Gyoba, Yôiti Suzuki

Multi-sensory-motor research: Investigating auditory, visual, and motor interaction in virtual reality environments 790
Thorsten Kluss, Niclas Schult, Tim Hantel, Christoph Zetzsche, Kerstin Schill

Video conference system that keeps mutual eye contact among participants 791
Masahiko Yahagi, Nami Moriyama, Takayuki Mori, Nobuo Nakajima

Tactile change blindness induced by tactile and visual distractors 794
Malika Auvray, Alberto Gallace, Takako Yoshida, Charles Spence

Digging up von Békésy: Funneling of touches around the body 798
Lisa M Pritchett, Laurence R Harris

Critical factors for inducing curved somatosensory saccades 800
Tamami Nakano, Shigefumi Neshime, Yuri Shojima, Shigeru Kitazawa

Basic research for development of a communication support device using air-conducted sound localization 804
Makoto Chishima, Makoto Otani, Mizue Kayama, Masami Hashimoto, Kazunori Itoh, Yoshiaki Arai

Distortion of auditory space during linear self-motion 806
Wataru Teramoto, Fumimasa Furune, Shuichi Sakamoto, Jiro Gyoba, Yôiti Suzuki

Detection thresholds of sound image movement deteriorate during sound localization 807
Kagesho Ohba, Yukio Iwaya, Akio Honda, Yôiti Suzuki

Influence of auditory and haptic stimulation in visual perception 808
Shunichi Kawabata, Takuro Kawabata, Masafumi Yamada, Seika Yanagida, Atsuo Nuruki, Kazutomo Yunokuchi, John Rothwell

The effect of oddball events on time perception 812
Qiongyao Shao, Tadayuki Tayama

Cross-modal perception in the framework of non-Riemannian sensory space 813
Masaru Shimbo, Jun Toyama, Masashi Shimbo

Modeling the temporal profile of multisensory integration 814
Benjamin A Rowland, Terrence R Stanford, Barry E Stein

Symposium 2: Multisensory integration from neurons to behavior—bridging the gap via computational models, Monday 17 October, 16:30 - 18:00

A computational model of the SC multisensory neurons: Integrative capabilities, maturation, and plasticity 815
Cristiano Cuppini, Mauro Ursino, Elisa Magosso, Benjamin A Rowland, Barry E Stein

Optimal time windows of integration 816
Hans Colonius, Adele Diederich

Symposium 3: Human movement, motor learning, and sensory plasticity, Tuesday 18 October, 9:00 - 10:30

Efficient cross-modal transfer of shape information in visual and haptic object categorization 822
Nina Gaissert, Steffen Waterkamp, Loes van Dam, Heinrich Buelthoff, Christian Wallraven

Talk Session 2, Tuesday 18 October, 11:00 - 12:15

Visual and haptic mental rotation 823
Satoshi Shioiri, Takanori Yamazaki, Kazumichi Matsumiya, Ichiro Kuriki

Haptic influence on visual search 824
Marcia Grabowecky, Alexandra List, Lucica Iordanescu, Satoru Suzuki

Tactile working memory outside our hands 826
Takako Yoshida, Hong Tan, Charles Spence

Keynote 2, Tuesday 18 October, 13:30 - 14:30

Interaction between space and effectiveness in multisensory integration: Behavioral and perceptual measures 828
Aaron R Nidiffer, Ryan A Stevenson, Juliane Krueger-Fister, Zachary P Barnett, Mark T Wallace

Poster Session 2, Tuesday 18 October, 14:30 - 16:30

Multisensory interactions across spatial location and temporal synchrony 830
Ryan A Stevenson, Juliane K Fister, Zachary P Barnett, Aaron R Nidiffer, Mark T Wallace

Temporal aspects of sound induced visual fission and fusion in the double-flash illusion paradigm 832
Lars T Boenke, Richard Höchenberger, Frank W Ohl, David Alais

Audiovisual interaction in time perception 833
Kuan-Ming Chen, Su-Ling Yeh

A fundamental study on influence of concurrently presented visual stimulus upon loudness perception 837
Koji Abe, Shota Tsujimura, Shouichi Takane, Kanji Watanabe, Sojun Sato

Visual target localization, the effect of allocentric audiovisual reference frame 838
David Hartnagel, Julien Chataignier, Lionel Pellieux, Patrick M B Sandor

Multidimensional attributes of the sense of presence in audio-visual content 841
Kazutomo Fukue, Kenji Ozawa, Yuichiro Kinoshita

Crossmodal activation of visual object regions for auditorily presented concrete words 843
Jasper J F van den Bosch, Derya Dogruel, Jochen Kaiser, Christian Fiebach, Marcus Naumer

Red is no warmer than blue: A challenge to the semantic coding hypothesis 849
George Van Doorn, Mark Symmons, Barry Richardson

Somatotopic representation of visual stimuli–evidence from the Simon effect 850
Jared Medina, Michael P Greenberg, H Branch Coslett, Roy H Hamilton

Similarity and difference in symmetry between the visual and haptic motional representations 854
Mitsumasa Takahashi, Kazumichi Matsumiya, Ichiro Kuriki, Rumi Tokunaga, Satoshi Shioiri

Integration of visual and vestibular information used to discriminate rotational self-motion 855
Florian Soyka, Ksander de Winkel, Michael Barnett-Cowan, Eric Groen, Heinrich H Bülthoff

Riding a motorcycle simulator: How do visual and non-visual cues contribute to the illusion of leaning in a bend 856
Virginie Dagonneau, Régis Lobjois, Stéphane Caro, Amit Shahar, Isabelle Israël

Reconstruction of spatial cognition from other's view and motion information 857
Kyo Hattori, Daisuke Kondo, Yuki Hashimoto, Tomoko Yonemura, Hiroyuki Iizuka, Hideyuki Ando, Taro Maeda

Velocity modulation of optical flow affects self-motion perception during body motion 858
Tomoko Yonemura, Shin Okamoto, Hiroki Kawasaki, Daisuke Kondo, Yuki Hashimoto, Hiroyuki Iizuka, Hideyuki Ando, Taro Maeda

Effects of visual vertical and motion for visually-induced body sway 859
Toshihiro Takahashi, Makoto Inagami, Hirohiko Kaneko

Psychophysical influence of mixed-reality visual stimulation on sense of center-of-gravity 860
Hiroki Omosako, Asako Kimura, Fumihisa Shibata, Hideyuki Tamura

Effects of different types of 3D rest frames on reducing cybersickness in a virtual environment 861
KyungHun Han, ChangHoon Park, EungSuk Kim, DaeGuen Kim, SungHo Woo, JiWoon Jeong, InJae Hwang, HyunTaek Kim

The effects of head movement and accurate proprioceptive feedback in training of sound localization 865
Akio Honda, Hiroshi Shibata, Souta Hidaka, Jiro Gyoba, Yukio Iwaya, Yôiti Suzuki

Sound localization in the coexistence of visually induced self-motion and vestibular information 866
Hideaki Terashima, Zhenglie Cui, Shuichi Sakamoto, Yukio Iwaya, Yôiti Suzuki

Consistent wind facilitates vection 868
Masaki Ogawa, Takeharu Seno, Hiroyuki Ito, Shoji Sunaga

Effect of an hour-long stereoscopic film on human body 869
Masumi Takada, Kiichi Murakami, Yasuyuki Matsuura, Hiroki Takada, Satoshi Iwase, Masaru Miyao

Interactions between flavor and taste: Using dashi soup as a taste stimulus 870
Nobuyuki Sakai, Manami Fujimoto, Megumi Murata

Audiovisual capture with ambiguous audiovisual stimuli 877
Jean-Michel Hupé, Daniel Pressnitzer

Symposium 4: Audiovisual integration: How early does it occur?, Tuesday 18 October, 16:30 - 18:00

Crossmodal contingent aftereffect 880
Wataru Teramoto, Maori Kobayashi, Souta Hidaka, Yoichi Sugita

Symposium 5: Effects of proprioceptive and vestibular processing on visual perception, Wednesday 19 October, 9:00 - 10:30

The stream/bounce effect with manual control of moving disks 883
Philip M Grove, Micah Bernoff, Kenzo Sakurai

Perceived direction of self-motion from orthogonally directed visual and vestibular stimulation in passive and active observation 886
Kenzo Sakurai, Toshio Kubodera, Philip M Grove, Shuichi Sakamoto, Yôiti Suzuki

Crossmodal correspondences 887
Charles Spence, Cesare Parise, Ophelia Deroy

Talk Session 3, Wednesday 18 October, 11:00 - 12:15

Ensemble coding in audition 889
Elise Piazza, Timothy Sweeny, David Wessel, David Whitney

Direct contribution of auditory motion information to sound-induced visual motion perception 890
Souta Hidaka, Wataru Teramoto, Yoichi Sugita, Yuko Manaka, Shuichi Sakamoto, Yôiti Suzuki

Visual distance cues amplify neuromagnetic auditory N1m responses 891
Christian F Altmann, Masao Matsuhashi, Mikhail Votinov, Kazuhiro Goto, Tatsuya Mima, Hidenao Fukuyama

A multi-sensory illusion: Hong Kong peak tram illusion (II) – subjective vertical 892
Hiu Mei Chow, Ping-Hui Chiu, Chia-huei Tseng, Lothar Spillmann

Student Award Session, Wednesday 19 October, 14:00 - 15:00

Context and crossmodal interactions: An ERP study 893
Beatriz R Sarmiento, Daniel Sanabria

Crossmodal transfer of object information in human echolocation 894
Santani Teng, Amrita Puri, David Whitney

A ventral visual stream reading center independent of sensory modality and visual experience 896
Lior Reich, Ella Striem-Amit, Marcin Szwed, Ornella Dakwar, Miri Guendelman, Laurent Cohen, Amir Amedi

Temporal integration of auditory stimulation and binocular disparity signals 897
Marina Zannoli, John Cass, David Alais, Pascal Mamassian

Evidence for a mechanism encoding audiovisual spatial separation 898
Emily Orchard-Mills, Johahn Leung, Maria C Morrone, David Burr, Ella Wufong, Simon Carlile, David Alais

What is sensory about multi-sensory enhancement of vision by sounds? 899
Alexis Pérez-Bellido, Salvador Soto-Faraco, Joan López-Moliner

Crossmodal semantic constraints on visual perception of binocular rivalry 900
Yi-Chuan Chen, Su-Ling Yeh, Charles Spence

Multisensory integration: When correlation implies causation 901
Cesare V Parise, Vanessa Harrar, Charles Spence, Marc Ernst

Poster Session 3, Wednesday 19 October, 15:00 - 17:00

Temporal integration of auditory stimulation and binocular disparity signals 902
Marina Zannoli, John Cass, David Alais, Pascal Mamassian

Multisensory illusions and the temporal binding window 903
Ryan A Stevenson, Raquel K Zemtsov, Mark T Wallace

Dynamics of multi-sensory tracking 905
Johahn Leung, Vincent Wei, Simon Carlile

Evidence for a mechanism encoding audiovisual spatial separation 906
Emily Orchard-Mills, Johahn Leung, Maria C Morrone, David Burr, Ella Wufong, Simon Carlile, David Alais

Context and crossmodal interactions: An ERP study 908
Beatriz R Sarmiento, Daniel Sanabria

What is sensory about multi-sensory enhancement of vision by sounds? 911
Alexis Pérez-Bellido, Salvador Soto-Faraco, Joan López-Moliner

Interactive processing of auditory amplitude-modulation rate and visual spatial frequency 913
Marcia Grabowecky, Emmanuel Guzman-Martinez, Laura Ortega, Julia Mossbridge

Multisensory integration: When correlation implies causation 914
Cesare V Parise, Vanessa Harrar, Charles Spence, Marc Ernst

Synchronous sounds enhance visual sensitivity without reducing target uncertainty 915
Yi-Chuan Chen, Pi-Chun Huang, Su-Ling Yeh, Charles Spence

Crossmodal semantic constraints on visual perception of binocular rivalry 916
Yi-Chuan Chen, Su-Ling Yeh, Charles Spence

Immature multisensory enhancement in auditory and visual noise in adolescents 917
Harriet C Downing, Ayla Barutchu, Sheila Crewther

A ventral visual stream reading center independent of sensory modality and visual experience 918
Lior Reich, Ella Striem-Amit, Marcin Szwed, Ornella Dakwar, Miri Guendelman, Laurent Cohen, Amir Amedi

Unimodal and multi-modal perception of cellular phones: A multidimensional scaling study 919
Yusuke Yamani, Hyun Woo, Jason S McCarley, Deana C McDonagh

A multi-sensory illusion: Hong Kong peak tram illusion (II) – subjective vertical 920
Hiu Mei Chow, Ping-Hui Chiu, Chia-huei Tseng, Lothar Spillmann

The long-term potentiation-like effect in the corticomotor area after transcranial direct current stimulation with motor imagery 921
Eriko Shibata, Fuminari Kaneko, Tatsuya Hayami, Keita Nagahata, Masaki Katayose

The build-up course of visuo-motor and audio-motor temporal recalibration 922
Yoshimori Sugano, Mirjam Keetels, Jean Vroomen

The effect of fatigued external rotator muscles of the shoulder on the shoulder position sense 930
Naoya Iida, Fuminari Kaneko, Nobuhiro Aoki, Yoshinari Sakaki

Action-induced rubber hand illusion 932
Pao-Chou Cho, Timothy Lane, Su-Ling Yeh

Self-produced tickle sensation by manipulating visual feedback 935
Hiroyuki Iizuka, Hideyuki Ando, Taro Maeda

Spatial alignment of the senses: The role of audition in eye-hand-coordination 939
Thorsten Kluss, Niclas Schult, Kerstin Schill, Christoph Zetzsche, Manfred Fahle

Crossmodal transfer of object information in human echolocation 940
Santani Teng, Amrita Puri, David Whitney

Effects of compression by means of sports socks on the ankle kinesthesia 941
Tatsuya Hayami, Fuminari Kaneko, Naoya Iida, Eriko Shibata, Nobuhiro Aoki, Takashi Miura, Tetsuji Iwasaki

What and how you see affects your appetite 943
Hsin-I Liao, Shinsuke Shimojo, Szu-Chi Huang, Su-Ling Yeh

Color congruent odorant is perceived prominently in mixture odor 944
Mari Arao, Maya Suzuki, Jun'ichi Katayama, Akihiro Yagi

Tasting with eyes 945
Nobuyuki Sakai

Visually perceived fat content of foods affects response time 947
Vanessa Harrar, Ulrike Toepel, Micah Murray, Charles Spence

Infant visual preference to strawberry enhanced by in-season odor 948
Yuji Wada, Yuna Inada, Jiale Yang, Satomi Kunieda, Tomohiro Masuda, Atsushi Kimura, So Kanazawa, Masami K Yamaguchi

Dissociation between olfactory and auditory-verbal processing in the occipital cortex of early blind subjects 950
Laurent A Renier, Isabel Cuevas, Paula Plaza, Laurence Dricot, Elodie Lerens, Cécile B Grandin, Philippe Rombaux, Anne G De Volder

Olfactory cerebral evoked potentials for pleasant and unpleasant smells in humans 952
Tomohiko Igasaki, Shinji Yamaguchi, Yuki Hayashida, Nobuki Murayama

Stimulation with an intermittent fragrance relieves the sleepiness of a driver 953
Kenji Susami, Chika Oshima, Kayoko Muto, Hiroshi Ando, Noriyoshi Matsuo

Emotional incongruence of facial expression and voice tone investigated with event-related brain potentials of infants 954
Kota Arai, Yasuyuki Inoue, Masaya Kato, Shoji Itakura, Shigeki Nakauchi, Michiteru Kitazaki

Brain network involved in the recognition of facial expressions of emotion in the early blind 956
Ryo Kitada, Yuko Okamoto, Akihiro T Sasaki, Takanori Kochiyama, Motohide Miyahara, Susan Lederman, Norihiro Sadato

Symposium 6: The influences of multisensory integration and attention on each other, Thursday 20 October, 9:00 - 10:30

The temporal window of multisensory integration under competing circumstances 962
Erik Van der Burg, John Cass, David Alais, Jan Theeuwes

Talk Session 4, Thursday 20 October, 11:00 - 12:15

Musical sight-reading expertise: Cross-modality investigations 965
Veronique Drai-Zerbib, Thierry Baccino

Effects of visual food texture on taste perception 966
Katsunori Okajima, Charles Spence

A case of phantom synchiric percepts in touch and vision 967
Jared Medina, Daniel E Drebing, Roy H Hamilton, H Branch Coslett

Multisensory perception of affect 968
Beatrice de Gelder

Keynote 3, Thursday 20 October, 12:15 -13:15







Pion logoa Pion publication