TY - GEN
T1 - The effect of spatial consistence on visual detection and discretion
AU - Yang, Jingjing
AU - Chu, Jinlong
AU - Li, Xiujun
AU - Li, Qi
AU - Wu, Jinglong
N1 - Funding Information:
The study was financially supported by Science and Technology Innovation fund of Changchun University of Science and Technology project (XJJLG-2016-18), the “13th Five-year plan” scientific and technological research project(JJKH20181138KJ) Department of Education of Jilin Province. We thank the subjects who participated in this study and the staff of Changchun University of Science and Technology, China.
PY - 2018/10/5
Y1 - 2018/10/5
N2 - The human brain is the most complex and efficient information processing system in nature. It can efficiently process information from multiple senses. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. This study designed behavioral experiments to control the selective attention of the visual modal of the subjects, and studied the reaction time and accuracy rate of the human brain to unimodal visual/auditory stimuli and multimodal audiovisual mixed stimuli under selective attention conditions. Through analysis of experimental results, it was found that the information processing of human brain has different mechanisms under the two task conditions. When the task was spatially irrelevant, the multimodal stimuli promotes the visual discovery regardless of the position. When the task was spatially related, whether the spatial position of the auditory stimulus was consistent or not had a different influence on the visual stimulus position. Auditory stimuli that were not attended affect visual information processing, which was associated with experimental tasks. We expect that these results could helpful to process the audiovisual information of artificial intelligence.
AB - The human brain is the most complex and efficient information processing system in nature. It can efficiently process information from multiple senses. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. This study designed behavioral experiments to control the selective attention of the visual modal of the subjects, and studied the reaction time and accuracy rate of the human brain to unimodal visual/auditory stimuli and multimodal audiovisual mixed stimuli under selective attention conditions. Through analysis of experimental results, it was found that the information processing of human brain has different mechanisms under the two task conditions. When the task was spatially irrelevant, the multimodal stimuli promotes the visual discovery regardless of the position. When the task was spatially related, whether the spatial position of the auditory stimulus was consistent or not had a different influence on the visual stimulus position. Auditory stimuli that were not attended affect visual information processing, which was associated with experimental tasks. We expect that these results could helpful to process the audiovisual information of artificial intelligence.
KW - Audiovisual interaction
KW - Event-related potential
KW - Spatial information
UR - http://www.scopus.com/inward/record.url?scp=85056299689&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85056299689&partnerID=8YFLogxK
U2 - 10.1109/ICMA.2018.8484523
DO - 10.1109/ICMA.2018.8484523
M3 - Conference contribution
AN - SCOPUS:85056299689
T3 - Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018
SP - 2388
EP - 2393
BT - Proceedings of 2018 IEEE International Conference on Mechatronics and Automation, ICMA 2018
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 15th IEEE International Conference on Mechatronics and Automation, ICMA 2018
Y2 - 5 August 2018 through 8 August 2018
ER -