Volume 12 Issue 2
. 
Turn off MathJax
Article Contents
Article Navigation >  Journal of Traffic and Transportation Engineering  > 2012  >  12(2): 62-69
Next Previous
TANG Yong, GU Hong-bin, LI Peng. Augmented semi-virtual reality cockpit technology[J]. Journal of Traffic and Transportation Engineering, 2012, 12(2): 62-69. doi: 10.19818/j.cnki.1671-1637.2012.02.009
Citation: TANG Yong, GU Hong-bin, LI Peng. Augmented semi-virtual reality cockpit technology[J]. Journal of Traffic and Transportation Engineering, 2012, 12(2): 62-69. doi: 10.19818/j.cnki.1671-1637.2012.02.009
shu

Augmented semi-virtual reality cockpit technology

doi: 10.19818/j.cnki.1671-1637.2012.02.009

  • School of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, Jiangsu, China

More Information
  • Author Bio:

    TANG Yong(1983-), male, doctoral student, +86-25-84890755, tangyong159@gmail.com

    GU Hong-bin(1957-), male, professor, PhD, +86-25-84893501, ghb@nuaa.edu.cn

  • Received Date: 2011-11-28
  • Publish Date: 2012-04-25
    Abstract
  • In order to enhance the visual sense of users and the interaction performance of human-cockpit system in the semi-virtual reality cockpit system, an augmented semi-virtual reality cockpit technolgy was presented, which incorporated a realistic view of hand into the virtual environments and made user see his own real hand in real time.The captured images by using camera were real-time segmented by skin color detecting algorithm.The segmented foreground images were rectified by using adaptive weighted stereo matching algorithm and view morphing algorithm.Hand images were seamlessly integrated into virtual environment by using virtual-real matching and virtual-real fusion methods, which can provide user with the visual images in augmented virtual environment.Experimental result shows that augmented semi-virtual reality cockpit technology make users feel true for the feedback of touch and vision.The smallest side length of the square clicked by users is 8 mm in head-mounted virtual environment.In augmented semi-virtual reality cockpit system, the average interaction time decreases by about 50% and 18% compared with traditional data glove method and semi-virtual reality method.The technolgy effectively improves the human-cockpit interaction performance of the system, enhances its practicability, and its developed cost decreases.1 tab, 11 figs, 22 refs.

     

    • FullText(HTML)
  • loading
    • References(22)
  • [1]
    GU Hong-bin, WU Dong-su, LIU Hui. Development of a novel low-cost flight simulator for pilot training[J]. World Academy of Science, Engineering and Technology, 2009(60): 685-689.
    [2]
    MCCARTY W D, SHEASBY S, AMBURN P, et al. Avirtual cockpit for a distributed interactive simulation[J]. IEEE Computer Graphics and Applications, 1994, 14(1): 49-54.
    [3]
    HOSSEINI M, MALRIC F, GEORGANAS N D. A haptic virtual environment for industrial training[C]//IEEE. IEEE International Workshop on Haptic Virtual Environments and their Applications. Ottawa: IEEE, 2002: 25-30.
    [4]
    REN Cheng, DAI Shu-ling. Implementation of cyber-glove based realistic virtual hand[J]. Journal of System Simulation, 2008, 20(22): 6214-6217. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200822050.htm
    [5]
    O'HAGAN R G, ZELINSKY A, ROUGEAUX S. Visual gesture interfaces for virtual environments[J]. Interacting with Computers, 2002, 14(3): 231-250.
    [6]
    TOSAS M, LI B. Virtual touch screen for mixed reality[C]// HCI/ECCV. Computer Vision in Human-Computer Interaction of Lecture Notes in Computer Science. Prague: Springer-Verlag, 2004: 48-59.
    [7]
    FANG Gao-lin, GAO Wen, ZHAO De-bin. Large vocabulary sign language recognition based on fuzzy decision trees[J]. IEEE Transactions on Systems, Man, and Cybernetics, 2004, 34(3): 305-314.
    [8]
    GAO Wen, MA Ji-yong, WU Jiang-qin, et al. Sign language recognition based on HMM/ANN/DP[J]. International Journal on Pattern Recognition and Artificial Intelligence, 2000, 14(5): 587-602.
    [9]
    HAO Ai-min, HE Bing, ZHAO Qin-ping. Review of augmented virtualit ytechnology in virtual reality[J]. Journal of Beijing University of Aeronautics and Astronautics, 2003, 29(10): 909-913. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-BJHK200310016.htm
    [10]
    DAI Shu-lin, LEI Xiao-yong, MEI Ji-hong. Virtual cockpit system[J]. Journal of System Simulation, 2002, 14(4): 488-492. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200204025.htm
    [11]
    SALZMANN H, FROEHLICH B. The two-user seating buck: enabling face-to-face discussions of novel car interface concepts[C]//IEEE. IEEE Virtual Reality 2008. Keno: IEEE, 2008: 75-82.
    [12]
    ZHOU Lai, GU Hong-bin, SUN Jin, et al. Hand pose estimation based on maximum a posteriori framework in semi-virtual reality cockpit[J]. Acta Aeronautica et Astronautica Sinica, 2011, 32(7): 1252-1259. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-HKXB201107012.htm
    [13]
    LUO Bin, YAO Peng, WENG Dong-dong, et al. Novel, lightweight flight simulator system based on mixed reality[J]. Journal of System Simulation, 2009, 21(17): 5406-5410. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-XTFZ200917033.htm
    [14]
    ZHANG Zheng-you. Flexible camera calibration by viewing a plane from unknown orientations[C]//IEEE. Proceedings of the Seventh IEEE International Conference on Computer Vision. Los Alamitos: IEEE, 1999: 666-673.
    [15]
    XU Zhan-wu, ZHU Miao-liang. Optimum colorspace for skin-tone detection[J]. Journal of Computer-Aided Design and Computer Graphics, 2006, 18(9): 1350-1356. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-JSJF200609011.htm
    [16]
    TANG Yong, GU Hong-bin, ZHOU Lai. Real-time hand segmentation and fingertip detection for interaction[J]. Opto-Electronic Engineering, 2010, 37(7): 145-150. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-GDGC201007030.htm
    [17]
    EDWARDS E K, ROLLAND J P, KELLER K P. Video seethrough design for merging of real and virtual environments[C]// IEEE. Proceedings of IEEE Virtual Reality Annual International Symposium. New York: IEEE, 1993: 223-233.
    [18]
    ROLLAND J P, BIOCCA F A, BARLOW T, et al. Quantification of adaptation to virtual-eye location in see-thru headmounted displays[C]//IEEE. Proceedings of the Virtual Reality Annual International Symposium. Los Alamitos: IEEE, 1995: 56-66.
    [19]
    TANG Yong, GU Hong-bin. Automatic virtual view generation based on view morphing[J]. Journal of Computational Information Systems, 2011, 7(6): 2051-2057.
    [20]
    YOON K J, KWEON I S. Locally adaptive support-weight approach for visual correspondence search[C]//IEEE. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington DC: IEEE, 2005: 924-931.
    [21]
    ZITNICK C L, KANADE T. A cooperative algorithm for stereo matching and occlusion detection[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(7): 675-684.
    [22]
    SCHIEFELE J, ALBERT O, VAN LIER V, et al. Simple force feedback for small virtual environments[C]//SPIE. Conference of Modeling and Simulating Sensory Response for Real and Virtual Environments. Orlando: SPIE, 1998: 100-110.
    • Relative Articles
    • Supplements(0)
    • Cited By

Catalog

    Get Citation
    PDF
    XML

    Article Metrics

    Article views (1832) PDF downloads(906) Cited by()
    Related

    Website copyright Journal of Traffic and Transportation Engineering Editorial Department陕ICP备05001904号-1

    Address ：Editorial Department of Journal of Traffic and Transportation Engineering, Chang'an University, Middle Section of South 2nd Ring Road, Xi'an, China（710064） Tel：029-82334388 Email：jygc@gfscw.cn

    All visit:Today's visit:

    Supported by: Beijing Renhe Information Technology Co. Ltd    

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return