WANG Wei, YANG Zhao-sheng, ZHAO Ding-xuan. Control model of variable speed limit based on finite horizon Markov decision-making[J]. Journal of Traffic and Transportation Engineering, 2011, 11(5): 109-114. doi: 10.19818/j.cnki.1671-1637.2011.05.017
Citation: WANG Wei, YANG Zhao-sheng, ZHAO Ding-xuan. Control model of variable speed limit based on finite horizon Markov decision-making[J]. Journal of Traffic and Transportation Engineering, 2011, 11(5): 109-114. doi: 10.19818/j.cnki.1671-1637.2011.05.017

Control model of variable speed limit based on finite horizon Markov decision-making

doi: 10.19818/j.cnki.1671-1637.2011.05.017
More Information
  • Author Bio:

    WANG Wei (1977-), female, lecturer, PhD, +86-431-85094337, wwei@jlu.edu.cn

  • Received Date: 2011-03-18
  • Publish Date: 2011-10-25
  • The function of variable speed limit(VSL) on expressway mainline was analyzed, and the existing methods of speed limit were studied.The control process of VSL was taken as Markov decision-making process of discrete time.A model of VSL based on reinforcement learning and finite horizon Markov decision-making was proposed.The model was dynamically adjusted through interacting with traffic environment, and solved by using finite horizon backward recursive iterative algorithm.The traffic environment of Chang-Ji Expressway was simulated by using Paramics.Analysis result shows that average traffic volume doesn't reduce, but increases by 3.20% when average limit speed decreases by 6.25% compared with design speed.So the model is feasible to increase traffic volume and improve traffic condition on expressway mainline effectively.

     

  • loading
  • [1]
    CIConsulting. 2011-2015 China highway industry invest ment analysis and forecast report[R]. Shenzhen: CIConsulting. (in Chinese)
    [2]
    ABDEL-ATY M, CUNNINGHAMRJ, GAYAH V V, et al. Dynamic variable speed limit strategies for real-time crash risk reduction on freeways[J]. Transportation Research Record, 2008(2078): 108-116.
    [3]
    LIN P, KANG KP, CHANG G L. Exploring the effectiveness of variable speed limit controls on highway work-zone operations[J]. Journal of Intelligent Transportation Systems, 2004, 8(3): 155-168. doi: 10.1080/15472450490492851
    [4]
    CHEN Da-shan. Variable speed control of highway[D]. Xi'an: Changan University, 2009. (in Chinese)
    [5]
    VAN DEN HOOGEN E, SMULDERS S, HEIDEMIJ A. Control by variable speed signs: results of the dutch experiment[C]∥IEEE. Seventh International Conference on Road Traffic Monitoring and Control. London: IEEE, 1994: 145-149.
    [6]
    HEGYI A, DE SCHUTTER B, HELLENDOORN H. Model predictive control for optimal coordination of ramp metering and variable speed limits[J]. Transportation Research Part C: Emerging Technologies, 2005, 13(3): 185-209. doi: 10.1016/j.trc.2004.08.001
    [7]
    LYLES R W, TAYLOR WC, LAVANSIRI D, et al. A field test and evaluation of variable speed limits in work zones[C]∥TRB. TRB Annual Meeting Proceedings. Washington DC: TRB, 2004: 1-21.
    [8]
    ALLABY P, HELLINGA B, BULLOCK M. Variable speed limits: safety and operational impacts of a candidate control strategy for freeway applications[J]. IEEE Transactions on Intelligent Transportation Systems, 2006, 8(4): 671-680.
    [9]
    LIANG Xin-rong, LIU Zhi-yong, SUN De-shan, et al. Control speed limitation on freeway based on support vectormachine[J]. Computer Engineering and Applications, 2005, 41(34): 178-180. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-JSGG200534056.htm
    [10]
    GAN Hong-cheng, SUN Li-jun. A study on the variable speed limits technology for freeways[J]. Transportation Science & Technology, 2004(6): 91-93. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-SKQB200406033.htm
    [11]
    LIANG Xin-rong, LIU Zhi-yong, MAO Zong-yuan. Neurofuzzy control for speed limit on expressway and its simulation study[J]. Journal of Highway and Transportation Researchand Development, 2005, 22(11): 123-125, 129. (in Chinese) http://www.cnki.com.cn/Article/CJFDTOTAL-GLJK200511031.htm
    [12]
    ZHANG Ru-bo, GU Guo-chang, LIU Zhao-de, et al. Reinforcement learning theory, algorithms and its application[J]. Control Theory and Applications, 2000, 17(5): 637-642. (in Chinese) doi: 10.3969/j.issn.1000-8152.2000.05.002
    [13]
    HUANG Bing-qiang. Research on the reinforcement learning method and its application[D]. Shanghai: Shanghai Jiaotong University, 2007. (in Chinese)
    [14]
    ZHENG Yu. Research on hierarchy reinforcement learning algorithm and its application[D]. Beijing: Beijing Jiaotong University, 2009. (in Chinese)

Catalog

    Article Metrics

    Article views (1851) PDF downloads(563) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return