WANG Xing-ju, GAO Gui-feng, MIYAGI T. RLRM control method of single entrance ramp for highway[J]. Journal of Traffic and Transportation Engineering, 2012, 12(3): 101-107. doi: 10.19818/j.cnki.1671-1637.2012.03.015
Citation: WANG Xing-ju, GAO Gui-feng, MIYAGI T. RLRM control method of single entrance ramp for highway[J]. Journal of Traffic and Transportation Engineering, 2012, 12(3): 101-107. doi: 10.19818/j.cnki.1671-1637.2012.03.015

RLRM control method of single entrance ramp for highway

doi: 10.19818/j.cnki.1671-1637.2012.03.015
More Information
  • Author Bio:

    WANG Xing-ju (1978-), male, associate professor, PhD, +86-311-87939527, wangxingju@stdu.edu.cn

  • Received Date: 2011-12-27
  • Publish Date: 2012-06-25
  • In order to relieve freeway traffic congestion, reinforcement learning ramp metering(RLRM) control method for single entrance ramp of highway under the incomplete information was proposed based on the artificial intelligence theories of reinforcement learning.Average speeds, average densities, traffic outflows and travel times of numerical cases 1-6 were calculated, and the control effect of RLRM was compared with no control and fixed-time control.Simulation result shows that in case 1 with the lowest traffic inflow, the congestion relief rates of fixed-time control and RLRM control depending on travel time are-6.25% and-9.38% respectively, which indicates that the control effect is not significant.When the traffic inflow increases in case 3, the congestion relief rates of fixed-time control and RLRM control depending on travel time are-8.19% and 3.51% respectively, which indicates that the control has some effect, and RLRM control performs better than fixed-time control.In case 6 with the highest traffic inflow, the congestion relief rates of fixed-time control are 8.20%, 0.39%, 18.97% and 23.99% respectively, and those of RLRM control are 18.18%, 3.42%, 30.65% and 44.41% taking average speed, average density, traffic outflow and travel time as evaluating indexes respectively, which shows that RLRM control effect is more significant than fixed-time control.So the greater the traffic inflow is, the better the control effect of RLRM is.

     

  • loading
  • [1]
    ZHU Jian-guo, WANG Chao-hui. Effect evaluation system of freeway construction meticulous management[J]. Journal of Chang'an University: Natural Science Edition, 2012, 32(2): 52-57. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-XAGL201202012.htm
    [2]
    GAN Hong-cheng, CHEN Jian-yang, WANG Qing. Integrated routing and ramp metering control for freeway networks[J]. Systems Engineering, 2009, 27(6): 78-82. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-GCXT200906012.htm
    [3]
    XU Jian-min, LI Lin, LIN Pei-qun, et al. Simulation-based evaluation for expressway traffic control strategies[J]. Highway, 2011(2): 83-87. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-GLGL201102018.htm
    [4]
    CAO Zhi-wei, HAN Yin. Study on freeway on-ramp control based on fuzzy theory[J]. Traffic and Transportation, 2011(7): 54-58. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-JTYH201101016.htm
    [5]
    GOMES G, HOROWITZ R. Optimal freeway ramp metering using the asymmetric cell transmission model[J]. Transpor-tation Research Part C: Emerging Technologies, 2006, 14(4): 244-262. doi: 10.1016/j.trc.2006.08.001
    [6]
    PANG Ming-bao, HE Guo-guang, MA Ning. On-ramp chaos control of freeway system with fuzzy delay feedback based on genetic algorithm[J]. China Civil Engineering Journal, 2009, 42(3): 125-131. (in Chinese). doi: 10.3321/j.issn:1000-131X.2009.03.021
    [7]
    ZHANG Hai-jun, YANG Xiao-guang, ZHANG Jue. Review of freeway on-ramp metering methodologies[J]. Journal of Tongji University: Natural Science, 2005, 33(8): 1051-1055, 1082. (in Chinese). doi: 10.3321/j.issn:0253-374X.2005.08.012
    [8]
    JIANG Zi-feng, JING Bian-shun, HAN Xi-ling. Simulation study of on-ramp control in freeway[J]. China Journal of Highway and Transport, 1997, 10(2): 83-89. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-ZGGL199702014.htm
    [9]
    PAPAGEORGIOU M, HADJ-SALEM H, MIDDELHAM F. ALINEA local ramp metering: summary of field results[J]. Transportation Research Record, 1997(1603): 90-98. doi: 10.3141/1603-12
    [10]
    ZHENG Fei, DU Yu-chuan, SUN Li-jun. ALINEA-based on-ramp traffic-responsive local-metering strategy for express-way in Shanghai[J]. Journal of Tongji University: Natural Science, 2009, 37(6): 766-771. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-TJDZ200906011.htm
    [11]
    HE Jing-kai, XU Jian-min. Design of on-ramp controller based on BP neural networks[J]. Journal of South China University of Technology: Natural Science Edition, 2002, 30(7): 24-27. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-HNLG200207006.htm
    [12]
    LIU Ping, REN Jian-ting. Freeway ramp metering based on PID neural network[J]. Science Technology and Engineering, 2011, 11(32): 7961-7966. (in Chinese). doi: 10.3969/j.issn.1671-1815.2011.32.027
    [13]
    CHEN De-wang, WANG Fei-yue, CHEN Long. Freeway ramp control algorithm based on neurofuzzy networks[J]. Journal of Traffic and Transportation Engineering, 2003, 3(2): 100-105. (in Chinese). http://transport.gfscw.cn/article/id/200302017
    [14]
    ZHAO Ming, HOU Zhong-sheng, YAN Jing-wen. Convergence analysis of ILC based ramp metering under constraints[J]. Journal of Transportation Systems Engineering and Informa-tion Technology, 2011, 11(2): 166-173. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-YSXT201102025.htm
    [15]
    HOU Zhong-sheng, YAN Jing-wen. Model free adaptive control based freeway ramp metering with feedforward itera-tive learning controller[J]. ACTA Automatica Sinica, 2009, 35(5): 588-595. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-MOTO200905022.htm
    [16]
    WANG Xing-ju, MIYAGI T. Reinforcement learning ramp metering[J]. Journal of Shijiazhuang Tiedao University: Natural Science Edition, 2010, 23(2): 104-108. (in Chinese). http://www.cnki.com.cn/Article/CJFDTOTAL-SJZT201002019.htm

Catalog

    Article Metrics

    Article views (1612) PDF downloads(1125) Cited by()
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return