To address the failure to consider vehicle states in region of interest (ROI) prediction, we propose the use of a Kalman filter to estimate the position of vehicles relative to lanes by vehicle states on the basis of a vehicle–road micro traffic model in the world coordinate system. The central position of the ROI is determined through a combination of optimal preview time theory with the ROI prediction. The range of the ROI is determined by offsetting upward, downward, leftward, and rightward from the central position of the ROI. The left and right ROI are processed separately to detect lane lines. Simulation results show that the proposed prediction method reduces the ROI range, and the model predictive control controller can make the vehicle run smoothly from the initial position to the road centerline.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
- Ψ :
the angle between the longitudinal vehicle axis and the lane, deg
- d :
the distance from the vehicle center of mass to lane line, m
- y 1 :
the distance between the vehicle longitudinal axis and road centerline at the preview point, m
- ε 1 :
the angle between the vehicle longitudinal axis and lane tangent at preview point, deg
- δ f :
front wheel angle, rad
- η :
camera optical axis yaw angle, deg
- θ :
camera optical axis pitch angle, deg
- Φ :
camera optical axis roll angle, deg
- v x :
longitudinal velocity, km/h
- v y :
lateral velocity, km/h
- φ :
yaw rate, rad/s
- m :
total mass of the vehicle, kg
- I z :
total vehicle inertia around the center of mass, kg•m2
- lf (lr):
the distances of the front (rear) axles from the vehicle center of mass, m
- cf (cr):
cornering stiffness of the front (rear) tires, N/rad
side slip angles of the front (rear) tires, rad
the forces acting on the front (rear) tires, N
- ß :
side slip angle, rad
- L :
preview distance, m
- p :
the distance from the vehicle center of mass to the right (left) lane line, m
- x̂ k :
- x̂ - k :
- P - k :
predicted covariance of the state
- P k :
covariance of the state
- Q :
covariance of the process noise
- R :
covariance of the measurement
- Z(k) :
- K k :
- H(k) :
the measurement matri
Armingol, J. M., Escalera, A. D. L., Hilario, C., Collado, J. M., Carrasco, J. P., Flores, M. J., Pastor, J. M. and Rodríguez, F. J. (2007). IVVI: intelligent vehicle based on visual information. Robotics and Autonomous Systems55, 12, 12–916.
Cerone, V., Chinu, A. and Regruto, D. (2002). Experimental results in vision-based lane keeping for highway vehicles. Proc. American Control Conf, Anchorage, AK, USA.
Chen, J., Xu, Y., Peng, Y. and Zhao, Y (2010). Dynamic compensation algorithm for vehicle camera calibration based on road characteristics. J. Mechanical Engineering46, 20, 20–117.
Choi, H.-C, Park, J.-M., Choi, W.-S. and Oh, S.-Y (2012). Vision-based fusion of robust lane tracking and forward vehicle detection in a real driving environment. Int. J. Automotive Technology13, 4, 4–669.
Fahmy, H. M., Ghany, M. A. A. E. and Baumann, G. (2018). Vehicle risk assessment and control for lane-keeping and collision avoidance at low-speed and high-speed scenarios. IEEE Trans. on Vehicular Technology67, 6, 6–4818.
Kang, C. M., Lee, S.-H. and Chung, C. C. (2018). Multirate lane-keeping system with kinematic vehicle model. IEEE Trans. on Vehicular Technology67, 10, 10–9222.
Kim, E., Kim, J. and Sunwoo, M. (2014). Model predictive control strategy for smooth path tracking of autonomous vehicles with steering actuator dynamics. Int. J. Automotive Technology15, 7, 7–1164.
Li, J., Chen, J., Yi, K., Xu, C. and Fan, Z. (2014). Lane Tracking System Based on Adaptive Image Threshold under Different Illumination. J. of Mechanical Engineering50, 2, 2–152.
Lin, Q., Han, Y. and Hahn, H. (2010). Real-Time Lane Departure Detection Based on Extended Edge-Linking Algorithm. Second Int. Conf. on Computer Research & Development, Kuala Lumpur, Malaysia.
Ma, C. (2011). Design of lane departure warning system based on monocular vision. Doctoral Dissertation. University of Electronic Science and Technology of China. Chengdu, China.
Marino, R., Scalzi, S. and Netto, M. (2011). Nested PID steering control for lane keeping in autonomous vehicles. Control Engineering Practice19, 12, 12–1467.
McCall, J. C. and Trivedi, M. M. (2006). Video-based lane estimation and tracking for driver assistance: Survey, system, and evaluation. IEEE Trans. on Intelligent Transportation System7, 1, 1–37.
Ni, L.-Q., Lin, F. and Wang, K.-Z. (2017). Research on path-following control of intelligent vehicles based on preview model. J. Chongqing University of Technology31, 3, 3–33.
Park, M.-K., Lee, S.-Y, Kwon, C.-K. and Kim, S.-W. (2017). Design of pedestrian target selection with funnel map for pedestrian AEB system. IEEE Trans. on Vehicular Technology66, 5, 5–3609.
Song, M.-H., Kim, C.-I., Kim, J.-M., Lee, K.-S., Park, H.-B., Jeon, J.-S., Kwag, S.-J. and Kim, M.-S. (2017). A novel approach to the enhancement of lane estimator by using Kalman filter. 17th Int. Conf. on Control, Automation and Systems, Jeju, Korea.
Tabatabaei Oreh, S. H., Kazemi, R. and Azadi, S. (2014). A sliding mode controller for directional control of articulated heavy vehicles. J. Automobile Engineering228, 3, 245–262.
Vinuchandran, A. V. and Shanmughasundaram, R. (2017). A real-time lane departure warning and vehicle detection system using monoscopic camera. Int. Conf. on Intelligent Computing Instrumentation and Control Technologies, Kannur, India.
Wang, W., Zhao, Y., Xu, J. and Liu, Y. (2014). Research on vehicle path tracking based on fuzzy control. China Mechanical Engineering25, 18, 2532–2538.
Wang, Y. and Boyd, S. (2010). Fast model predictive control using online optimization. IEEE Trans. on Control Systems Technology18, 2, 2–278.
Xu, Y. (2001). Study on Integrative Navigation Method of Intelligent Vehicle Based on Machine Vision and GPS. Ph.D. Dissertatio. Jilin University. Changchun, China.
You, F., Wang, R. and Zhang, R. (2007). Algorithm on lane changing and tracking control technology for Intelligent Vehicle. IEEE Int. Conf. on Robotics and Biomimetics, Sanya, China.
Yu, H. and Zhang, W. (2009). Lane detection and tracking based on dynamic region of interest. Industrial Instrumentation & Automation5, 103–106.
Zhang, C. (2011). Research on path tracking control for vision based intelligent vehicle. M. S. Dissertation. Harbin Institute of Technology. Harbin. China.
Zhang, Q., Wang, X. and Gao, F. (2018). Study on region of interest prediction considering vehicle dynamics. Chinese Journal of Automotive Engineering8, 3, 3–83.
Zhou, Y., Xu, R., Hu, X. and Ye, Q. (2006). A robust lane detection and tracking method based on computer vision. Measurement Science and Technology17, 4, 4–745.
This work is supported by the National Natural Science Foundation of China (No. 51905045), Key Technology on Major program of Jilin Province (No. 20170201005GX), the Science and Technology Research Planning Project of the Education Department of Jilin Province (No. JJKH20181035KJ), the Development and Reform Commission of Jilin City (Nos. 2019C036-1 and 2019C038-3).
Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Li, Z., Cui, G., Li, S. et al. Lane Keeping Control Based on Model Predictive Control Under Region of Interest Prediction Considering Vehicle Motion States. Int.J Automot. Technol. 21, 1001–1011 (2020). https://doi.org/10.1007/s12239-020-0095-7
- Kalman filter
- Lane keeping control
- Model predictive control
- ROI prediction
- Vision-based vehicle