{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T04:51:30Z","timestamp":1781585490472,"version":"3.54.5"},"reference-count":42,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2019,3,14]],"date-time":"2019-03-14T00:00:00Z","timestamp":1552521600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["Grant 61802043, Grant 61370142 and Grant 61272368"],"award-info":[{"award-number":["Grant 61802043, Grant 61370142 and Grant 61272368"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["Grant 3132018195 and Grant 3132016352"],"award-info":[{"award-number":["Grant 3132018195 and Grant 3132016352"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Fundamental Research of Ministry of Transport of P. R. China","award":["Grant 2015329225300"],"award-info":[{"award-number":["Grant 2015329225300"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The driver gaze zone is an indicator of a driver\u2019s attention and plays an important role in the driver\u2019s activity monitoring. Due to the bad initialization of point-cloud transformation, gaze zone systems using RGB-D cameras and ICP (Iterative Closet Points) algorithm do not work well under long-time head motion. In this work, a solution for a continuous driver gaze zone estimation system in real-world driving situations is proposed, combining multi-zone ICP-based head pose tracking and appearance-based gaze estimation. To initiate and update the coarse transformation of ICP, a particle filter with auxiliary sampling is employed for head state tracking, which accelerates the iterative convergence of ICP. Multiple templates for different gaze zone are applied to balance the templates revision of ICP under large head movement. For the RGB information, an appearance-based gaze estimation method with two-stage neighbor selection is utilized, which treats the gaze prediction as the combination of neighbor query (in head pose and eye image feature space) and linear regression (between eye image feature space and gaze angle space). The experimental results show that the proposed method outperforms the baseline methods on gaze estimation, and can provide a stable head pose tracking for driver behavior analysis in real-world driving scenarios.<\/jats:p>","DOI":"10.3390\/s19061287","type":"journal-article","created":{"date-parts":[[2019,3,15]],"date-time":"2019-03-15T04:12:09Z","timestamp":1552623129000},"page":"1287","update-policy":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["Continuous Driver\u2019s Gaze Zone Estimation Using RGB-D Camera"],"prefix":"10.3390","volume":"19","author":[{"given":"Yafei","family":"Wang","sequence":"first","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"},{"name":"School of Microelectronics, Dalian University of Technology, Dalian 116024, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoliang","family":"Yuan","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zetian","family":"Mi","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinjia","family":"Peng","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xueyan","family":"Ding","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheng","family":"Liang","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xianping","family":"Fu","sequence":"additional","affiliation":[{"name":"Information Science and Technology College, Dalian Maritime University, Dalian 116026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhao, Y., G\u00f6rne, L., Yuen, I.M., Cao, D., Sullman, M., Auger, D., Lv, C., Wang, H., Matthias, R., and Skrypchuk, L. (2017). An orientation sensor-based head tracking system for driver behaviour monitoring. Sensors, 17.","DOI":"10.3390\/s17112692"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Reyes-Mu noz, A., Domingo, M., L\u00f3pez-Trinidad, M., and Delgado, J. (2016). Integration of body sensor networks and vehicular ad-hoc networks for traffic safety. Sensors, 16.","DOI":"10.3390\/s16010107"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhang, X., Li, J., Liu, Y., Zhang, Z., Wang, Z., Luo, D., Zhou, X., Zhu, M., Salman, W., and Hu, G. (2017). Design of a fatigue detection system for high-speed trains based on driver vigilance using a wireless wearable EEG. Sensors, 17.","DOI":"10.3390\/s17030486"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MMUL.2012.24","article-title":"Microsoft kinect sensor and its effect","volume":"19","author":"Zhang","year":"2012","journal-title":"IEEE Multimed."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1109\/TITS.2010.2092770","article-title":"Driver inattention monitoring system for intelligent vehicles: A review","volume":"12","author":"Dong","year":"2011","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1109\/TPAMI.2008.106","article-title":"Head pose estimation in computer vision: A survey","volume":"31","author":"Trivedi","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1109\/TPAMI.2009.30","article-title":"In the eye of the beholder: A survey of models for eyes and gaze","volume":"32","author":"Hansen","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Vasli, B., Martin, S., and Trivedi, M.M. (2016, January 1\u20134). On driver gaze estimation: Explorations and fusion of geometric and data driven approaches. Proceedings of the IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, Brazil.","DOI":"10.1109\/ITSC.2016.7795623"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"818","DOI":"10.1109\/TITS.2014.2300870","article-title":"Continuous head movement estimator for driver assistance: Issues, algorithms, and on-road evaluations","volume":"15","author":"Tawari","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tawari, A., Chen, K.H., and Trivedi, M.M. (2014, January 8\u201311). Where is the driver looking: Analysis of head, eye and iris for robust gaze zone estimation. Proceedings of the IEEE 17th International Conference on Intelligent Transportation Systems (ITSC), Qingdao, China.","DOI":"10.1109\/ITSC.2014.6957817"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2014","DOI":"10.1109\/TITS.2015.2396031","article-title":"Driver gaze tracking and eyes off the road detection system","volume":"16","author":"Vicente","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1049\/iet-cvi.2015.0296","article-title":"\u2018Owl\u2019 and \u2018Lizard\u2019: Patterns of head pose and eye pose in driver gaze classification","volume":"10","author":"Fridman","year":"2016","journal-title":"IET Comput. Vis."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Jung, D., Lee, J.M., Gwon, S.Y., Pan, W., Lee, H.C., Park, K.R., and Kim, H.C. (2016). Compensation method of natural head movement for gaze tracking system using an ultrasonic sensor for distance measurement. Sensors, 16.","DOI":"10.3390\/s16010110"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pan, W., Jung, D., Yoon, H.S., Lee, D.E., Naqvi, R.A., Lee, K.W., and Park, K.R. (2016). Empirical Study on Designing of Gaze Tracking Camera Based on the Information of User\u2019s Head Movement. Sensors, 16.","DOI":"10.3390\/s16091396"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"13439","DOI":"10.3390\/s131013439","article-title":"Remote gaze tracking system on a large display","volume":"13","author":"Lee","year":"2013","journal-title":"Sensors"},{"key":"ref_16","unstructured":"Chen, Y., and Medioni, G. (1991, January 9\u201311). Object modeling by registration of multiple range images. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Sacramento, CA, USA."},{"key":"ref_17","unstructured":"Besl, P.J., and McKay, N.D. (1992). Method for registration of 3-D shapes. Sensor Fusion IV: Control Paradigms and Data Structures, SPIE."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1109\/TITS.2014.2332613","article-title":"Driver monitoring based on low-cost 3-D sensors","volume":"15","author":"Armingol","year":"2014","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"B\u00e4r, T., Reuter, J.F., and Z\u00f6llner, J.M. (2012, January 16\u201319). Driver head pose and gaze estimation based on multi-template icp 3-d point-cloud alignment. Proceedings of the IEEE 15th International Conference on Intelligent Transportation Systems (ITSC), Anchorage, AK, USA.","DOI":"10.1109\/ITSC.2012.6338678"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1007\/s11263-015-0863-4","article-title":"Gaze estimation in the 3d space using rgb-d sensors","volume":"118","author":"Odobez","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, S., Ngan, K.N., and Sheng, L. (2013, January 16\u201318). A head pose tracking system using RGB-D camera. Proceedings of the International Conference on Computer Vision Systems, St. Petersburg, Russia.","DOI":"10.1007\/978-3-642-39402-7_16"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Padeleris, P., Zabulis, X., and Argyros, A.A. (2012, January 16\u201321). Head pose estimation on depth data based on particle swarm optimization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6239236"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Fanelli, G., Gall, J., and Van Gool, L. (2011, January 20\u201325). Real time head pose estimation with random regression forests. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995458"},{"key":"ref_24","unstructured":"Fanelli, G., Weise, T., Gall, J., and Van Gool, L. (September, January 31). Real time head pose estimation from consumer depth cameras. Proceedings of the Joint Pattern Recognition Symposium, Frankfurt, Germany."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Breitenstein, M.D., Kuettel, D., Weise, T., Van Gool, L., and Pfister, H. (2008, January 23\u201328). Real-time face pose estimation from single range images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Anchorage, AK, USA.","DOI":"10.1109\/CVPR.2008.4587807"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"20945","DOI":"10.3390\/s150920945","article-title":"Head pose estimation on top of haar-like face detection: A study using the kinect sensor","volume":"15","author":"Saeed","year":"2015","journal-title":"Sensors"},{"key":"ref_27","unstructured":"Ghiass, R.S., and Arandjelovic, O. (arXiv, 2016). Highly accurate gaze estimation using a consumer RGB-depth sensor, arXiv."},{"key":"ref_28","unstructured":"Wang, K., and Ji, Q. (2016, January 4\u20138). Real time eye gaze tracking with Kinect. Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), Cancun, Mexico."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"8363","DOI":"10.3390\/s140508363","article-title":"An investigation on the feasibility of uncalibrated and unconstrained gaze tracking for human assistive applications by using head pose estimation","volume":"14","author":"Cazzato","year":"2014","journal-title":"Sensors"},{"key":"ref_30","unstructured":"Mora, K.A.F., and Odobez, J. (2012, January 16\u201321). Gaze estimation from multimodal kinect data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, RI, USA."},{"key":"ref_31","unstructured":"Mora, K.A.F., and Odobez, J. (2013, January 15\u201318). Person independent 3d gaze estimation from remote rgb-d cameras. Proceedings of the IEEE International Conference on Image Processing (ICIP), Melbourne, Australia."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust real-time face detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3d is here: point-cloud library (pcl). Proceedings of the IEEE International Conference on Robotics and automation (ICRA), Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2967","DOI":"10.1016\/S0167-8655(03)00157-0","article-title":"An accurate and fast point-to-plane registration technique","volume":"24","author":"Park","year":"2003","journal-title":"Pattern Recognit. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1109\/JPROC.2007.893250","article-title":"An overview of existing methods and recent advances in sequential Monte Carlo","volume":"95","author":"Godsill","year":"2007","journal-title":"Proc. IEEE"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1109\/TITS.2010.2044241","article-title":"Head pose estimation and augmented reality tracking: An integrated system and evaluation for monitoring driver awareness","volume":"11","author":"Trivedi","year":"2010","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.knosys.2017.10.010","article-title":"Learning a gaze estimator with neighbor selection from large-scale synthetic eye images","volume":"139","author":"Wang","year":"2018","journal-title":"Knowl.-Based Syst."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1007\/s00362-009-0251-7","article-title":"Comparison of PLS algorithms when number of objects is much larger than number of variables","volume":"50","author":"Alin","year":"2009","journal-title":"Stat. Pap."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"392","DOI":"10.1016\/j.csl.2013.06.002","article-title":"Speaker state classification based on fusion of asymmetric simple partial least squares (SIMPLS) and support vector machines","volume":"28","author":"Huang","year":"2014","journal-title":"Comput. Speech Lang."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2033","DOI":"10.1109\/TPAMI.2014.2313123","article-title":"Adaptive linear regression for appearance-based gaze estimation","volume":"36","author":"Lu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.knosys.2016.07.038","article-title":"Appearance-based gaze estimation using deep features and random forest regression","volume":"110","author":"Wang","year":"2016","journal-title":"Knowl.-Based Syst."},{"key":"ref_42","unstructured":"Martinez, F., Carbone, A., and Pissaloux, E. (October, January 30). Gaze estimation using local features and non-linear regression. Proceedings of the 19th IEEE International Conference on Image Processing (ICIP), Orlando, FL, USA."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/www.mdpi.com\/1424-8220\/19\/6\/1287\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:38:43Z","timestamp":1760186323000},"score":1,"resource":{"primary":{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/www.mdpi.com\/1424-8220\/19\/6\/1287"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,14]]},"references-count":42,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["s19061287"],"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.3390\/s19061287","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,14]]}}}