{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T16:48:23Z","timestamp":1777654103340,"version":"3.51.4"},"reference-count":43,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2018,5,22]],"date-time":"2018-05-22T00:00:00Z","timestamp":1526947200000},"content-version":"vor","delay-in-days":21,"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/http\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Computer Graphics Forum"],"published-print":{"date-parts":[[2018,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>We present GazeDirector, a new approach for eye gaze redirection that uses model\u2010fitting. Our method first tracks the eyes by fitting a multi\u2010part eye region model to video frames using analysis\u2010by\u2010synthesis, thereby recovering eye region shape, texture, pose, and gaze simultaneously. It then redirects gaze by 1) warping the eyelids from the original image using a model\u2010derived flow field, and 2) rendering and compositing synthesized 3D eyeballs onto the output image in a photorealistic manner. GazeDirector allows us to change where people are looking without person\u2010specific training data, and with full articulation, i.e. we can precisely specify new gaze directions in 3D. Quantitatively, we evaluate both model\u2010fitting and gaze synthesis, with experiments for gaze estimation and redirection on the Columbia gaze dataset. Qualitatively, we compare GazeDirector against recent work on gaze redirection, showing better results especially for large redirection angles. Finally, we demonstrate gaze redirection on YouTube videos by introducing new 3D gaze targets and by manipulating visual behavior.<\/jats:p>","DOI":"10.1111\/cgf.13355","type":"journal-article","created":{"date-parts":[[2018,6,1]],"date-time":"2018-06-01T00:19:39Z","timestamp":1527812379000},"page":"217-225","update-policy":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":44,"title":["GazeDirector: Fully Articulated Eye Gaze Redirection in Video"],"prefix":"10.1111","volume":"37","author":[{"given":"Erroll","family":"Wood","sequence":"first","affiliation":[{"name":"University of Cambridge UK"},{"name":"Microsoft"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tadas","family":"Baltru\u0161aitis","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University USA"},{"name":"Microsoft"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louis\u2010Philippe","family":"Morency","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Robinson","sequence":"additional","affiliation":[{"name":"University of Cambridge UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreas","family":"Bulling","sequence":"additional","affiliation":[{"name":"Max Planck Institute for Informatics Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2018,5,22]]},"reference":[{"key":"e_1_2_9_2_2","doi-asserted-by":"crossref","unstructured":"BanfM. BlanzV.: Example\u2010based rendering of eye movements. InComputer Graphics Forum(2009). 2","DOI":"10.1111\/j.1467-8659.2009.01406.x"},{"key":"e_1_2_9_3_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925962"},{"key":"e_1_2_9_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766924"},{"key":"e_1_2_9_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661285"},{"key":"e_1_2_9_6_2","doi-asserted-by":"crossref","unstructured":"Baltru\u0161aitisT. RobinsonP. MorencyL.\u2010P.: OpenFace: an open source facial behavior analysis toolkit. InIEEE WACV(2016). 3 5 7","DOI":"10.1109\/WACV.2016.7477553"},{"key":"e_1_2_9_7_2","doi-asserted-by":"crossref","unstructured":"BlanzV. VetterT.: A morphable model for the synthesis of 3d faces. InProc. 26th conf. on Computer graphics and interactive techniques(1999). 3 4 5","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_9_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/2766943"},{"key":"e_1_2_9_9_2","doi-asserted-by":"crossref","unstructured":"CaoC. HouQ. ZhouK.: Displaced dynamic expression regression for real\u2010time facial tracking and animation.ACM Transactions on Graphics (TOG)(2014). 3","DOI":"10.1145\/2601097.2601204"},{"key":"e_1_2_9_10_2","doi-asserted-by":"crossref","unstructured":"CriminisiA. ShottonJ. BlakeA. TorrP. H.: Gaze manipulation for one\u2010to\u2010one teleconferencing. InComputer Vision 2003. Proceedings. Ninth IEEE International Conference on(2003) IEEE pp.191\u2013198. 1 2","DOI":"10.1109\/ICCV.2003.1238340"},{"key":"e_1_2_9_11_2","doi-asserted-by":"crossref","unstructured":"CaoC. WuH. WengY. ShaoT. ZhouK.: Real\u2010time facial animation with image\u2010based dynamic avatars.ACM Transactions on Graphics (TOG)(2016). 3","DOI":"10.1145\/2897824.2925873"},{"key":"e_1_2_9_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0149-7634(00)00025-7"},{"key":"e_1_2_9_13_2","doi-asserted-by":"crossref","unstructured":"GigerD. BazinJ.\u2010C. KusterC. PopaT. GrossM.: Gaze correction with a single webcam. InIntl. Conf. on Multimedia and Expo (ICME)(2014) IEEE. 2","DOI":"10.1109\/ICME.2014.6890306"},{"key":"e_1_2_9_14_2","doi-asserted-by":"crossref","unstructured":"GaninY. KononenkoD. SungatullinaD. LempitskyV.: Deepwarp: Photorealistic image resynthesis for gaze manipulation. InEuropean Conference on Computer Vision(2016) Springer pp.311\u2013326. 1 2 7","DOI":"10.1007\/978-3-319-46475-6_20"},{"key":"e_1_2_9_15_2","unstructured":"GemmellJ. ToyamaK. ZitnickC. L. KangT. SeitzS.: Gaze awareness for video\u2010conferencing: A software approach.IEEE Multimedia(2000). 2"},{"key":"e_1_2_9_16_2","unstructured":"GarridoP. ZollhoeferM. CasasD. ValgaertsL. VaranasiK. PerezP. TheobaltC.:Reconstruction of personalized 3d face rigs from monocular video. 3"},{"key":"e_1_2_9_17_2","doi-asserted-by":"publisher","DOI":"10.1177\/10883576040190010301"},{"key":"e_1_2_9_18_2","doi-asserted-by":"crossref","unstructured":"JeniL. A. CohnJ. F.: Person\u2010independent 3d gaze estimation using face frontalization. InProc. CVPR Workshops (CVPRW)(2016) IEEE. 7","DOI":"10.1109\/CVPRW.2016.104"},{"key":"e_1_2_9_19_2","unstructured":"JimenezJ. DanvoyeE. von der PahlenJ.: Photorealistic eyes rendering. InSIGGRAPH Talks Advances in Real\u2010Time Rendering(2012) ACM. 4 6"},{"key":"e_1_2_9_20_2","doi-asserted-by":"publisher","DOI":"10.1107\/S0567739476001873"},{"key":"e_1_2_9_21_2","unstructured":"KarisB. AntoniadesT. CaulkinS. MastilovicV.: Digital humans: Crossing the uncanny valley in unreal engine 4. InGDC Talks(2016) EPIC. 6"},{"key":"e_1_2_9_22_2","doi-asserted-by":"crossref","unstructured":"KononenkoD. LempitskyV.: Learning to look up: realtime monocular gaze correction using machine learning. InProc. Computer Vision and Pattern Recognition (CVPR)(2015) IEEE. 2","DOI":"10.1109\/CVPR.2015.7299098"},{"key":"e_1_2_9_23_2","doi-asserted-by":"crossref","unstructured":"KusterC. PopaT. BazinJ.\u2010C. GotsmanC. GrossM.: Gaze correction for home video conferencing.ACM Transactions on Graphics (TOG)(2012). 2","DOI":"10.1145\/2366145.2366193"},{"key":"e_1_2_9_24_2","doi-asserted-by":"crossref","unstructured":"K\u00fcblerT. C. RittigT. KasneciE. UngewissJ. KraussC.: Rendering refraction and reflection of eyeglasses for synthetic eye tracker images. InProc. ETRA(2016) ACM. 8","DOI":"10.1145\/2857491.2857494"},{"key":"e_1_2_9_25_2","unstructured":"KlehmO. RousselleF. PapasM. BradleyD. HeryC. BickelB. JaroszW. BeelerT.: Recent advances in facial appearance capture. InComputer Graphics Forum(2015) Wiley Online Library. 3"},{"key":"e_1_2_9_26_2","unstructured":"LoopC.:Smooth subdivision surfaces based on triangles. 4"},{"key":"e_1_2_9_27_2","volume-title":"Advances in Visual Computing","author":"Qin Y.","year":"2015"},{"key":"e_1_2_9_28_2","unstructured":"RuhlandK. AndristS. BadlerJ. PetersC. BadlerN. GleicherM. MutluB. McdonnellR.: Look me in the eyes: A survey of eye and gaze animation for virtual agents and artificial systems. InEurographics State\u2010of\u2010the\u2010Art Report(2014) pp.69\u201391. 4"},{"key":"e_1_2_9_29_2","doi-asserted-by":"crossref","unstructured":"SharpT. KeskinC. RobertsonD. TaylorJ. ShottonJ. KimD. RhemannC. LeichterI. VinnikovA. WeiY. et al.: Accurate robust and flexible real\u2010time hand tracking. InProc. 33rd Annual ACM Conference on Human Factors in Computing Systems(2015) ACM. 6","DOI":"10.1145\/2702123.2702179"},{"key":"e_1_2_9_30_2","doi-asserted-by":"crossref","unstructured":"SuwajanakornS. SeitzS. M. Kemelmacher\u2010ShlizermanI.: What makes tom hanks look like tom hanks. InProc. International Conference on Computer Vision (ICCV)(2015) IEEE. 3","DOI":"10.1109\/ICCV.2015.450"},{"key":"e_1_2_9_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/2926713"},{"key":"e_1_2_9_32_2","doi-asserted-by":"crossref","unstructured":"SmithB. YinQ. FeinerS. NayarS.: Gaze Locking: Passive Eye Contact Detection for Human\u01ce\u0102\u015eObject Interaction. InACM User Interface Software and Technology (UIST)(2013). 1 7","DOI":"10.1145\/2501988.2501994"},{"key":"e_1_2_9_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818056"},{"key":"e_1_2_9_34_2","doi-asserted-by":"crossref","unstructured":"ThiesJ. Zollh\u00f6ferM. StammingerM. TheobaltC. NiessnerM.: Face2Face: Real\u2010time Face Capture and Reenactment of RGB Videos. InProc. Computer Vision and Pattern Recognition (CVPR)(2016) IEEE. 3 6","DOI":"10.1109\/CVPR.2016.262"},{"key":"e_1_2_9_35_2","doi-asserted-by":"crossref","unstructured":"ThiesJ. Zollh\u00f6ferM. StammingerM. TheobaltC. NiessnerM.: Facevr: Real\u2010time facial reenactment and eye gaze control in virtual reality.arXiv preprint arXiv:1610.03151(2016). 1","DOI":"10.1145\/3084822.3084841"},{"key":"e_1_2_9_36_2","unstructured":"Unity: Game engine.Online\u2013https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/http\/unity3d.com. 8"},{"key":"e_1_2_9_37_2","doi-asserted-by":"crossref","unstructured":"WeiseT. BouazizS. LiH. PaulyM.: Realtime performance\u2010based facial animation. InACM Transactions on Graphics (TOG)(2011) Vol.30 ACM p. 77. 3","DOI":"10.1145\/2010324.1964972"},{"key":"e_1_2_9_38_2","doi-asserted-by":"crossref","unstructured":"WoodE. Baltru\u0161aitisT. MorencyL.\u2010P. RobinsonP. BullingA.: A 3d morphable eye region model for gaze estimation. InEuropean Conference on Computer Vision(2016) Springer. 2 3 7","DOI":"10.1007\/978-3-319-46448-0_18"},{"key":"e_1_2_9_39_2","doi-asserted-by":"crossref","unstructured":"WoodE. Baltru\u0161aitisT. MorencyL.\u2010P. RobinsonP. BullingA.: Learning an appearance\u2010based gaze estimator from one million synthesised images. InProc. ETRA(2016) ACM. 4","DOI":"10.1145\/2857491.2857492"},{"key":"e_1_2_9_40_2","doi-asserted-by":"crossref","unstructured":"WolfL. FreundZ. AvidanS.: An eye for an eye: A single camera gaze\u2010replacement method. InProc. Computer Vision and Pattern Recognition (CVPR)(2010) IEEE. 2","DOI":"10.1109\/CVPR.2010.5540133"},{"key":"e_1_2_9_41_2","unstructured":"WeinerD. KiryatiN.: Virtual gaze redirection in face images. InProc. Conf. Image Analysis and Processing(2003) IEEE. 2"},{"key":"e_1_2_9_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925947"},{"key":"e_1_2_9_43_2","doi-asserted-by":"crossref","unstructured":"YangR. ZhangZ.: Eye gaze correction with stereovision for video\u2010teleconferencing. InEuropean Conference on Computer Vision(2002) Springer pp.479\u2013494. 2","DOI":"10.1007\/3-540-47967-8_32"},{"key":"e_1_2_9_44_2","unstructured":"ZitnickC. L. GemmellJ. ToyamaK.: Manipulation of video eye gaze and head orientation for video teleconferencing.Microsoft Research MSR\u2010TR\u201099\u201046(1999). 1"}],"container-title":["Computer Graphics Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fcgf.13355","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/cgf.13355","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T22:38:53Z","timestamp":1751668733000},"score":1,"resource":{"primary":{"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/onlinelibrary.wiley.com\/doi\/10.1111\/cgf.13355"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,5]]}},"alternative-id":["10.1111\/cgf.13355"],"URL":"https:\/\/summer-heart-0930.chufeiyun1688.workers.dev:443\/https\/doi.org\/10.1111\/cgf.13355","archive":["Portico"],"relation":{},"ISSN":["0167-7055","1467-8659"],"issn-type":[{"value":"0167-7055","type":"print"},{"value":"1467-8659","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5]]},"assertion":[{"value":"2018-05-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}