Publications

Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videos

ECCV 2024

Ekta Prashnani, Koki Nagano, Shalini De Mello, David Luebke, Orazio Gallo

PDF Dataset Video Project

Coherent 3D Portrait Video Reconstruction via Triplane Fusion

Arxiv 2024

Shengze Wang, Xueting Li, Chao Liu, Matthew Chan, Michael Stengel, Josef Spjut, Henry Fuchs, Shalini De Mello, Koki Nagano

PDF Video Project

What You See Is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANs

CVPR 2024

Alex Trevithick, Matthew Chan, Towaki Takikawa, Umar Iqbal, Shalini De Mello, Manmohan Chandraker, Ravi Ramamoorthi, Koki Nagano

PDF Video Project

Dream-in-4D: A Unified Approach for Text- and Image-guided 4D Scene Generation

CVPR 2024

Yufeng Zheng, Xueting, Koki Nagano, Sifei Liu, Karsten Kreis, Otmar Hilliges, Shalini De Mello

PDF Project

GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning

CVPR 2024 (Highlight)

Ye Yuan*, Xueting Li*, Yangyi Huang, Shalini De Mello, Koki Nagano, Jan Kautz, Umar Iqbal

PDF Video Project

Generalizable One-shot Neural Head Avatar

NeurIPS 2023

Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, Jan Kautz

PDF Video Project

GeNVS: Generative Novel View Synthesis with 3D-Aware Diffusion Models

ICCV 2023 (Oral)

E. Chan*, K. Nagano*, M. Chan*, A. Bergman*, JJ Park*, A. Levy, M. Aittala, S. De Mello, T. Karras, G. Wetzstein

PDF Code Project

RANA: Relightable Articulated Neural Avatars

ICCV 2023

Umar Iqbal, Akin Caliskan, Koki Nagano, Sameh Khamis, Pavlo Molchanov, Jan Kautz

PDF Video Project

Live 3D Portrait: Real-Time Radiance Fields for Single-Image Portrait View Synthesis

SIGGRAPH 2023

Alex Trevithick, Matthew Chan, Michael Stengel, Eric R. Chan, Chao Liu, Zhiding Yu, Sameh Khamis, Manmohan Chandraker, Ravi Ramamoorthi, Koki Nagano

PDF Video Project

SSIF: Single-shot Implicit Morphable Faces with Consistent Texture Parameterization

SIGGRAPH 2023

Connor Lin, Koki Nagano, Jan Kautz, Eric R. Chan, Umar Iqbal, Leonidas Guibas, Gordon Wetzstein, Sameh Khamis

PDF Project

Intriguing Properties of Synthetic Images: from Generative Adversarial Networks to Diffusion Models

CVPR 2023 Workshop on Media Forensics

Riccardo Corvi, Davide Cozzolino, Giovanni Poggi, Koki Nagano, Luisa Verdoliva

PDF Project

On the Detection of Synthetic Images Generated by Diffusion Models

ICASSP 2023 (Top 3% Paper)

Riccardo Corvi, Davide Cozzolino, Giada Zingarini, Giovanni Poggi, Koki Nagano, Luisa Verdoliva

PDF Project

Lumos: Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation

SIGGRAPH ASIA 2022

Yu-Ying Yeh, Koki Nagano, Sameh Khamis, Jan Kautz, Ming-Yu Liu, Ting-Chun Wang

PDF Video Project

Fusing Global and Local Features for Generalized AI-Synthesized Image Detection

ICIP 2022

Yan Ju, Shan Jia, Lipeng Ke, Hongfei Xue, Koki Nagano, Siwei Lyu

PDF Project

EG3D: Efficient Geometry-aware 3D Generative Adversarial Networks

CVPR 2022 (Oral Presentation)

E. Chan*, C. Lin*, M. Chan*, K. Nagano*, B. Pan, S. De Mello, O. Gallo, L. Guibas, J. Tremblay, S. Khamis, T. Karras, G. Wetzstein *Joint first authors

PDF Code Video Project

Frame Averaging for Equivariant Shape Space Learning

CVPR 2022

Matan Atzmon, Koki Nagano, Sanja Fidler, Sameh Khamis, Yaron Lipman

PDF Project

DRaCoN – Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars

Arxiv 2022

Amit Raj, Umar Iqbal, Koki Nagano, Sameh Khamis, Pavlo Molchanov, James Hays, Jan Kautz

PDF Project

RTMV: A Ray-Traced Multi-View Synthetic Dataset for Novel View Synthesis

Arxiv 2022

J Tremblay*, M Meshry*, A Evans, J Kautz, A Keller, S Khamis, C Loop, N Morrical, T Müller, K Nagano, T Takikawa, S Birchfield *Joint first authors

PDF Video Project

StyleGAN3 Detectors

GTC 2021

Detecting images generated by the latest never-before-seen GAN (i.e., StyleGAN3).

Project Blog GTC Talk

Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement

CVPR 2021

Huiwen Luo, Koki Nagano, Han-Wei Kung, Mclean Goldwhite, Qingguo Xu, Zejian Wang, Lingyu Wei, Liwen Hu, Hao Li

PDF Video

One-Shot Identity-Preserving Portrait Reenactment

arXiv 2020

Sitao Xiang, Yuming Gu, Pengda Xiang, Mingming He, Koki Nagano, Haiwei Chen, Hao Li

PDF

Deep Face Normalization

ACM Transactions on Graphics (SIGGRAPH ASIA 2019)

Koki Nagano, Huiwen Luo, Zejian Wang, Jaewoo Seo, Jun Xing, Liwen Hu, Lingyu Wei, Hao Li

PDF Video Supplemental

Hairbrush For Immersive Data-Driven Hair Modeling

Proceedings of the 32nd ACM User Interface Software and Technology Symposium 2019 (UIST 2019)

Jun Xing, Koki Nagano, Weikai Chen, Haotian Xu, Li-Yi Wei, Yajie Zhao, Jingwan Lu, Byungmoon Kim, Hao Li

PDF Video

Protecting World Leaders Against Deep Fakes

CVPR 2019 Workshop on Media Forensics

Shruti Agarwal, Hany Farid, Yuming Gu, Mingming He, Koki Nagano, Hao Li

PDF

paGAN: Real-time Avatars Using Dynamic Textures

ACM Transactions on Graphics (SIGGRAPH ASIA 2018)

Koki Nagano, Jaewoo Seo, Jun Xing, Lingyu Wei, Zimo Li, Shunsuke Saito, Aviral Agarwal, Jens Fursund, Hao Li

PDF Video Live Demo

High-Fidelity Facial Reflectance and Geometry Inference from an Unconstrained Image

ACM Transactions on Graphics (SIGGRAPH 2018)

Shugo Yamaguchi*, Shunsuke Saito*, Koki Nagano, Yajie Zhao, Weikai Chen, Kyle Olszewski, Shigeo Morishima, Hao Li *Joint first authors

PDF Video Supplemental

Mesoscopic Facial Geometry Inference Using Deep Neural Networks

CVPR 2018 (Splotlight Presentation)

Loc Huynh, Weikai Chen, Shunsuke Saito, Jun Xing, Koki Nagano, Andrew Jones, Paul Debevec, Hao Li

PDF

Avatar Digitization From A Single Image For Real-Time Rendering

ACM Transactions on Graphics (SIGGRAPH ASIA 2017)

Liwen Hu*, Shunsuke Saito*, Lingyu Wei*, Koki Nagano, Jaewoo Seo, Iman Sadeghi, Jens Fursund, Yen-Chun Chen, Hao Li *Joint first authors

PDF Video

Photorealistic Facial Texture Inference Using Deep Neural Network

CVPR 2017 (Splotlight Presentation)

Shunsuke Saito*, Lingyu Wei*, Liwen Hu, Koki Nagano, Hao Li *Joint first authors

PDF Video Fxguide Supplemental

Multi-View Stereo on Consistent Face Topology

Eurographics 2017

Graham Fyffe*, Koki Nagano*, Loc Huynh, Shunsuke Saito, Jay Busch, Andrew Jones, Hao Li, Paul Debevec *Joint first authors

PDF Video Project

Time-offset Conversations on a Life-Sized Automultiscopic Projector Array

CVPR 2016 CCD

Andrew Jones, Koki Nagano, Jay Busch, Xueming Yu, Hsuan-Yueh Peng, Joseph Barreto, Oleg Alexander, Mark Bolas, Paul Debevec, and Jonas Unger

PDF Video Project

GPU-Based Inverse Rendering With Multi-Objective Particle Swarm Optimization

Journal of Visualization 2016 / SIGGRAPH ASIA 2015 Symposium on Visualization in High Performance Computing / CS596 Final Project

Koki Nagano, Thomas Collins, Chi-An Chen, Aiichiro Nakano

PDF Journal

Skin Microstructure Deformation With Displacement Map Convolution

ACM Transactions on Graphics (SIGGRAPH 2015)

Koki Nagano, Graham Fyffe, Oleg Alexander, Jernej Barbič, Hao Li, Abhijeet Ghosh, Paul Debevec

PDF Video Project Fxguide Demo

Building a Life-Size Automultiscopic Display Using Consumer Hardware

GPU Technology Conference 2015

Andrew Jones, Jonas Unger, Koki Nagano, Jay Busch, Xueming Yu, Hsuan-Yueh Peng, Oleg Alexander, Paul Debevec

PDF GTC Page

Interpolating vertical parallax for an autostereoscopic three-dimensional projector array

Journal of Electronic Imaging / SPIE Stereoscopic Displays and Applications XXV

Andrew Jones, Koki Nagano, Jing Liu, Jay Busch, Xueming Yu, Mark Bolas, Paul Debevec

PDF Video Talk 4gamer Wall Street Journal Project

Creating a life-sized automultiscopic Morgan Spurlock for CNNs Inside Man

SIGGRAPH 2014 Talks

Andrew Jones, Jonas Unger, Koki Nagano, Jay Busch, Xueming Yu, Hsuan-Yueh Peng, Oleg Alexander, Paul Debevec

PDF Video Project

Measurement and Modeling of Microfacet Distributions under Deformation

SIGGRAPH 2014 Talks

Koki Nagano, Oleg Alexander, Jernej Barbič, Hao Li, Paul Debevec

PDF PPT

Driving High-Resolution Facial Blendshapes with Video Performance Capture

SIGGRAPH 2013 Talks

Graham Fyffe, Andrew Jones, Oleg Alexander, Ryosuke Ichikari, Paul Graham, Koki Nagano, Jay Busch, Paul Debevec

PDF Video Nvidia Demo Project

ScritterHDR: Multiplex-Hidden Imaging on High Dynamic Range Projection

SIGGRAPH ASIA 2011 Posters

Koki Nagano, Takeru Utsugi, Kazuhisa Yanaka, Akihiko Shirai, Masayuki Nakajima

PDF Poster

Scritter: A Multiplexed Content Display System Compatible with Current 3D Projection technology

SIGGRAPH 2010 Posters / VRSJ 2010

Koki Nagano, Takeru Utsugi, Takeo Hamada, Mika Hirano, Akihiko Shirai, Masayuki Nakajima

PDF Video Poster VRIC Laval Virtual VRSJ (Japanese)

ScritterH: Image Hiding Algorithm for Multiplexed Content Projection

VRSJ 2010

Takeru Utsugi, Koki Nagano, Kazuhisa Yanaka, Akihiko Shirai, Masayuki Nakajima

PDF Video

Publications

Demo & Talks

Thesis