Hey, welcome to my homepage! My name is Koki Nagano (in Kanji, my first name means “Lighting”, and “Hope”). I work at the intersection of Computer Graphics, Vision and AI. Currently, I am a Principal Research Scientist at NVIDIA. My research focuses on realistic digital humans synthesis, neural media synthesis and trustworthy visual computing including detection and prevention of visual misinformation in collaboration with DARPA. My PhD thesis focused on the topic of high-fidelity 3D human capture (USC, 2017), and I was supervised by Prof. Paul Debevec at USC ICT. Previously I was a Principal Scientist at Pinscreen Inc. During my PhD, I worked for Weta Digital on Hollywood blockbuster movies and for the Meta Reality Labs in Pittsburgh. I got my Bachelor of Engineering from Tokyo Institute of Technology with focus on Environmental Design.
Internship at NVIDIA
We hire research interns. If you are interested in the intersection of Graphics, Vision and GenAI for digital humans, realistic media synthesis (2D/3D), and relevant forgery detection and prevention techniques, please
send me an email.
Face-ing Our Realistic Digital Self
TED
/
TEDxCharlottesville
Rendering Every Pixel for High-Fidelity Geometry in 3D GANs
Project
AI-Mediated 3D Video Conferencing
SIGGRAPH Demo
,
Computex Keynote
Real-Time Radiance Fields for Single-Image Portrait View Synthesis
Project
Avatar Fingerprinting for Authorized Use of Synthetic Talking-Head Videos
Project
I am AI: AI-driven Digital Avatar Made Easy
featured on
SIGGRAPH Blog
,
fxguide
AI-Synthesized Avatars: From Real-Time Deepfakes To Photoreal AI Virtual Assistant
featured on
Wired
,
befores and afters
New Real-time Hybrid AI + CGI Face Replacement
featured on
fxguide
Advanced Face AI & Neural Rendering
featured on
fxguide
Deep Face Normalization
video
Personalized Avatars for Realtime Virtual Try-on
featured on
fxguide
.
Protecting World Leaders Against Deep Fakes
Paper
featured on
MIT Tech Review
,
Al Jazeera
,
The Verge
.
VR Hair Salon for Avatars
featured on
befores and afters
The Human Element: Digital Mimicry
watch
demo
watch episode on
Netflix
Pinscreen Avatars in your Pocket: Mobile paGAN engine and Personalized Gaming
featured on
fxguide
.
Deepfake video: The weaponization of fake news - The Fifth Estate
watch
episode
Deep Learning-Based Photoreal Avatars for Online Virtual Worlds in iOS
featured on
MIT Tech Review
,
CBS
,
PBS
,
fxguide
.
Skin Microstructure Deformation With Displacement Map Convolution
featured on
CNET
,
Fast Company
,
CG Channel
,
GIZMODO
.
Skin Stretch: Simulating Dynamic Skin Microgeometry
featured on
GIZMODO
,
The Verge
,
MOTHERBOARD
,
fxguide
.
An Autostereoscopic Projector Array Optimized for 3D Facial Display
featured on
Wall Street Journal
,
4gamer
.