My research lies at the intersection of deep learning, computer vision, and computer graphics. Specifically, I am interested in generative AI, with a focus on animating 3D humans as well as manipulating images and videos.
A novel deep learning-based virtual oculoplastic surgery simulation system that aims to improve the accuracy and quality of simulations by considering the anatomical structure and characteristics of the eye.
Propose a latent-based landmark detection and latent manipulation module to edit the emotion of portrait video that faithfully follows the original lip-synchronization or lip-contact.
Use a generative prior for identity agnostic audio-driven talking-head generation with emotion manipulation while trained on a single identity audio-visual dataset.
Train a sketch generator with generated deep features of pre-trained StyleGAN to generate high-quality sketch images with limited data.
Generating Texture for 3D Human Avatar from a Single Image using Sampling and Refinement Networks Sihun Cha,
Kwanggyoon Seo,
Amirsaman Ashtari,
Junyong Noh
Eurographics 2023; CGF 2023
paper /
page /
code
Generating and completing of 3D human RGB texture from a single image using sampling and refinement process from visible region.
A method that generates a virtual camera layout for both human and stylzed characters of
a 3D animation scene by following the cinematic intention of a reference video.
A feed-forward neural network that can learn a semantic change of
input images in a latent space to create the morphing effect by distilling the information of pre-trained GAN.
Research Experience
Flawless AI Research Scientist Jun.2024-Current
Visual Media Lab Research Assistance Jan.2017-Mar.2024
Adobe Research Research Intern Jun.2022-Aug.2022 Mar.2021-Jun.2021
NAVER Corp. Research Intern Dec.2019-Jun.2020
The source code of this website is from Jon Barron.