Hello World! I am a PhD candiate at GCSTKAIST advised by Prof. Junyong Noh.
During my PhD, I was fortunate to work at Adobe Research with wonderful mentors Seoung Wug Oh,
Joon-Young Lee, and Jingwan (Cynthia) Lu.
Also, I spent time at Naver Clova working with Suntae Kim and Soonmin Bae.
My research lies at the intersection of deep learning, computer vision, and computer graphics. Specifically, I am interests in generative AI focusing on manipulating images/videos and animating 3D human.
Propose a latent-based landmark detection and latent manipulation module to edit the emotion of portrait video that faithfully follows the original lip-synchronization or lip-contact.
Use a generative prior for identity agnostic audio-driven talking-head generation with emotion manipulation while trained on a single identity audio-visual dataset.
Train a sketch generator with generated deep features of pre-trained StyleGAN to generate high-quality sketch images with limited data.
Generating Texture for 3D Human Avatar from a Single Image using Sampling and Refinement Networks Sihun Cha,
Kwanggyoon Seo,
Amirsaman Ashtari,
Junyong Noh
Eurographics 2023; CGF 2023
paper /
page /
code
Generating and completing of 3D human RGB texture from a single image using sampling and refinement process from visible region.
A method that generates a virtual camera layout for both human and stylzed characters of
a 3D animation scene by following the cinematic intention of a reference video.
A feed-forward neural network that can learn a semantic change of
input images in a latent space to create the morphing effect by distilling the information of pre-trained GAN.
Research Experience
Visual Media Lab Research Assistance Jan.2017-Mar.2024
Adobe Research Research Intern Jun.2022-Aug.2022 Mar.2021-Jun.2021
NAVER Corp. Research Intern Dec.2019-Jun.2020
Project
3D Cinemagraph for AR Contents Creation June.2020-Dec.2022
Develop user-friendly content production technology that enables general users to easily transform a
single image into immersive AR contents where background and characters within the image move and
interact with real-world objects.
Development of Camera Work Tracking Technology for Animation Production using Artificial
Intelligence May.2018-Dec.2019
Analyze cinematography properties of a reference video clip using neural networks and replicate the
cinematic intention of the reference video to the 3D animation.