I am a PhD student in Computer Science at the Korea Institute of Advanced Science and Technology (KAIST). My research focuses on vision-language models (VLMs), with a particular interest in applications for sign language and tasks related to long video understanding, including robotics.

Experiences

Korea Institute of Science and Technology (KIST)
June. 2019 - Mar. 2020
Intern researcher
Conducting research on developing a machine learning-based facial expression generator for robots.

Korea Institute of Science and Technology (KIST)
Oct. 2015 - Mar. 2016
Student researcher
Conducting research on developing an ontology-based approach for robot planning.

Publications

An Efficient Sign Language Translation Using Spatial Configuration and Motion Dynamics with LLMs
Eui Jun Hwang, Sukmin Cho, Junmyeong Lee, and Jong C. Park
Under Review (ARR)
pdf|

A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production
Eui Jun Hwang, Sukmin Cho, Huije Lee, and Jong C. Park
WACV'25 | IEEE/CVF Winter Conference on Applications of Computer Vision
pdf| abstract|

PiLaMIM: Toward Richer Visual Representations by Integrating Pixel and Latent Masked Image Modeling
Junmyeong Lee, Eui Jun Hwang, Sukmin Cho, and Jong C. Park
SSL@NeurIPS'24 | Self-Supervised Learning - Theory and Practice
To be appeared

Autoregressive sign language production: A gloss-free approach with discrete representations (Oral)
Eui Jun Hwang, Huije Lee, and Jong C. Park
FG'24 | IEEE International Conference on Automatic Face and Gesture Recognition
pdf| abstract|

Preprocessing Mediapipe Keypoints with Keypoint Reconstruction and Anchors for Isolated Sign Language Recognition
Kyunggeun Roh, Huije Lee, Eui Jun Hwang, Sukmin Cho, Jong C. Park
RPSL@LREC-COLING'24 | Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources
pdf| abstract|

Leveraging large language models with vocabulary sharing for sign language translation
Huije Lee, Jung Ho Kim, Eui Jun Hwang, and Jong C. Park
ICASSPW'23 | IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops
pdf| abstract|

Robot dialog system in the context of hospital receptionist and its demonstration
Eui Jun Hwang, Byeong Kyu Ahn, Jong Yoon Lim, Bruce A Macdonald, and Ho Seok Ahn
IJSR'23 | International Journal of Social Robotics
pdf| abstract|

Sign language production with avatar layering: A critical use case over rare words
Jung-Ho Kim, Eui Jun Hwang, Sukmin Cho, Du Hui Lee, and Jong C. Park
LREC'22 | Language Resources and Evaluation Conference
pdf| abstract|

Non-Autoregressive Sign Language Production with Gaussian Space
Eui Jun Hwang, Jung-Ho Kim, and Jong C. Park
BMVC'21 | British Machine Vision Conference
pdf| abstract|

Demonstration of hospital receptionist robot with extended hybrid code network to select responses and gestures
Eui Jun Hwang, Byeong Kyu Ahn, Bruce A Macdonald, and Ho Seok Ahn
ICRA'20 | International Conference on Robotics and Automation
pdf| abstract|

Automatic Generation of Eye Expressions with End-to-End Learning
Ung Park*, Eui Jun Hwang*, and Jongsuk Choi
(* = Equal Contribution)
RO-MAN'20 | IEEE International conference on robot and human interactive communication
pdf| abstract|

Hospital receptionist robot v2: design for enhancing verbal interaction with social skills
Ho Seok Ahn, Wesley Yep, Jongyoon Lim, Byeong Kyu Ahn, Deborah L Johanson, Eui Jun Hwang, Min Ho Lee, Elizabeth Broadbent, and Bruce A MacDonald
RO-MAN'19 | IEEE International conference on robot and human interactive communication
pdf| abstract|

The effect of robot attentional behaviors on user perceptions and behaviors in a simulated health care interaction: randomized controlled trial
Deborah L Johanson, Ho Seok Ahn, Bruce A MacDonald, Byeong Kyu Ahn, JongYoon Lim, Eui Jun Hwang, Craig J Sutherland, and Elizabeth Broadbent
JMIR'19 | Journal of medical Internet research
pdf| abstract|

End-to-end dialogue system with multi languages for hospital receptionist robot
Eui Jun Hwang, Bruce A Macdonald, and Ho Seok Ahn
UR'19 | International conference on ubiquitous robots
pdf| abstract|

A 3d simulation for social human-robot interaction with ontology-based robot knowledge
Eui Jun Hwang, Sangyun Lee, Yoonseob Lim, Jongsuk Choi
URAI'16 | International Conference on Ubiquitous Robots and Ambient Intelligence
pdf| abstract|

Education

Korea Advanced Institute of Science and Technology (KAIST)
Mar. 2020 - current
Ph.D. in School of Computing

The University of Auckland (UoA)
Mar. 2017 - Feb. 2019
M.S. in Software Engineering

The University of Auckland (UoA)
Mar. 2011 - Feb. 2017
B.S. in Computer Science