Jaeyeon Kim
Hi everyone! I’m Jaeyeon Kim, a PhD student at the Language Technologies Institute, Carnegie Mellon University, co-advised by Professor Carlos Busso and Professor Shinji Watanabe.
My primary research interests lie in developing artificial intelligence that understands and interacts with the world in a human-like manner by integrating multiple modalities — particularly by bridging linguistic and visual knowledge with auditory information.
selected publications
Gaze Beyond the Frame: Forecasting Egocentric 3D Visual SpanIn NeurIPS (Spotlight) , 2025
WoW-Bench: Evaluating Fine-Grained Acoustic Perception in Audio-Language Models via Marine Mammal VocalizationsarXiv preprint arXiv:2508.20976, 2025
Learning Semantic Information from Raw Audio Signal Using Both Contextual and Phonetic RepresentationsIn ICASSP , 2024