Dynamic Reality Lab

Assistant Professor
University of Nebraska–Lincoln
School of Computing (CSE)
College of Engineering
Dynamic Reality Lab (DRL)
📍Nebraska Hall 102

yujnkm@cse.unl.edu

DRL Website
Nebraska Profile
CV

I am an Assistant Professor in the School of Computing , College of Engineering at the University of Nebraska–Lincoln and the Director of the Dynamic Reality Lab (DRL). My research extends human interactivity within the "blended world" of physical and virtual environments, specializing in Human-Computer Interaction (HCI) and wide-area, outdoor Augmented Reality (AR) experiences. By deploying advanced sensing technologies--including EEG, EMG, and eye-tracking--I work to accurately interpret human behavior and optimize interactions with physical AI, robotics, and avatar-based Human-AI systems. I am particularly interested in the intersection of HCI and spatial computing, exploring how we design for agency and ownership within 3D interactive narratives that unfold through entities such as DNN avatars. I also explore immersive theater and interactive narrative structures into these technical systems to better simulate the art of the human experience in digital spaces.

Prior to joining Nebraska, I was an Assistant Professor [tenure-track] in Visual Computing and Interactive Media (VCIM) at Texas A&M University. I earned my PhD from the University of California, Santa Barbara. During my doctoral studies, I collaborated with Microsoft Research's Extended Perception, Interaction & Cognition (EPIC) Research Group. I also spent time at Nokia Bell Labs within the Experiments in Art and Technology (E.A.T.) and Future X Robotics Research Group. My contributions during these periods include the development of projects such as the Reality Distortion Room and WorldTracer, which capture the art of human experience in digital augmented reality where interactive narratives unfold through engagement.

I frequently present my work at academic venues, including IEEE VR, ISMAR, VRST, ACM CHI, UIST, and DIS. I am a committed member of the research community and welcome colleagues and students to say hello if they see me at any of these events!

Recent News

3-18-2026

We had one p

Research Areas

Wide-Area Outdoor Augmented Reality + Navigation

My research investigates the technical and spatial challenges of wide-area outdoor AR at scales exceeding three football fields. Moving beyond room-scale constraints, this work develops robust geospatial anchoring and persistent world-mapping to ensure digital stability across expansive, unstructured landscapes. By engineering the infrastructure for massive-scale spatial computing, we enable seamless digital-physical integration that remains consistent for multiple users in real-world environments.

Biometric Integration for Cognitive-Aware Spatial Computing

To optimize the user experience within complex AR environments, my lab integrates multimodal sensors, including EEG and eye-tracking. We study how spatial awareness, attention, and memory are impacted by augmented overlays, using real-time biometric data to monitor and manage cognitive load. By developing adaptive "cognitive cues," this research seeks to create intelligent interfaces that dynamically synchronize information delivery with the user’s internal mental state.

Immersive Storytelling and Human Expressiveness

This research transforms immersive theater and interactive narratives by integrating Deep Neural Networks (DNN) and autonomous AI agents. We explore how AI-powered avatars can enrich digital experiences, making them feel more "live," connected, and human. By aligning intelligent agents with expressive avatar formats, my lab creates responsive environments that adapt to user presence and sentiment, ultimately expanding the boundaries of human expressiveness in digital performance.

Students

Dynamic Reality Lab [DRL]
Nebraska Hall , Room 102
900 N 16th St, Lincoln, NE 68508

I grew up in Japan, attending Japanese public schools and my research have taken me across the globe, I often joke that I have lived in almost every corner of the United States--from the Northeast and the South to the West Coast and the Midwest! I found immense joy from exploring and experimenting ways to connect with people. Throughout these journeys, I found immense joy in exploring and experimenting with new ways to connect with people. These experiences have shaped my deep appreciation for human interaction and discussion within the context.