Research Focus

Designing user-centered, inclusive technologies using tangible interaction and mixed reality (VR/AR) to enhance sensory and communication experiences in diverse contexts, such as healthcare, education, and collaborative environments.

In this section, I explained each project and linked them to their publications, marked as [X].
My Research

Research Projects

DIS '23 (Second author) [1]
Co-designing Magic Machines for Everyday Mindfulness with Practitioners

We explored designing technology to support everyday mindfulness activities for people with varying levels of experience. Through 9 magic machine workshops, 30 mindfulness practitioners explored and reflected on their personal experiences of everyday mindfulness, and generated designs that support their daily practice. I facilitated the workshops, conducted data analysis, as well as contributed in writing the paper.

Our findings identified six categories of designs conceptualized by our participants: everyday objects, physical spaces, wearables, metaphorical art, companions, and toys. We further analyze the practitioners’ thought processes and considerations for designs that support everyday mindfulness, such as eliciting and regulating emotion and associating mindfulness with routine daily activities. Finally, we discussed the implications of designing individualized mindfulness products and the potential of using co-design magic machine workshops to explore a practical design space.

Submitted CSCW '25 (Second Author) [2]
Co-Designing Environment-Based Strategies with
Neurodivergent Individuals for Sensory-Inclusive Dental Visit Experiences.

We conducted 12 2-hour co-design workshops with 13 neurodivergent or sensory processing disorder (SPD) individuals to reimagine the dental experience to reduce dental anxiety. We explored the environment-based interventions within the dental visit experience for our participants. The study focused on finding the overarching design guideline that could support the neurodivergent / SPD individuals regarding sensory experiences. I facilitated the workshops, conducted data analysis, as well as contributed in writing the paper.

We are currently developing an AR prototype with a physical interaction device to enhance the sensory experience.

Previous Study
RO-MAN '24 (Acknowledged contributer) [3]
EMoBo: Interactive devices supporting positive relational processes between children and adults in residential care settings

We propose e-MoBo, a low-cost, non-humanoid “Robo-Mediator” of our own design to train children’s socio-emotional skills towards creating stronger relationships with others. We report on the developing e-MoBo and results of a field study with the current prototype and 14 neurotypical children, ages 5-9, as we prepare to deploy e-MoBo in a residential center with traumatized children. Our results suggest that e-MoBo, compared to a control, helps children express emotions, offering the promise of a low-cost, nonanthropomorphic, Robo-Mediator meeting children’s needs. I facilitated the field study as well as fabricated the prototype with 3D CAD and Laser cutting skills - working especially on the cubes.

EMoBo ROMAN Paper
NSF Award #2234802 (Acknowledged contributer) [5]
EAGER: A Training Tool to Help Teachers Recognize and Reduce Bias in Their Classroom Behaviors and Increase Interpersonal Competence

In EAGER, I worked with Professor Susan Fussell in the communication & collaborative technologies lab to explore how VR could utilize nonverbal communication in educational and collaborative workplace settings. I initiated the project by writing the VR Psychophysiology guide, which informed biosensor and VR setup protocols.

NSF Award
Publications

Publications

[1] Jingjin Li, Nayeon Kwon, Huong Pham, Ryun Shim, and Gilly Leshed. 2023. Co-designing Magic Machines for Everyday Mindfulness with Practitioners. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS '23). Association for Computing Machinery, New York, NY, USA, 1630–1647. https://doi.org/10.1145/3563657.3595976

[2]
Anonymous. “Co-Designing Environment-Based Strategies with Neurodivergent Individualsfor Sensory-Inclusive Dental Visit Experiences.” ACM CSCW. Submitted October 2024. [Status: Under Review] 

Acknowledged Contributor in: 
[3] R. Cañete, Y. Kedar, and K. E. Green, "e-MoBo, a Low-Cost, ‘Robo-Mediator’ Helping Therapists Teach Children How to Express Emotions: Insights from Field Testing," Proc. 33rd IEEE Int. Conf. Robot & Human Interact. Commun. (RO-MAN), Pasadena, CA, 2024.

Acknowledged Contributor in: 
[4] Jingjin Li, Jiajing Guo, and Gilly Leshed. 2024. Meditating in Live Stream: An Autoethnographic and Interview Study to Investigate Motivations, Interactions and Challenges. Proc. ACM Hum.-Comput. Interact. 8, CSCW1, Article 140 (April 2024), 33 pages.
https://doi.org/10.1145/3637417

Acknowledged Contributor in: 
[5] Andrea Won (PI), Susan Fussell (Co-PI), Aleshia Hayes (Co-PI). NSF Award  #2234802. EAGER: A Training Tool to Help Teachers Recognize and Reduce Bias in Their Classroom Behaviors and Increase Interpersonal Competence