My Research

My research focuses on using biosignals such as eye tracking, facial expressions, and physiological cues (GSR, heart rate, breathing rate) as "super power" input (ML-trained) and output (visual augmentation) in XR, to support empathic Human-AI Mixed Reality collaboration (XR+AI)

I completed my PhD research at the Empathic Computing Lab led by Prof Mark Billinghurst and Dr Gun Lee at the University of South Australia, where I investigated gaze-supported multimodal interaction techniques (gaze with hand, speech or physiological cues) and interface designs in Mixed Reality remote collaboration. I subsequently published four full papers and four technical posters at IEEE VR, ISMAR, FrontiersVR, PACM HCI (CSCW), ACM CHI, SigGraph, and SigGraph Asia for my PhD topic. I completed my Master’s degree in Human-Computer Interaction from the University of St Andrews (UK), where I worked on collaborative Immersive Analytics under Prof Aaron Quigley. I also have a Bachelor’s degree in Economics, where I built my analysis skills.

My Collaboration

I have collaborated with Meta Reality Labs Research (RLR), ETRI Korea, and DSTG. I am currently in collaboration with Empathic Computing Lab (University of South Australia and University of Auckland), University of Adelaide, and CSIRO Data61.

Teaching and Supervising

I am currently a Lecturer (Assistant Professor equivalent) at the RMIT University in Melbourne Australia. I supervise and teach human-AI related XR topics. Currently, I have 1 PhD student (co-supervise with Professor Mark Billinghurst and Dr Theophilus Teo) and 3 research interns from Australia, USA and China. I work closely with the Empathic Computing Lab, the Australian Research Centre for Interactive and Virtual Environments (IVE) and the Australiasian Researchers in Interactive Virtual Environments (ARIVE) network in Australia and New Zealand. Please reach out at allison.jing@rmit.edu.au if you share a similar research interest and are considering doing a PhD/Masters/Honours with us.

Current Research Topics (some are in collaboration with UniSA)

1. Using Motion-free ML-trained Physiological Data as Superpower Input in Mixed Reality
2. EmoGenie: Building XR Empathy-Generative Agent to Support Communication Among People with ADHD
3. Explore Visual Cues Combined with Multimodal LLM to enhance Mixed Reality Collaboration
4. Objectifying Emotion into Visual Augmentation in Assynchronise Virtual Environments
5. RoadGardian: Utilizing AR and AI to Enhance Emotion-Induced Road Hazard
6. eXpolloRa Hub: Multiuser XR Galaxy for Cross-Reality Collaboration

Previous Expriences

Previously, I interned at Meta Reality Labs Research (RLR), Australian Research Centre for Interactive and Virtual Environments (IVE), St Andrews Computer-Human Interaction research group (SACHI), and China Development Research Foundation (CDRF) in Australia, Europe, and Asia.

Served clients from tech, startup, NGO, and gaming industries, I also acquired a wide range of skillsets designing for both enterprise and consumer products. I worked as a Product Designer and Content Manager for ChefUS (Bay area cloud kitchen startup), Xbox, Microsoft, Amazon Game Studios, SWACS (a Scottish NGO) from both Europe and North America.

Personal Interests...

Apart from doodling, I am also an avid traveller and have since lived in the US (Bellevue WA as my home base), China, Singapore, Australia, and the UK. I enjoy learning local culture while living on different continents. I also like to play PC/console games and do outdoor activities.

Keywords: Collaborative Visualization | Multimodal Interaction | Rapid Prototyping | UX Research | 3D Interface Design | System Design | Product Design | Empathic Computing