Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Lin Zhu has a total of 39 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    PilotAR: Streamlining Pilot Studies with OHMDs from Concept to Insight

    by Nuwan Janaka, Runze Cai, Ashwin Ram, Lin Zhu, Shengdong Zhao, Kai Qi Yong

    Pilot studies in HCI research serve as a cost-effective approach to validate potential ideas and identify impactful findings before extensive studies. Yet, the additional requirements of AR/MR, such as multi-view observations and increased multitasking, make it challenging to conduct pilot studies effectively, hindering innovations in this field. Based on interviews with 12 AR/MR researchers, we identified the key challenges associated with conducting AR/MR pilot studies with Optical See-Through Head-Mounted Displays (OST-HMDs, OHMDs), including the inability to observe and record in-context user interactions, increased task load, and difficulties with in-context data analysis and discussion. To tackle these challenges, we introduce PilotAR, a desktop-based tool designed iteratively to enhance OHMD-based AR/MR pilot studies. PilotAR facilitates data collection via live first-person and third-person views, multi-modal annotations, and flexible wizarding interfaces. It also accommodates multi-experimenter settings, streamlines the study process with configurable workflows and shortcuts, records annotated data, and eases results sharing. Formative testing, conducted using three case studies, has highlighted the significant benefits of PilotAR, as well as its potential for further development and refinement.


  • Open Access

    Exploring the Roles of Artifacts in Speculative Futures: Perspectives in HCI

    by Lin Zhu, Jiayue Wang, Jiawei Li

    In an era where technology increasingly blurs the boundaries between humans and machines, artifacts have become crucial mediums for critically examining the technological, social, and ethical dimensions of Human–Computer Interaction (HCI). This study explores artifacts as a key yet underutilized medium for speculation in the evolving field of HCI from a systemic perspective. While artifacts increasingly enable HCI to move beyond optimizing user experiences towards critically and collaboratively envisioning futures, perspectives comprehensively examining artifacts across the speculative design process and their impacts remain limited. Through a literature review of 53 speculative artifacts within the scope of HCI, this research elucidates the roles of artifacts across intention, making, and impact. Four categories of speculative artifacts emerged—Reflective, Exploratory, Interventional, and Heuristic—demonstrating how artifacts employ material, ambiguous, functional, and provocative forms to shape experiences, behaviors, and social norms. This study highlights the need for HCI to increasingly recognize the capacity of artifacts to support critical, sustained, participatory speculation by providing tangible representations of alternative futures. Speculative artifacts thus serve as powerful mediums to engage in societal discourse around the ethics and values of emerging technologies and to envision and enact responsible innovation. The materialization of alternative futures through artifacts allows researchers to reimagine socio-technological relationships, pushing design into inclusive, controversial spaces where diverse stakeholders can collaboratively shape desired and undesired futures.


  • Open Access

    GlassMessaging: Supporting Messaging Needs During Daily Activities Using OST-HMDs

    by Nuwan Janaka, Jie Gao, Lin Zhu, Shengdong Zhao, Lan Lyu, Peisen Xu, Maximilian Nabokow, Silang Wang, Yanch Ong

    The act of communicating with others during routine daily tasks is both common and intuitive for individuals. However, the hands- and eyes-engaged nature of present digital messaging applications makes it difficult to message someone amidst such activities. We introduce GlassMessaging , a messaging application designed for Optical See-Through Head-Mounted Displays (OST-HMDs). It facilitates messaging through both voice and manual inputs, catering to situations where hands and eyes are preoccupied. GlassMessaging was iteratively developed through a formative study identifying current messaging behaviors and challenges in common multitasking with messaging scenarios.


  • Open Access

    GlassMessaging

    by Nuwan Janaka, Jie Gao, Lin Zhu, Shengdong Zhao, Lan Lyu, Peisen Xu, Maximilian Nabokow, Silang Wang, Yanch Ong

    Communicating with others while engaging in simple daily activities is both common and natural for people. However, due to the hands- and eyes-busy nature of existing digital messaging applications, it is challenging to message someone while performing simple daily activities. We present GlassMessaging, a messaging application on Optical See-Through Head-Mounted Displays (OHMDs), to support messaging with voice and manual inputs in hands- and eyes-busy scenarios. GlassMessaging is iteratively developed through a formative study identifying current messaging behaviors and challenges in common multitasking with messaging scenarios. We then evaluated this application against the mobile phone platform on varying texting complexities in eating and walking scenarios. Our results showed that, compared to phone-based messaging, GlassMessaging increased messaging opportunities during multitasking due to its hands-free, wearable nature, and multimodal input capabilities. The affordance of GlassMessaging also allows users easier access to voice input than the phone, which thus reduces the response time by 33.1% and increases the texting speed by 40.3%, with a cost in texting accuracy of 2.5%, particularly when the texting complexity increases. Lastly, we discuss trade-offs and insights to lay a foundation for future OHMD-based messaging applications.


  • Open Access

    GlassMessaging: Supporting Messaging Needs During Daily Activities Using OST-HMDs

    by Nuwan Janaka, Jie Gao, Lin Zhu, Shengdong Zhao, Lan Lyu, Peisen Xu, Maximilian Nabokow, Silang Wang, Yanch Ong

    The act of communicating with others during routine daily tasks is both common and intuitive for individuals. However, the hands- and eyes-engaged nature of present digital messaging applications makes it difficult to message someone amidst such activities. We introduce GlassMessaging, a messaging application designed for Optical See-Through Head-Mounted Displays (OST-HMDs). It facilitates messaging through both voice and manual inputs, catering to situations where hands and eyes are preoccupied. GlassMessaging was iteratively developed through a formative study identifying current messaging behaviors and challenges in common multitasking with messaging scenarios

  • Thin Films for Surface Protection

    by Fredrick Madaraka Mwema, Tien-Chien Jen, Lin Zhu

    Surface engineering is one of the technologies that has benefited from the advancement in thin film processing. In this chapter, thin films for surface protection of materials/components have been described. Some of the application areas for surface engineering of thin films include cutting tools, aerospace, automotive components, etc. In principle, thin films of superior mechanical, chemical, and physical properties are deposited on the surfaces of substrate materials as coatings. This way, the surface properties of the substrate material are enhanced for better performance. Thin films for surface protection can be classified as coatings for wear protection, coatings for corrosion protection, and hydrophobic/hydrophilic materials. As discussed in the chapter oxides and nitrides are the most common thin film materials for these applications. The chapter has also presented the emerging topics and trends in this topic, and it is noted that besides the functional requirements of semiconductor thin films, there is a need to develop coatings with protective and self-healing characteristics for durability.

  • Open Access

    Event-based Video Reconstruction via Potential-assisted Spiking Neural Network

    by Lin Zhu, Xiao Wang, Yi Chang, Jianing Li, Tiejun Huang, Yonghong Tian

    Neuromorphic vision sensor is a new bio-inspired imaging paradigm that reports asynchronous, continuously per-pixel brightness changes called `events' with high temporal resolution and high dynamic range. So far, the event-based image reconstruction methods are based on artificial neural networks (ANN) or hand-crafted spatiotemporal smoothing techniques. In this paper, we first implement the image reconstruction work via fully spiking neural network (SNN) architecture. As the bio-inspired neural networks, SNNs operating with asynchronous binary spikes distributed over time, can potentially lead to greater computational efficiency on event-driven hardware. We propose a novel Event-based Video reconstruction framework based on a fully Spiking Neural Network (EVSNN), which utilizes Leaky-Integrate-and-Fire (LIF) neuron and Membrane Potential (MP) neuron. We find that the spiking neurons have the potential to store useful temporal information (memory) to complete such time-dependent tasks. Furthermore, to better utilize the temporal information, we propose a hybrid potential-assisted framework (PA-EVSNN) using the membrane potential of spiking neuron. The proposed neuron is referred as Adaptive Membrane Potential (AMP) neuron, which adaptively updates the membrane potential according to the input spikes. The experimental results demonstrate that our models achieve comparable performance to ANN-based models on IJRR, MVSEC, and HQF datasets. The energy consumptions of EVSNN and PA-EVSNN are 19.36$\times$ and 7.75$\times$ more computationally efficient than their ANN architectures, respectively.