Dr. Fan leads Accessible & Pervasive User EXperience (APEX) Group to conduct research in Human-Computer Interaction (HCI) by exploring the design principles, interaction techniques and applications of Assistive Technology, Human-AI Interaction and Collaboration as well as VR/AR/MR, in particular for addressing aging, accessibility, and learning challenges. His group regularly publishes scientific papers in top HCI venues and has won 10 paper awards, such as Best Paper Honorable Mention Awards (x 4) and Best Paper Award at CHI, Best Paper Honorable Mention Award at ACM Multimedia, Best Paper Honorable Mention Award at UbiComp, Best Artifact Award at ASSETS, and Best Paper Honorable Mention Awards at Chinese CHI (x 2). He regularly serves in various roles for top HCI venues, including CHI/CSCW/ASSETS/DIS.
Best Paper Honorable Mention Award Inventing a VR-Mediated Cognitive Defusion for Managing Negative Thoughts
CHI 2024
Best Paper Honorable Mention Award Inventing a novel electrotactile wearable on fingertip edges to help Blind and Low Vision (BLV) People comprehend charts
CHI 2024
Best Paper Honorable Mention Award Inventing an AI- and AR-powered app to assist BLV People to use digital-screen parcel lockers
CHI 2024
Best Paper Honorable Mention Award Promoting traditional Chinese cultural heritage by assisting traditional Chinese opera (Xiqu) performers
CHI 2023
Best Paper Honorable Mention Award Inventing a novel voice-accompanying hand-to-face gesture interaction technique
Chinese CHI 2023
Best Paper Honorable Mention Award Inventing an AR-based approach to help with the learning of Chinese traditional opera (Xiqu) makeup
Chinese CHI 2022
Best Paper Honorable Mention Award A systematic review of communication in immersive social Virtual Reality (VR)
ASSETS 2020
Best Artifact Award Inventing a novel eyelid gesture interaction for people with motor impairments to use touchscreen without touch
CHI 2019
Best Paper Award Investigating how livestreamers utilize streaming to promote traditional Chinese heritage
UbiComp 2015
Best Paper Honorable Mention Award Inventing a novel active acoustic sensing IoT device for monitoring content level in a container
Research
Note: *: Corresponding Author (annotated since 2022); #: equal contribution
CHI 2025
Toward Enabling Natural Conversation with Older Adults via the Design of LLM-Powered Voice Agents that Support Interruptions and Backchannels
Chao Liu, Mingyang Su, Yan Xiang, Yuru Huang, Yiqian Yang, Kang Zhang*, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
RemoteChess: Enhancing Older Adults’ Social Connectedness via Designing a Virtual Reality Chinese Chess (Xiangqi) Community
Qianjie Wei, Xiaoying Wei, Yiqi Liang, Fan Lin, Nuonan Si, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
"Watch, Smell, Ask, Touch": Practices, Challenges, and Technological Support in Ability Assessment of Older Adults from Practitioners' Perspectives in China
Zhongyue Zhang, Yuru Huang, Mengyang Wang, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
JournalAIde: Empowering Older Adults in Digital Journal Writing
Shixu Zhou, Weiyue Lin, Zuyu Xu, Xiaoying Wei, Raoyi Huang, Xiaojuan Ma, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
Chorus of the Past: Toward Designing a Multi-agent Conversational Reminiscence System with Digital Artifacts for Older Adults
Jingwei Sun, Zhongyue Zhang, Mengyang Wang, Nianlong Li, Yan Xiang, Liuxin Zhang, Yu Zhang*, Qianying Wang*, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
Facilitating Daily Practice in Intangible Cultural Heritage through Virtual Reality: A Case Study of Traditional Chinese Flower Arrangement
Yingna Wang, Qingqin Liu, Xiaoying Wei, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
Designing LLM-Powered Multimodal Instructions to Support Rich Hands-on Skills Remote Learning: A Case Study with Massage Instructors and Learners
Chutian Jiang, Yinan Fan, Junan Xie, Emily Kuang, Baichuan Feng, Kaihao Zhang*, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
InteRecon: Towards Reconstructing Interactivity of Personal Memorable Items in Mixed Reality
Zisu Li, Jiawei Li, Zeyu Xiong, Shumeng Zhang, Faraz Faruqi, Stefanie Mueller, Chen Liang, Xiaojuan Ma, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
Toward Personalizable AI Node Graph Creative Writing Support: Insights on Preferences for Generative AI Features and Information Presentation Across Story Writing Processes
Hua Xuan Qin, Guangzhi Zhu, Mingming Fan, and Pan Hui* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
CHI 2025
ACKnowledge: A Computational Framework for Human Compatible Affordance-based Interaction Planning in Real-world Contexts
Ziqi Pan, Xiucheng Zhang, Zisu Li, Zhenhui Peng, Mingming Fan, Xiaojuan Ma* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '25), April 26 11--May 1, 2025, Yokohama, Japan PDF
TVCG 2025
TeamPortal: Exploring Virtual Reality Collaboration Through Shared and Manipulating Parallel Views
Xian Wang, Luyao Shen, Lei Chen, Mingming Fan, Lik-Hang Lee IEEE Transactions on Visualization and Computer Graphics (TVCG), 2025 PDF
TVCG 2025
FocalSelect: Improving Occluded Objects Acquisition with Heuristic Selection and Disambiguation in Virtual Reality
Duotun Wang, Linjie Qiu, Boyu Li, Qianxi Liu, Xiaoying Wei, Jianhao Chen, Zeyu Wang, Mingming Fan IEEE Transactions on Visualization and Computer Graphics (TVCG) (to be presented at IEEE VR) PDF
TACCESS 2025
How Can Haptic Feedback Assist People with Blind and Low Vision (BLV): A Systematic Literature Review
Chutian Jiang#, Emily Kuang#, Mingming Fan* TACCESS 2025 ACM Transactions on Accessible Computing (TACCESS) PDF
IJHCS 2025
ContractMind: Trust-calibration interaction design for AI contract review tools
Jian Zeng#, Kaixin Chen#, Ruiqi Wang, Yilong Li, Mingming Fan, Kaishun Wu, Xiaoke Qi*, Lu Wang* IJHCS International Journal of Human-Computer Studies, Volume 196, 2025, 103411, ISSN 1071-5819 PDF
CSCW 2025
Understanding and Co-designing Photo-based Reminiscence with Older Adults
Zhongyue Zhang, Lina Xu, Xingkai Wang, Xu Zhang, Mingming Fan* CSCW 2025 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), CSCW (In Press) PDF
CSCW 2025
Challenges in Adopting Companion Robots: An Exploratory Study of Robotic Companionship Conducted with Chinese Retirees
Mengyang Wang, Keye Yu, Yukai Zhang, Mingming Fan* CSCW 2025 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), CSCW (In Press) PDF
CSCW 2025
AI as a Bridge Across Ages: Exploring The Opportunities of Artificial Intelligence in Supporting Inter-Generational Communication in Virtual Reality
Qiuxin Du#, Xiaoying Wei#, Jiawei Li, Emily Kuang, Jie Hao, Dongdong Weng, Mingming Fan* CSCW 2025 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), CSCW (In Press) PDF
CSCW 2025
Systematic Literature Review of Using Virtual Reality as a Social Platform in HCI Community
Xiaoying Wei, Xiaofu Jin, Ge Lin Kan, Yukang Yan, Mingming Fan* CSCW 2025 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), CSCW (In Press) PDF
CSCW 2025
Practices and Challenges of Online Love-seeking Among Deaf or Hard of Hearing People: A Case Study in China
Beiyan Cao, Jingling Zhang, Changyang He, Yuru Huang, Muzhi Zhou*, Mingming Fan* CSCW 2025 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), CSCW (In Press) PDF
VRST 2024
Toward Facilitating Search in VR With the Assistance of Vision Large Language Models
Chao Liu, Clarence Chi San Cheung, Mingqing Xu, Zhongyue Zhang, Mingyang Su, Mingming Fan* VRST 2024 In Proceedings of ACM Symposium on Virtual Reality Software and Technology (VRST) PDF
VINCI 2024
Investigating Size Congruency Between the Visual Perception of a VR Object and the Haptic Perception of Its Physical World Agent
Wenqi Zheng, Dawei Xiong, Cekai Weng, Jiajun Jiang, Junwei Li, Jinni Zhou, Mingming Fan* VINCI 2024 The 17th International Symposium on Visual Information Communication and Interaction (VINCI 2024) PDF
Qianjie Wei, Jingling Zhang, Pengqi Wang, Xiaofu Jin, Mingming Fan* VINCI 2024 The 17th International Symposium on Visual Information Communication and Interaction (VINCI 2024) PDF
IMWUT (UbiComp 2024)
SilverCycling: Exploring the Impact of Bike-Based Locomotion on Spatial Orientation for Older Adults in VR
Qiongyan Chen, Zhiqing Wu, Yucheng Liu, Lei Han, Zisu Li, Ge Lin Kan, Mingming Fan* UbiComp 2024 Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) PDF
CSCW 2024
Avatar Appearance and Behavior of Potential Harassers Affect Users' Perceptions and Response Strategies in Social Virtual Reality (VR): A Mixed-Methods Study
Xuetong Wang#, Ziyan Wang#, Mingmin Zhang, Kangyou Yu, Pan Hui, Mingming Fan* CSCW 2024 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), CSCW PDF
MM 2024
VR-Mediated Cognitive Defusion: A Comparative Study for Managing Negative Thoughts
Kento Shigyo, Yi-Fan Cao, Kentaro Takahira, Mingming Fan, Huamin Qu Proceedings of the 32nd ACM International Conference on Multimedia (MM'24) PDF
Best Paper Honorable Mention Award
ASSETS 2024
Beadwork Bridge: Understanding and Exploring the Opportunities of Beadwork in Enriching School Education for Blind and Low Vision (BLV) People
Shumeng Zhang, Weiyue Lin, Zisu Li, Ruiqi Jiang, Chen Liang, Mingming Fan*, Raul Masu* The 26th International ACM SIGACCESS Conference on Computers and Accessibility PDF
DIS 2024
Exploring the Impact of Artificial Intelligence-Generated Content (AIGC) Tools on Social Dynamics in UX Collaboration
Ziyan Wang, Luyao Shen, Emily Kuang, Shumeng Zhang, Mingming Fan* ACM Conference on Designing Interactive Systems (DIS) 2024 PDF
TVCG
VisTellAR: Embedding Data Visualization to Short-form Videos Using Mobile Augmented Reality
Wai Tong, Kento Shigyo, Lingping Yuan, Mingming Fan, Ting-Chuen Pong, Huamin Qu, Meng Xia IEEE Transactions on Visualization and Computer Graphics (TVCG), Early Access PDF
IJHCI
EmojiChat: Toward Designing Emoji-Driven Social Interaction in VR Museums
Luyao Shen#, Xian Wang#, Sijia Li, Lik-Hang Lee, Mingming Fan, Pan Hui* International Journal of Human–Computer Interaction, 1–17 PDF
CHI 2024
Toward Making Virtual Reality (VR) More Inclusive for Older Adults: Investigating Aging Effects on Object Selection and Manipulation in VR
Zhiqing Wu, Duotun Wang#, Shumeng Zhang#, Yuru Huang, Zeyu Wang, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
Designing Unobtrusive Modulated Electrotactile Feedback on Fingertip Edge to Assist Blind and Low Vision (BLV) People in Comprehending Charts
Chutian Jiang#, Yinan Fan#, Junan Xie, Emily Kuang, Kaihao Zhang*, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF |
Best Paper Honorable Mention Award
CHI 2024
To Reach the Unreachable: Exploring the Potential of VR Hand Redirection for Upper Limb Rehabilitation
Peixuan Xiong, Yukai Zhang, Nandi Zhang, Shihan Fu, Xin Li, Yadan Zheng, Jinni Zhou, Xiquan Hu*, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support
Zhitong (Klara) Guan#, Zeyu Xiong#, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF |
Best Paper Honorable Mention Award
CHI 2024
LightSword: A Customized Virtual Reality Exergame for Long-Term Cognitive Inhibition Training in Older Adults
Qiuxin Du, Zhen Song*, Haiyan Jiang, Xiaoying Wei, Dongdong Weng, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR
Jingze Tian#, Yingna Wang#, Keye Yu, Liyi Xu, Junan Xie, Franklin Mingzhe Li, Yafeng Niu, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
Enhancing UX Evaluation Through Collaboration with Conversational AI Assistants: Effects of Proactive Dialogue and Timing
Emily Kuang, Minghao Li, Mingming Fan*, Kristen Shinohara* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults Explore and Learn Smartphone Applications
Xiaofu Jin, Wai Tong, Xiaoying Wei, Xian Wang, Emily Kuang, Xiaoyu Mo, Huamin Qu, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
"It is hard to remove from my eye": Design Makeup Residue Visualization System for Chinese Traditional Opera (Xiqu) Performers
Zeyu Xiong, Shihan Fu, Yanying Zhu, Chenqing Zhu, Xiaojuan Ma, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF |
Best Paper Honorable Mention Award
CHI 2024
Bridging the Literacy Gap for Adults: Streaming and Engaging in Adult Literacy Education through Livestreaming
Shihan Fu, Jianhao Chen, Emily Kuang, Mingming Fan* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
CoPrompt: Supporting Prompt Sharing and Referring in Collaborative Natural Language Programming
Li Feng, Ryan Yen, Yuzhe You, Mingming Fan, Jian Zhao, Zhicong Lu Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with Dystonia
Qin Sun, Yunqi Hu, Mingming Fan, Jingting Li, Su-Jing Wang* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
See Widely, Think Wisely: Toward Designing a Generative Multi-agent System to Burst Filter Bubbles
Yu Zhang #, Jingwei Sun#, Li Feng, Cen Yao, Mingming Fan, Liuxin Zhang, Qianying wang, Xin Geng*, Yong Rui* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VR
Xiaohui Tan, Zhenxuan He, Can Liu, Mingming Fan, Tianren Luo, Zitao Liu, Mi Tian, Teng Han*, Feng Tian* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA PDF
CHI 2024
CharacterMeet: Supporting Creative Writers’ Entire Story Character Construction Processes Through Conversation with LLM-Powered Chatbot Avatars
Hua Xuan Qin, Shan Jin, Gao, Mingming Fan, Pan Hui Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA PDF
CHI 2024
Neural Canvas: Supporting Scenic Design Prototyping by Integrating 3D Sketching and Generative AI
Yulin Shen, Yifei Shen, Jiawen Cheng, chutian Jiang, Mingming Fan, Zeyu Wang* Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA PDF
CVPR 2024
SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splatting
Zhijing Shao, Zhaolong Wang, Zhuang Li, Duotun Wang, Xiangru Lin, Yu Zhang, Mingming Fan, Zeyu Wang The IEEE/CVF Conference on Computer Vision and Pattern Recognition PDF
CHI 2024 Extended Abstract
AromaBlendz: An Olfactory System for Crafting Personalized Scents
Shihan Fu, Jianhao Chen, Yi Cai, Mingming Fan* Extended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems (CHI EA '24) PDF | Video
MM 2023
Designing Loving-Kindness Meditation in Virtual Reality for Long-Distance Romantic Relationships
Xian Wang, Xiaoyu Mo, Lik-Hang Lee, Xiaoying Wei, Xiaofu Jin, Mingming Fan*, Pan Hui* Proceedings of the 31st ACM International Conference on Multimedia (MM ’23), October 29–November 3, 2023, Ottawa, ON, Canada. PDF
UIST 2023
ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow Projection
Chen Liang, Xutong Wang, Zisu Li, Chi Hsia, Mingming Fan, Chun Yu, Yuanchun Shi* In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST'23), Article No.: 27, Pages 1–14 PDF
UIST'23 Demo
A Multi-modal Toolkit to Support DIY Assistive Technology Creation for Blind and Low Vision People
Liwen He, Yifan Li, Mingming Fan, Liang He, Yuhang Zhao* UIST'23, Demo. PDF | Video
Chinese CHI 23
OperARtistry: An AR-based Interactive Application to Assist the Learning of Chinese Traditional Opera (Xiqu) Makeup
Zeyu Xiong#, Shihan Fu#, Mingming Fan* In Proceedings of Chinese CHI 2023 (CHCHI 2023), November 13–16, 2023, Denpasar, Bali, Indonesia. ACM, New York, NY, USA, 11 pages. PDF |
Best Paper Honorable Mention Award
IMWUT (UbiComp 2023)
Exploring The Opportunities of AR for Enriching Storytelling With Family Photos Among Grandparents and Grandchildren
Zisu Li, Li Feng, Chen Liang, Yuru Huang, Mingming Fan* Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) PDF
ASSETS 2023
Understanding Strategies and Challenges of Conducting Daily Data Analysis (DDA) Among Blind and Low Vision People
Chutian Jiang, Wentao Lei, Emily Kuang, Teng Han, Mingming Fan* The 25th International ACM SIGACCESS Conference on Computers and Accessibility PDF
ASSETS 2023
Understanding Curators' Practices and Challenges of Making Exhibitions More Accessible for Blind and Low Vision People
Yuru Huang#, Jingling Zhang#, Xiaofu Jin, Mingming Fan* The 25th International ACM SIGACCESS Conference on Computers and Accessibility PDF
VINCI 2023
OdorV-Art: An Initial Exploration of An Olfactory Intervention for Appreciating Style Information of Artworks in Virtual Museum
Shumeng Zhang, Ziyan Wang, You Zhou, Hao Cui, Shihan Fu, Zeyu Wang, Mingming Fan* The 16th International Symposium on Visual Information Communication and Interaction (VINCI’23) PDF
TVCG
uxSense: Supporting User Experience Analysis with Visualization and Computer Vision
Andrea Batch, Yipeng Ji, Mingming Fan, Jian Zhao, and Niklas Elmqvist IEEE Transactions on Visualization and Computer Graphics PDF
CHI 2023
CoPracTter: Toward Integrating Personalized Practice Scenarios, Timely Feedback and Social Support into An Online Support Tool for Coping with Stuttering in China
Li Feng, Zeyu Xiong, Xinyi Li, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Bridging the Generational Gap: Exploring How Virtual Reality Supports Remote Communication Between Grandparents and Grandchildren
Xiaoying Wei, Yizheng Gu, Emily Kuang, Xian Wang, Beiyan Cao, Xiaofu, Jin, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Enhancing Older Adults' Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen Devices
Emily Kuang, Ruihuan Chen, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)
Emily Kuang, Ehsan Jahangirzadeh Soure, Mingming Fan*, Jian Zhao, Kristen Shinohara* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Sparkling Silence:Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing Streamers
Beiyan Cao, Changyang He, Muzhi Zhou*, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
"I am the Follower, also the Boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired
Yan Zhang, Ziang Li, Haole Guo, Luyao Wang, Qihe Chen, Wenjie Jiang, Mingming Fan, Guyue Zhou, Jiangtao Gong ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device Sensing
Zisu Li, Chen Liang, Yue Qin, Yukang Yan, Mingming Fan, Yuntao Wang, Chun Yu, Yuanchun Shi ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF |
Best Paper Honorable Mention Award
IUI 2023
SmartRecorder: An IMU-based Video Tutorial Creation by Demonstration System for Smartphone Interaction Tasks
Xiaozhu Hu, Yanwen Huang, Bo Liu, Ruolan Wu, Yongquan Hu, Aaron Quigley, Mingming Fan, Chun Yu, Yuanchun Shi ACM IUI '22: 28th International Conference on Intelligent User Interfaces PDF
IwC
Older Adults’ Concurrent and Retrospective Think-Aloud Verbalizations for Identifying User Experience Problems of VR Games
Mingming Fan*, Vinita Tibdewal, Qiwen Zhao, Lizhou Cao, Chao Peng, Runxuan Shu, Yujia Shan Interacting with Computers Online PDF |
PDF
IMWUT (UbiComp 2022)
Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps
Xiaofu Jin, Xiaozhu Hu, Xiaoying Wei, Mingming Fan* UbiComp 2022 Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 6, Issue 3, September 2022, Article No.: 121, https://doi.org/10.1145/3550321 PDF |Video (Youtube)
CSCW 2022
Human-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization
Mingming Fan*, Xianyou Yang, Tsz Tung Yu, Vera Q. Liao, Jian Zhao CSCW 2022 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW1,
Article 96 (April 2022), 32 pages. https://doi.org/10.1145/3512943 PDF
CSCW 2022
Typist Experiment: an Investigation of Human-to-Human Dictation via Role-play to Inform Voice-based Text Authoring
Can Liu, Siying Hu, Li Feng, Mingming Fan CSCW 2022 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW2,
Article 199 (Nov. 2022) PDF
ASSETS 2022
"I Used To Carry A Wallet, Now I Just Need To Carry My Phone": Understanding Current Banking Practices and Challenges Among Older Adults in China
Xiaofu Jin, Mingming Fan* ASSETS' 2022 In ACM SIGACCESS Conference on Computers and Accessibility (ASSETS' 2022) PDF
IJHCI
PoeticAR: Reviving Traditional Poetry of the Heritage Site of Jichang Garden via Augmented Reality
Jin Tian, Yifan Cao, Lingyi Feng, Dongting Fu, Linping Yuan, Huaming Qu, Yang Wang, Mingming Fan* International Journal of Human-Computer Interaction (In Press) PDF
Chinese CHI 2022
Understanding Older Adults' Perceptions and Challenges in Using AI-enabled Everyday Technologies
Esha Shandilya, Mingming Fan* Chinese CHI 2022 The Tenth International Symposium of Chinese CHI, ACM. PDF
Chinese CHI 2022
Communication in Immersive Social Virtual Reality: A Systematic Review of 10 Years' Studies
Xiaoying Wei#, Xiaofu Jin#, Mingming Fan* Chinese CHI 2022 The Tenth International Symposium of Chinese CHI, ACM. PDF |
Best Paper Honorable Mention Award
Chinese CHI 2022
Reducing Stress and Anxiety in the Metaverse: A Systematic Review of Meditation, Mindfulness and Virtual Reality
Xian Wang#, Xiaoyu Wang#, Mingming Fan*, Lik-Hang Lee, Bertram E. Shi, Pan Hui* Chinese CHI 2022 The Tenth International Symposium of Chinese CHI, ACM. PDF
DIS 2022
"It Feels Like Being Locked In A Cage": Understanding Blind or Low Vision Streamers' Perceptions of Content Curation Algorithms
Zhiyi Rong, Mo Zhou, Zhicong Lu*, Mingming Fan* In ACM SIGCHI Conference on Designing Interactive Systems (DIS' 22) (acceptance rate: 21.5%) PDF
IJHCI
Understanding How Older Adults Comprehend COVID-19 Interactive Visualizations via Think-Aloud Protocol
Mingming Fan*, Yiwen Wang, Yuni Xie, Franklin Li, Chunyang Chen International Journal of Human-Computer Interaction PDF | Appendix
CHI 2022
"I Shake The Package To Check If It's Mine": A Study of Package Fetching Practices and Challenges of Blind and Low Vision People in China
Wentao Lei, Mingming Fan*, Juliann Thang In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
"I Don't Want People to Look At Me Differently": Designing User-Defined Above-the-Neck Gestures for People with Upper Body Motor Impairments
Xuan Zhao, Mingming Fan*, Teng Han In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
"Merging Results Is No Easy Task": An International Survey Study of Collaborative Data Analysis Practices Among UX Practitioners
Emily Kuang, Xiaofu Jin, Mingming Fan* In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
From WOW to WHY: Guidelines for Creating the Opening of a Data Video with Cinematic Styles
Xian Xu, Leni Yang, David Yip, Mingming Fan*, Zheng Wei, Huamin Qu In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
"I need to be professional until my new team uses emoji, GIFs, or memes first": New Collaborators’ Perspectives on Using Non-Textual Communication in Virtual Workspaces
Esha Shandilya, Mingming Fan, Garreth Tigwell In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CACM
Credit: Getty Images
Eyelid Gestures for People with Motor Impairments
Mingming Fan*, Zhen Li, Franklin Mingzhe Li Communications of the ACM, January 2022, Vol. 65 No. 1, Pages 108-115, 10.1145/3498367 HTML | PDF | Video (Youtube)| Code | Report
Chinese CHI 2021
Think-Aloud Verbalizations for Identifying User Experience Problems: Effects of Language Proficiency with Chinese Non-Native English Speakers
Mingming Fan, Lingyun (Julie) Zhu Chinese CHI 2021 The Ninth International Symposium of Chinese CHI (Chinese CHI 2021), ACM, 11 pages. PDF
TVCG (VIS 2021)
CoUX: Collaborative Visual Analysis of Think-Aloud Usability Test Videos for Digital Interfaces
Ehsan Jahangirzadeh#, Emily Kuang#, Mingming Fan, Jian Zhao (#:equal contribution) IEEE VIS 2021 IEEE Transactions on Visualization and Computer Graphics PDF | Video (Youtube) | Code
UbiComp 2021
Douleur: Creating Pain Sensation with Chemical Stimulant to Enhance User Experience in Virtual Reality
Chutian Jiang#, Yanjun Chen#, Mingming Fan, Liuping Wang, Luyao Shen, Nianlong Li, Wei Sun, Yu Zhang, Feng Tian, Teng Han(#:equal contribution) UbiComp 2021 Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 5, Issue 2, June 2021, Article No.: 66, pp 1–26. PDF
TSE
Accessibile or Not? An Empirical Investigation of Android App Accessibility
Sen Chen, Chunyang Chen, Lingling Fan, Mingming Fan, Xian Zhan, and Yang Liu IEEE Transactions on Software Engineering PDF | Website | Code
DIS 2021
"Too Old to Bank Digitally?": A Survey of Banking Practices and Challenges among Older Adults in China
Xiaofu Jin, Emily Kuang, Mingming Fan In ACM Conference on Designing Interactive Systems (DIS'21), Pages 802–814 PDF | Survey Questions
CHI 2021
Older Adults' Think-Aloud Verbalizations and Speech Features for Identifying User Experience Problems
Mingming Fan, Qiwen Zhao, Vinita Tibdewal In CHI Conference on Human Factors in Computing Systems (CHI'21) PDF | Video (Youtube)
CHI 2021
"I Choose Assistive Devices That Save My Face": A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China
Franklin Mingzhe Li, Di Laura Chen, Mingming Fan, Khai N. Truong In CHI Conference on Human Factors in Computing Systems (CHI'21) PDF
CHI 2021
vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors
Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, Mingming Fan In CHI Conference on Human Factors in Computing Systems (CHI'21) PDF | Video (Youtube)
TVCG (VIS 2021)
ChartSeer: Interactive Steering Exploratory Visual Analysis with Machine Intelligence
Jian Zhao, Mingming Fan, Mi Feng IEEE Transactions on Visualization and Computer Graphics, 2020 PDF | Video (Youtube)
ASSETS 2020 Best Artifact Award
Eyelid Gestures on Mobile Devices for People with Motor Impairments
Mingming Fan#, Zhen Li#, Franklin Mingzhe Li# (#:equal contribution) In 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020, Article No.: 15, pp 1–8 PDF | Video (Youtube)| Talk | Code | Application (Apk file)
| Best Artifact Award
CHI 2020
Mouillé: Exploring Wetness Illusion on Fingertips to Enhance Immersive Experience in VR
Teng Han, Sirui Wang, Sijia Wang, Xiangmin Fan, Jie Liu, Feng Tian, and Mingming Fan In CHI Conference on Human Factors in Computing Systems, 2020 PDF | Video (Youtube) | Talk
TiiS
Automatic Detection of Usability Problem Encounters in Think-Aloud Sessions
Mingming Fan, Yue Li, Khai N. Truong ACM Transactions on Interactive Intelligent Systems (TiiS), Article No. 16, May 2020 PDF
JUS
Practices and Challenges of Using Think-aloud Protocols in Industry: An International Survey
Mingming Fan, Serina Shi, Khai N. Truong Journal of Usability Studies, Vol. 15, Issue 2, February, 2020, pp. 85-102 PDF |Survey
Ph.D. Dissertation
Leveraging Subtle Verbalization and Speech Patterns to Help Evaluators Identify Usability Problem Encounters in Concurrent Think-aloud Sessions
Mingming Fan Ph.D. Dissertation(July 2019) Department of Computer Science, University of Toronto, Toronto, Canada PDF
TVCG (VIS 2019)
VisTA: Integrating Machine Intelligence with Visualization to Support the Investigation of Think-Aloud Sessions
Mingming Fan, Ke Wu, Jian Zhao, Yue Li, Winter Wei, and Khai N. Truong IEEE Transactions on Visualization and Computer Graphics, Vol. 26, Issue 1, January, 2020 PDF | Video (Youtube)
TOCHI (CHI 2020)
Concurrent Think-Aloud Verbalizations and Usability Problems
Mingming Fan, Jinglan Lin, Christina Chung, Khai N. Truong ACM Transactions on Computer-Human Interaction. 26 (5), Article 8, 35 pages, 2019. PDF
IMWUT (UbiComp 2019)
FMT: A Wearable Camera-Based Object Tracking Memory Aid for Older Adults
Franlin Mingzhe Li, Di Laura Chen, Mingming Fan, and Khai N. Truong In Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies PDF | New Scientist Report |ACM DL
CHI 2019
"I feel it is my responsibility to stream”: Streaming and Engaging with Intangible Cultural Heritage through Livestreaming
Zhicong Lu, Michelle Annett, Mingming Fan, Daniel Wigdor In 2019 CHI Conference on Human Factors in Computing Systems PDF |
Best Paper Award
CHI 2019
PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation
on Smartphones
Teng Han, Jie Liu, Khalad Hasan, Mingming Fan, Junhyeok Kim, Jiannan Li, Xiangmin Fan,
Feng Tian, Edward Lank, and Pourang Irani In 2019 CHI Conference on Human Factors in Computing Systems PDF | Video (Youtube)
Internet of Things
Projected Visible Light for 3D Finger Tracking and Device Augmentation on Everyday Objects
Shang Ma, Qiong Liu, Mingming Fan, Phillip Sheu Internet of Things. 2019. Volume 6. Elsevier PDF
TVCG (VIS 2018)
InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming
Zhicong Lu, Mingming Fan, Yun Wang, Jian Zhao, Michelle Annett, Daniel Wigdor IEEE Transactions on Visualization and Computer Graphics, Vol. 25, Issue 1, 2019 PDF | Video (Youtube)
TACCESS (ASSETS 2018)
Guidelines for Creating Senior-Friendly Product Instructions
Mingming Fan, Khai N. Truong ACM Transactions on Accessible Computing 11, 2, Article 9 (June 2018), 35 pages. PDF
ASSETS 2017
BrailleSketch: A Gesture-based Text Entry Method for
People with Visual Impairments
Franklin Li, Mingming Fan, Khai N. Truong In 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS
'17). PDF
ISWC 2017
An Empirical Study of Touch-based Authentication Methods on
Smartwatches
Yue Zhao, Zhongtian Qiu, Yiqing Yang, Weiwei Li, Mingming Fan In 2017 ACM International Symposium on Wearable Computers (ISWC '17). PDF
ISWC 2017
An Empirical Study of Foot Gestures for Hands-Occupied Mobile
Interaction
Mingming Fan, Yizheng Ding, Fang Shen, Yuhui You, Zhi Yu In 2017 ACM International Symposium on Wearable Computers (ISWC '17). PDF
Exploring the Use of Capacitive Sensing to
Externally Measure Liquid Level in Fluid Containers
Mingming Fan, Khai N. Truong, Abhishek Ranjan Knowledge Media Design Institute Technical Report, University of Toronto, 2016 PDF | Video (Youtube)
UbiComp 2015
SoQr: Sonically Quantifying the Content Level inside
Containers
Mingming Fan, Khai N. Truong In 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) PDF | Video (Youtube) |
Best Paper Honorable Mention Award
ISWC 2014
Public Restroom Detection on Mobile Phone via Active Probing
Mingming Fan, Alexander T. Adams, Khai N. Truong In 2014 ACM International Symposium on Wearable Computers (ISWC'14). PDF | Video (Youtube)
HotMobile 2014
HiFi: Hide and Find Digital Content Associated with Physical
Objects via Coded Light
Mingming Fan, Qiong Liu, Hao Tang, Patrick Chiu In 15th Workshop on Mobile Computing Systems and Applications (HotMobile '14). PDF
UbiComp 2012
Augmenting Gesture Recognition with Erlang-Cox Models to
Identify Neurological Disorders in Premature Babies
Mingming Fan, Dana Gravem, Dan Cooper, Donald J Patterson In 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), pp411-420. PDF | Video (Youtube)
Services
Technical Program Committee (Selected)
CHI 2025, subcommittee chair (Accessibility and Aging)
DIS 2025, program committee member
CHI 2024, subcommittee chair (Accessibility and Aging)
ASSETS 2023, program committee member
CSCW 2023, associate chair
CHI 2023, associate chair
CHI 2022, associate chair
ASSETS 2021, program committee member
CHI 2021, associate chair
ASSETS 2020, program committee member
Organizing Committee (Selected)
ASSETS 2022
Student Research Competition Chair
Reviewer (Selected)
CHI
received "special recognition" for outstanding reviews
ACM Transactions on Computer-Human Interaction (TOCHI)
ACM ASSETS
ACM Transactions on Accessible Computing (TACCESS)
ACM UbiComp / IMWUT
received "special recognition" for outstanding reviews
ACM UIST
received "special recognition" for outstanding reviews
IEEE VIS
ACM CSCW
ACM SIGGRAPH
Teaching
Spring 2025
UCUG 1505: Creative Coding and Interactive Art
HKUST(GZ)
Spring 2025
CMAA 5017: AR/VR/MR/XR: Concepts, Theory and Techniques
HKUST(GZ)
Fall 2024
CMAA 6018A: Independent Study
HKUST(GZ)
Fall 2024
CMAA 5018: Assistive Technology Design
HKUST(GZ)
Spring 2024
CMAA 5017: AR/VR/MR/XR: Concepts, Theory and Techniques
HKUST(GZ) & HKUST(CWB)
Spring 2024
CMAA 6018A: Independent Study
HKUST(GZ) & HKUST(CWB)
Fall 2023
CMAA 5018: Assistive Technology Design
HKUST(GZ) & HKUST(CWB)
Spring 2023
CMAA 5017: AR/VR/MR/XR: Concepts, Theory and Techniques
HKUST(GZ) & HKUST(CWB)
Fall 2022
CMAA 5018: Assistive Technology Design
HKUST(GZ) & HKUST(CWB)
Spring 2022
CMAA 5017: AR/VR/MR/XR: Concepts, Theory and Techniques
HKUST(GZ) & HKUST(CWB)
Spring 2021
HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices
RIT, NY, USA
Spring 2021
ISTE-799: Independent Study
RIT, NY, USA
Fall 2020
HCIN-720: Prototyping Wearable and Internet of Things Devices
RIT, NY, USA
Spring 2020
HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices
RIT, NY, USA
Spring 2020
ISTE-799: Independent Study
RIT, NY, USA
Fall 2019
HCIN-720: Prototyping Wearable and Internet of Things Devices
Office:
Room 610, Building E2, HKUST(GZ)
Guangzhou, China
Email: mingmingfan@ust.hk
Prospective Ph.D. Applicants:
If you have *strong* skills in designing and implementing functional interactive software and/or hardware systems on the following topics, send me an email with your research proposal and I will consider it seriously. For students who do not have strong research experience, please consider applying to our MPhil first. If you do get an MPhil offer, I'm happy to chat about opportunities to work in my group.
Human-AI Collaboration Principles: Create functional human-AI collaboration prototypes to explore foundamental challenges that humans face while working with AI, in particular in the context of learning/education, aging, health, and accessibility.
AI + Interactive Hardware: Create novel interactive embodied agents (e.g., in the form of physical robots or wearable/deskktop devices) to tackle learning/education, aging, health, and accessibility challenges.
AI + Immersive Media (VR/AR/MR): Create creative AI + immersive media to tackle learning/education, aging, health, and accessibility challenges.
Prospective MPhil Applicants: Our MPhil program is a fully funded and the admission is managed by independent committees in the university. If you want to work with me as an MPhil student, please apply and get an offer first. After you get an offer, I am happy to chat about possible opportunities to work with me. For applicants with strong academic record but limited research experience, I recommend them apply for our MPhil program first. Follow the instructions via this link and apply accordingly.
Accepted MPhil students have the opportunity to work with me in my group and will have better chances to be admitted into our PhD programs.
Visiting Research Students:
If you are a registered graduate or senior year Undergraduate student in another university and would like to study for a short period (e.g., 3 months) with my group in our university, I welcome you to apply our visiting student program: link. You may also send me an email with CV and transcripts. Make sure your home university and/or your academic supervisor allows you to visit for the period you apply for.
Best Paper Honorable Mention Award
