Mingming Fan's head profile Mingming Fan is an Assistant Professor in Computational Media and Arts (CMA) and Internet of Things (IOT) Thrusts at The Hong Kong University of Science and Technology (Guangzhou) (HKUST(GZ)), with joint and affiliate appointments in Division of Integrative Systems and Design and Department of Computer Science and Engineering at HKUST. He worked for two years as a tenure-tracked Assistant Professor in the Center for Accessibility and Inclusion Research (CAIR) at RIT right after earning his Ph.D. from the Department of Computer Science at the University of Toronto in 2019.

Dr. Fan founded and directs the Accessible & Pervasive User EXperience (APEX) Group to conduct research at the intersection of Human-Computer Interaction (HCI), AI and VR/AR/Visualization with three research directions: 1)Assistive Technology (AT): design novel ATs to empower older adults and people with disabilities, and 2)Human-AI Collaboration/Teaming: Design effective human-AI teaming tools and methods; 3)Multi-sensory VR/AR: design novel multi-sensory feedback. Dr. Fan has authored over 80 peer-review papers in the leading international conferences and journals of HCI, Accessibility, and Visualization/VR/AR and has won many paper awards, including Best Paper Honorable Mention Awards at CHI 2024, CHI 2023, and Chinese CHI 2023, Best Artifact Award at ASSETS 2020, Best Paper Award at CHI 2019, and Best Paper Honorable Mention Award at UbiComp 2015. He currently serves as a subcommittee chair of CHI 2024, on the paper award committee of CSCW 2023, and on program committees of CSCW 2023 and ASSETS 2023 respectively.

范明明,现任香港科技大学(广州)信息枢纽计算媒体与艺术学域与物联网学域助理教授、博士生导师、无障碍人机交互(APEX)课题组创始人。兼任香港科技大学综合系统与设计系和计算机科学与工程系联合和隶属助理教授。2019年于多伦多大学计算机科学系获博士学位。研究领域为智能人机交互,研究方向包括:1)智能无障碍辅具与“适老化”技术;2)人智协作;3)多模态虚拟现实与增强现实的交互技术。在人机交互及无障碍研究领域的国际重要学术期刊与会议上发表论文80余篇,包括50余篇中国计算机学会(CCF)推荐的A类(最高级别)期刊与会议论文。研究多次荣获国际论文奖,包括CHI 2024 最佳论文荣誉提名奖(3次)、CHI 2023最佳论文荣誉提名奖、Chinese CHI 2023最佳论文荣誉提名奖、ASSETS 2020最佳作品奖、CHI 2019最佳论文奖、UbiComp 2015最佳论文荣誉提名奖等。目前担任多个国内外重要学术职务,包括人机交互顶级学术会议CHI 2024子委员会主席(Accessibility and Aging),CSCW 2023论文奖评审委员会委员,CSCW 2023及ASSETS 2023程序委员会委员,中国计算机学会(CCF)人机交互专委会执委,中国残疾人康复协会康复工程与辅具技术专业委员会委员等。

Paper Awards

CHI 2024 Best Paper Honorable Mention Award
Investigating electrotactile feedback on fingertip edges and its applications to Blind and Low Vision (BLV) People
CHI 2024 Best Paper Honorable Mention Award
Designing an AI- and AR-powered app (FetchAid) to assist BLV People to use Parcel Lockers
CHI 2024 Best Paper Honorable Mention Award
Designing an interactive app (EyeVis) to help traditional Chinese opera (Xiqu) performers better remove eye-area make-ups
Chinese CHI 2023 Best Paper Honorable Mention Award
CHI 2023 Best Paper Honorable Mention Award
ASSETS 2020 Best Artifact Award
CHI 2019 Best Paper Award
UbiComp 2015 Best Paper Honorable Mention Award

Research

Note: *: Corresponding Author (annotated since 2022); #: equal contribution

DIS 2024

Exploring the Impact of Artificial Intelligence-Generated Content (AIGC) Tools on Social Dynamics in UX Collaboration

Ziyan Wang, Luyao Shen, Emily Kuang, Shumeng Zhang, Mingming Fan*
ACM Conference on Designing Interactive Systems (DIS) 2024
PDF

TVCG

VisTellAR: Embedding Data Visualization to Short-form Videos Using Mobile Augmented Reality

Wai Tong, Kento Shigyo, Lingping Yuan, Mingming Fan, Ting-Chuen Pong, Huamin Qu, Meng Xia
IEEE Transactions on Visualization and Computer Graphics (TVCG), Early Access
PDF

CHI 2024

Toward Making Virtual Reality (VR) More Inclusive for Older Adults: Investigating Aging Effects on Object Selection and Manipulation in VR

Zhiqing Wu, Duotun Wang#, Shumeng Zhang#, Yuru Huang, Zeyu Wang, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

Designing Unobtrusive Modulated Electrotactile Feedback on Fingertip Edge to Assist Blind and Low Vision (BLV) People in Comprehending Charts

Chutian Jiang#, Yinan Fan#, Junan Xie, Emily Kuang, Kaihao Zhang*, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF | Best Paper Honorable Mention Award

CHI 2024

To Reach the Unreachable: Exploring the Potential of VR Hand Redirection for Upper Limb Rehabilitation

Peixuan Xiong, Yukai Zhang, Nandi Zhang, Shihan Fu, Xin Li, Yadan Zheng, Jinni Zhou, Xiquan Hu*, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support

Zhitong (Klara) Guan#, Zeyu Xiong#, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF | Best Paper Honorable Mention Award

CHI 2024

LightSword: A Customized Virtual Reality Exergame for Long-Term Cognitive Inhibition Training in Older Adults

Qiuxin Du, Zhen Song*, Haiyan Jiang, Xiaoying Wei, Dongdong Weng, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

Jingze Tian#, Yingna Wang#, Keye Yu, Liyi Xu, Junan Xie, Franklin Mingzhe Li, Yafeng Niu, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

Enhancing UX Evaluation Through Collaboration with Conversational AI Assistants: Effects of Proactive Dialogue and Timing

Emily Kuang, Minghao Li, Mingming Fan*, Kristen Shinohara*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

Exploring the Opportunity of Augmented Reality (AR) in Supporting Older Adults Explore and Learn Smartphone Applications

Xiaofu Jin, Wai Tong, Xiaoying Wei, Xian Wang, Emily Kuang, Xiaoyu Mo, Huamin Qu, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

"It is hard to remove from my eye": Design Makeup Residue Visualization System for Chinese Traditional Opera (Xiqu) Performers

Zeyu Xiong, Shihan Fu, Yanying Zhu, Chenqing Zhu, Xiaojuan Ma, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF | Best Paper Honorable Mention Award

CHI 2024

Bridging the Literacy Gap for Adults: Streaming and Engaging in Adult Literacy Education through Livestreaming

Shihan Fu, Jianhao Chen, Emily Kuang, Mingming Fan*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

CoPrompt: Supporting Prompt Sharing and Referring in Collaborative Natural Language Programming

Li Feng, Ryan Yen, Yuzhe You, Mingming Fan, Jian Zhao, Zhicong Lu
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

“Can It Be Customized According to My Motor Abilities?”: Toward Designing User-Defined Head Gestures for People with Dystonia

Qin Sun, Yunqi Hu, Mingming Fan, Jingting Li, Su-Jing Wang*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

See Widely, Think Wisely: Toward Designing a Generative Multi-agent System to Burst Filter Bubbles

Yu Zhang #, Jingwei Sun#, Li Feng, Cen Yao, Mingming Fan, Liuxin Zhang, Qianying wang, Xin Geng*, Yong Rui*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

WieldingCanvas: Interactive Sketch Canvases for Freehand Drawing in VR

Xiaohui Tan, Zhenxuan He, Can Liu, Mingming Fan, Tianren Luo, Zitao Liu, Mi Tian, Teng Han*, Feng Tian*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11--16, 2024, Honolulu, HI, USA
PDF

CHI 2024

CharacterMeet: Supporting Creative Writers’ Entire Story Character Construction Processes Through Conversation with LLM-Powered Chatbot Avatars

Hua Xuan Qin, Shan Jin, Gao, Mingming Fan, Pan Hui
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA
PDF

CHI 2024

Neural Canvas: Supporting Scenic Design Prototyping by Integrating 3D Sketching and Generative AI

Yulin Shen, Yifei Shen, Jiawen Cheng, chutian Jiang, Mingming Fan, Zeyu Wang*
Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI '24), May 11-16, 2024, Honolulu, HI, USA
PDF

CVPR 2024

SplattingAvatar: Realistic Real-Time Human Avatars with Mesh-Embedded Gaussian Splatting

Zhijing Shao, Zhaolong Wang, Zhuang Li, Duotun Wang, Xiangru Lin, Yu Zhang, Mingming Fan, Zeyu Wang
The IEEE/CVF Conference on Computer Vision and Pattern Recognition
PDF

MM 2023

Designing Loving-Kindness Meditation in Virtual Reality for Long-Distance Romantic Relationships

Xian Wang, Xiaoyu Mo, Lik-Hang Lee, Xiaoying Wei, Xiaofu Jin, Mingming Fan*, Pan Hui*
Proceedings of the 31st ACM International Conference on Multimedia (MM ’23), October 29–November 3, 2023, Ottawa, ON, Canada.
PDF

UIST 2023

ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow Projection

Chen Liang, Xutong Wang, Zisu Li, Chi Hsia, Mingming Fan, Chun Yu, Yuanchun Shi*
In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST'23), Article No.: 27, Pages 1–14
PDF

Chinese CHI 23

OperARtistry: An AR-based Interactive Application to Assist the Learning of Chinese Traditional Opera (Xiqu) Makeup

Zeyu Xiong#, Shihan Fu#, Mingming Fan*
In Proceedings of Chinese CHI 2023 (CHCHI 2023), November 13–16, 2023, Denpasar, Bali, Indonesia. ACM, New York, NY, USA, 11 pages.
PDF | Best Paper Honorable Mention Award

IMWUT (UbiComp 2023)

Exploring The Opportunities of AR for Enriching Storytelling With Family Photos Among Grandparents and Grandchildren

Zisu Li, Li Feng, Chen Liang, Yuru Huang, Mingming Fan*
Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)
PDF

ASSETS 2023

Understanding Strategies and Challenges of Conducting Daily Data Analysis (DDA) Among Blind and Low Vision People

Chutian Jiang, Wentao Lei, Emily Kuang, Teng Han, Mingming Fan*
The 25th International ACM SIGACCESS Conference on Computers and Accessibility
PDF

ASSETS 2023

Understanding Curators' Practices and Challenges of Making Exhibitions More Accessible for Blind and Low Vision People

Yuru Huang#, Jingling Zhang#, Xiaofu Jin, Mingming Fan*
The 25th International ACM SIGACCESS Conference on Computers and Accessibility
PDF

VINCI 2023

OdorV-Art: An Initial Exploration of An Olfactory Intervention for Appreciating Style Information of Artworks in Virtual Museum

Shumeng Zhang, Ziyan Wang, You Zhou, Hao Cui, Shihan Fu, Zeyu Wang, Mingming Fan*
The 16th International Symposium on Visual Information Communication and Interaction (VINCI’23)
PDF

TVCG

uxSense: Supporting User Experience Analysis with Visualization and Computer Vision

Andrea Batch, Yipeng Ji, Mingming Fan, Jian Zhao, and Niklas Elmqvist
IEEE Transactions on Visualization and Computer Graphics
PDF

CHI 2023

CoPracTter: Toward Integrating Personalized Practice Scenarios, Timely Feedback and Social Support into An Online Support Tool for Coping with Stuttering in China

Li Feng, Zeyu Xiong, Xinyi Li, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Bridging the Generational Gap: Exploring How Virtual Reality Supports Remote Communication Between Grandparents and Grandchildren

Xiaoying Wei, Yizheng Gu, Emily Kuang, Xian Wang, Beiyan Cao, Xiaofu, Jin, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Enhancing Older Adults' Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen Devices

Emily Kuang, Ruihuan Chen, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)

Emily Kuang, Ehsan Jahangirzadeh Soure, Mingming Fan*, Jian Zhao, Kristen Shinohara*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Sparkling Silence:Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing Streamers

Beiyan Cao, Changyang He, Muzhi Zhou*, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

"I am the Follower, also the Boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired

Yan Zhang, Ziang Li, Haole Guo, Luyao Wang, Qihe Chen, Wenjie Jiang, Mingming Fan, Guyue Zhou, Jiangtao Gong
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device Sensing

Zisu Li, Chen Liang, Yue Qin, Yukang Yan, Mingming Fan, Yuntao Wang, Chun Yu, Yuanchun Shi
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF | Best Paper Honorable Mention Award

IUI 2023

SmartRecorder: An IMU-based Video Tutorial Creation by Demonstration System for Smartphone Interaction Tasks

Xiaozhu Hu, Yanwen Huang, Bo Liu, Ruolan Wu, Yongquan Hu, Aaron Quigley, Mingming Fan, Chun Yu, Yuanchun Shi
ACM IUI '22: 28th International Conference on Intelligent User Interfaces
PDF

IwC

Older Adults’ Concurrent and Retrospective Think-Aloud Verbalizations for Identifying User Experience Problems of VR Games

Mingming Fan*, Vinita Tibdewal, Qiwen Zhao, Lizhou Cao, Chao Peng, Runxuan Shu, Yujia Shan
Interacting with Computers
Online PDF | PDF

IMWUT (UbiComp 2022)

Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps

Xiaofu Jin, Xiaozhu Hu, Xiaoying Wei, Mingming Fan*
UbiComp 2022
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 6, Issue 3, September 2022, Article No.: 121, https://doi.org/10.1145/3550321
PDF | Video (Youtube)

CSCW 2022

Human-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization

Mingming Fan*, Xianyou Yang, Tsz Tung Yu, Vera Q. Liao, Jian Zhao
CSCW 2022
Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW1, Article 96 (April 2022), 32 pages. https://doi.org/10.1145/3512943
PDF

CSCW 2022

Typist Experiment: an Investigation of Human-to-Human Dictation via Role-play to Inform Voice-based Text Authoring

Can Liu, Siying Hu, Li Feng, Mingming Fan
CSCW 2022
Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW2, Article 199 (Nov. 2022)

ASSETS 2022

"I Used To Carry A Wallet, Now I Just Need To Carry My Phone": Understanding Current Banking Practices and Challenges Among Older Adults in China

Xiaofu Jin, Mingming Fan*
ASSETS' 2022
In ACM SIGACCESS Conference on Computers and Accessibility (ASSETS' 2022)
PDF

IJHCI

PoeticAR: Reviving Traditional Poetry of the Heritage Site of Jichang Garden via Augmented Reality

Jin Tian, Yifan Cao, Lingyi Feng, Dongting Fu, Linping Yuan, Huaming Qu, Yang Wang, Mingming Fan*
International Journal of Human-Computer Interaction (In Press)
PDF

Chinese CHI 2022

Understanding Older Adults' Perceptions and Challenges in Using AI-enabled Everyday Technologies

Esha Shandilya, Mingming Fan*
Chinese CHI 2022
The Tenth International Symposium of Chinese CHI, ACM.
PDF

Chinese CHI 2022

Communication in Immersive Social Virtual Reality: A Systematic Review of 10 Years' Studies

Xiaoying Wei#, Xiaofu Jin#, Mingming Fan*
Chinese CHI 2022
The Tenth International Symposium of Chinese CHI, ACM.
PDF

Chinese CHI 2022

Reducing Stress and Anxiety in the Metaverse: A Systematic Review of Meditation, Mindfulness and Virtual Reality

Xian Wang#, Xiaoyu Wang#, Mingming Fan*, Lik-Hang Lee, Bertram E. Shi, Pan Hui*
Chinese CHI 2022
The Tenth International Symposium of Chinese CHI, ACM.
PDF

DIS 2022

"It Feels Like Being Locked In A Cage": Understanding Blind or Low Vision Streamers' Perceptions of Content Curation Algorithms

Zhiyi Rong, Mo Zhou, Zhicong Lu*, Mingming Fan*
In ACM SIGCHI Conference on Designing Interactive Systems (DIS' 22) (acceptance rate: 21.5%)
PDF

IJHCI

Understanding How Older Adults Comprehend COVID-19 Interactive Visualizations via Think-Aloud Protocol

Mingming Fan*, Yiwen Wang, Yuni Xie, Franklin Li, Chunyang Chen
International Journal of Human-Computer Interaction
PDF | Appendix

CHI 2022

"I Shake The Package To Check If It's Mine": A Study of Package Fetching Practices and Challenges of Blind and Low Vision People in China

Wentao Lei, Mingming Fan*, Juliann Thang
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

"I Don't Want People to Look At Me Differently": Designing User-Defined Above-the-Neck Gestures for People with Upper Body Motor Impairments

Xuan Zhao, Mingming Fan*, Teng Han
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

"Merging Results Is No Easy Task": An International Survey Study of Collaborative Data Analysis Practices Among UX Practitioners

Emily Kuang, Xiaofu Jin, Mingming Fan*
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

From WOW to WHY: Guidelines for Creating the Opening of a Data Video with Cinematic Styles

Xian Xu, Leni Yang, David Yip, Mingming Fan*, Zheng Wei, Huamin Qu
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

"I need to be professional until my new team uses emoji, GIFs, or memes first": New Collaborators’ Perspectives on Using Non-Textual Communication in Virtual Workspaces

Esha Shandilya, Mingming Fan, Garreth Tigwell
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CACM

Credit: Getty Images

Eyelid Gestures for People with Motor Impairments

Mingming Fan*, Zhen Li, Franklin Mingzhe Li
Communications of the ACM, January 2022, Vol. 65 No. 1, Pages 108-115, 10.1145/3498367
HTML | PDF | Video (Youtube) | Code | Report

Chinese CHI 2021

Think-Aloud Verbalizations for Identifying User Experience Problems: Effects of Language Proficiency with Chinese Non-Native English Speakers

Mingming Fan, Lingyun (Julie) Zhu
Chinese CHI 2021
The Ninth International Symposium of Chinese CHI (Chinese CHI 2021), ACM, 11 pages.
PDF

TVCG (VIS 2021)

CoUX: Collaborative Visual Analysis of Think-Aloud Usability Test Videos for Digital Interfaces

Ehsan Jahangirzadeh#, Emily Kuang#, Mingming Fan, Jian Zhao (#:equal contribution)
IEEE VIS 2021
IEEE Transactions on Visualization and Computer Graphics
PDF | Video (Youtube) | Code

UbiComp 2021

Douleur: Creating Pain Sensation with Chemical Stimulant to Enhance User Experience in Virtual Reality

Chutian Jiang#, Yanjun Chen#, Mingming Fan, Liuping Wang, Luyao Shen, Nianlong Li, Wei Sun, Yu Zhang, Feng Tian, Teng Han(#:equal contribution)
UbiComp 2021
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 5, Issue 2, June 2021, Article No.: 66, pp 1–26.
PDF

TSE

Accessibile or Not? An Empirical Investigation of Android App Accessibility

Sen Chen, Chunyang Chen, Lingling Fan, Mingming Fan, Xian Zhan, and Yang Liu
IEEE Transactions on Software Engineering
PDF | Website | Code

DIS 2021

"Too Old to Bank Digitally?": A Survey of Banking Practices and Challenges among Older Adults in China

Xiaofu Jin, Emily Kuang, Mingming Fan
In ACM Conference on Designing Interactive Systems (DIS'21), Pages 802–814
PDF | Survey Questions

CHI 2021

Older Adults' Think-Aloud Verbalizations and Speech Features for Identifying User Experience Problems

Mingming Fan, Qiwen Zhao, Vinita Tibdewal
In CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Video (Youtube)

CHI 2021

"I Choose Assistive Devices That Save My Face": A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China

Franklin Mingzhe Li, Di Laura Chen, Mingming Fan, Khai N. Truong
In CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF

CHI 2021

vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors

Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, Mingming Fan
In CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Video (Youtube)

TVCG (VIS 2021)

ChartSeer: Interactive Steering Exploratory Visual Analysis with Machine Intelligence

Jian Zhao, Mingming Fan, Mi Feng
IEEE Transactions on Visualization and Computer Graphics, 2020
PDF | Video (Youtube)

ASSETS 2020

Eyelid Gestures on Mobile Devices for People with Motor Impairments

Mingming Fan#, Zhen Li#, Franklin Mingzhe Li# (#:equal contribution)
In 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020, Article No.: 15, pp 1–8
PDF | Video (Youtube) | Talk | Code | Application (Apk file) | Best Artifact Award

CHI 2020

Mouillé: Exploring Wetness Illusion on Fingertips to Enhance Immersive Experience in VR

Teng Han, Sirui Wang, Sijia Wang, Xiangmin Fan, Jie Liu, Feng Tian, and Mingming Fan
In CHI Conference on Human Factors in Computing Systems, 2020
PDF | Video (Youtube) | Talk

TiiS

Automatic Detection of Usability Problem Encounters in Think-Aloud Sessions

Mingming Fan, Yue Li, Khai N. Truong
ACM Transactions on Interactive Intelligent Systems (TiiS), Article No. 16, May 2020
PDF

JUS

Practices and Challenges of Using Think-aloud Protocols in Industry: An International Survey

Mingming Fan, Serina Shi, Khai N. Truong
Journal of Usability Studies, Vol. 15, Issue 2, February, 2020, pp. 85-102
PDF | Survey

Ph.D. Dissertation

Leveraging Subtle Verbalization and Speech Patterns to Help Evaluators Identify Usability Problem Encounters in Concurrent Think-aloud Sessions

Mingming Fan
Ph.D. Dissertation (July 2019)
Department of Computer Science, University of Toronto, Toronto, Canada
PDF

TVCG (VIS 2019)

VisTA: Integrating Machine Intelligence with Visualization to Support the Investigation of Think-Aloud Sessions

Mingming Fan, Ke Wu, Jian Zhao, Yue Li, Winter Wei, and Khai N. Truong
IEEE Transactions on Visualization and Computer Graphics, Vol. 26, Issue 1, January, 2020
PDF | Video (Youtube)

TOCHI (CHI 2020)

a usability evaluator uses our tool to identify usability problems

Concurrent Think-Aloud Verbalizations and Usability Problems

Mingming Fan, Jinglan Lin, Christina Chung, Khai N. Truong
ACM Transactions on Computer-Human Interaction. 26 (5), Article 8, 35 pages, 2019.
PDF

IMWUT (UbiComp 2019)

FMT: A Wearable Camera-Based Object Tracking Memory Aid for Older Adults

Franlin Mingzhe Li, Di Laura Chen, Mingming Fan, and Khai N. Truong
In Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
PDF | New Scientist Report | ACM DL

CHI 2019

the example images of living streaming for intagible cultural heritage

"I feel it is my responsibility to stream”: Streaming and Engaging with Intangible Cultural Heritage through Livestreaming

Zhicong Lu, Michelle Annett, Mingming Fan, Daniel Wigdor
In 2019 CHI Conference on Human Factors in Computing Systems
PDF | Best Paper Award

CHI 2019

PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation on Smartphones

Teng Han, Jie Liu, Khalad Hasan, Mingming Fan, Junhyeok Kim, Jiannan Li, Xiangmin Fan, Feng Tian, Edward Lank, and Pourang Irani
In 2019 CHI Conference on Human Factors in Computing Systems
PDF | Video (Youtube)

Internet of Things

project profile image. An older adult is writing on the edge of one printed product instructions

Projected Visible Light for 3D Finger Tracking and Device Augmentation on Everyday Objects

Shang Ma, Qiong Liu, Mingming Fan, Phillip Sheu
Internet of Things. 2019. Volume 6. Elsevier
PDF

TVCG (VIS 2018)

InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming

Zhicong Lu, Mingming Fan, Yun Wang, Jian Zhao, Michelle Annett, Daniel Wigdor
IEEE Transactions on Visualization and Computer Graphics, Vol. 25, Issue 1, 2019
PDF | Video (Youtube)

TACCESS (ASSETS 2018)

project profile image. An older adult is writing on the edge of one printed product instructions

Guidelines for Creating Senior-Friendly Product Instructions

Mingming Fan, Khai N. Truong
ACM Transactions on Accessible Computing 11, 2, Article 9 (June 2018), 35 pages.
PDF

ASSETS 2017

BrailleSketch: A Gesture-based Text Entry Method for People with Visual Impairments

Franklin Li, Mingming Fan, Khai N. Truong
In 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17).
PDF

ISWC 2017

An Empirical Study of Touch-based Authentication Methods on Smartwatches

Yue Zhao, Zhongtian Qiu, Yiqing Yang, Weiwei Li, Mingming Fan
In 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

ISWC 2017

An Empirical Study of Foot Gestures for Hands-Occupied Mobile Interaction

Mingming Fan, Yizheng Ding, Fang Shen, Yuhui You, Zhi Yu
In 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

Exploring the Use of Capacitive Sensing to Externally Measure Liquid Level in Fluid Containers

Mingming Fan, Khai N. Truong, Abhishek Ranjan
Knowledge Media Design Institute Technical Report, University of Toronto, 2016
PDF | Video (Youtube)

UbiComp 2015

SoQr: Sonically Quantifying the Content Level inside Containers

Mingming Fan, Khai N. Truong
In 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)
PDF | Video (Youtube) | Best Paper Honorable Mention Award

ISWC 2014

Public Restroom Detection on Mobile Phone via Active Probing

Mingming Fan, Alexander T. Adams, Khai N. Truong
In 2014 ACM International Symposium on Wearable Computers (ISWC'14).
PDF | Video (Youtube)

HotMobile 2014

HiFi: Hide and Find Digital Content Associated with Physical Objects via Coded Light

Mingming Fan, Qiong Liu, Hao Tang, Patrick Chiu
In 15th Workshop on Mobile Computing Systems and Applications (HotMobile '14).
PDF

UbiComp 2012

Augmenting Gesture Recognition with Erlang-Cox Models to Identify Neurological Disorders in Premature Babies

Mingming Fan, Dana Gravem, Dan Cooper, Donald J Patterson
In 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), pp411-420.
PDF | Video (Youtube)


Services

Technical Program Committee (Selected)

CHI 2024, subcommittee chair (Accessibility and Aging)
ASSETS 2023, program committee member
CSCW 2023, associate chair (program committee member)
CHI 2023, associate chair
CHI 2022, associate chair
ASSETS 2021, program committee member
CHI 2021, associate chair
ASSETS 2020, program committee member

Organizing Committee

ASSETS 2022 Student Research Competition Chair

Reviewer (Selected)

CHI received "special recognition" for outstanding reviews
ACM Transactions on Computer-Human Interaction (TOCHI)
ACM ASSETS
ACM Transactions on Accessible Computing (TACCESS)
ACM UbiComp / IMWUT received "special recognition" for outstanding reviews
ACM UIST received "special recognition" for outstanding reviews
IEEE VIS
ACM CSCW
ACM SIGGRAPH

Teaching

Spring 2024 CMAA 5017: AR/VR/MR/XR: Concepts, Theory and Techniques HKUST (Guangzhou and Clear Water Bay)
Spring 2024 CMAA 6018A: Independent Study HKUST (Guangzhou and Clear Water Bay)
Fall 2023 CMAA 5018: Assistive Technology Design HKUST (Guangzhou and Clear Water Bay)
Spring 2023 CMAA 5017: AR/VR/MR/XR: Concepts, Theory and Techniques HKUST (Guangzhou and Clear Water Bay)
Fall 2022 CMAA 5018: Assistive Technology Design HKUST (Guangzhou and Clear Water Bay)
Spring 2022 CMAA 5017: AR/VR/MR/XR: Concepts, Theory and Techniques HKUST (Guangzhou and Clear Water Bay)
Spring 2021 HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices RIT
Spring 2021 ISTE-799: Independent Study RIT
Fall 2020 HCIN-720: Prototyping Wearable and Internet of Things Devices RIT
Spring 2020 HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices RIT
Spring 2020 ISTE-799: Independent Study RIT
Fall 2019 HCIN-720: Prototyping Wearable and Internet of Things Devices RIT

   @mingming_fan

Office:
Room 610, Building E2, HKUST(GZ)
Guangzhou, China
Email: mingmingfan@ust.hk

Prospective Ph.D. and RA Applicants: I always look for Ph.D. (both 2024-2025 and 2025-2026 academic years) and RA applicants with strong technical and/or design skills on the following topics:

  • Human-AI Teaming/Collaboration: Design more effective and user-friendly interface technologies between human and AI agents (e.g., powered by foundation models like LLMs).
  • Interactive Embodied Agents (VR/AR + Foundation models + robots): Design interactive embodied agents to tackle aging, health, and accessibility challenges.
  • Computational Interaction: Design computatinonal approaches to understanding users' behaviors and inferring their intents as well as optimizing user interfaces (e.g., adaptive user interfaces)
  • For the 2024-2025 academic year (starting in this September), plese apply through this link and send me an email with the subject "PhD or RA + Name" and attach your CV, transcripts, and English test scores.

    For the 2025-2026 academic year (starting 2025 September), I strongly encourage you to send me the same set of materials as above and also apply for our PhD summer camp through this link. PhD Summer camp will happen in July 2024, and outstanding applicants may secure an offer as early as this September.

    Visiting Research Students:: I am also open to host visiting research students. For Visiting Research Study program offered by HKUST(Guangzhou), please learn about the program through this link and send me an email with CV, publications, and transcripts. Make sure your home university and/or your academic supervisor allows you to visit.

    Prospective MPhil Applicants: For candidates with strong acadeimc background but without strong research experience, I recommend them apply for our MPhil program first. Our MPhil program is a fully funded research master's program and is currently accepting applicants for the 2024/2025 academic year. Follow the instructions via this link and apply accordingly.

    Accepted MPhil students have the opportunity to work in our research group and will have better chances to be admitted into our PhD programs.