Dr. Fan founded and directs the Accessible & Pervasive User EXperience (APEX) Group to conduct research at the intersection of Human-Computer Interaction (HCI), AI and Accessibility and Aging. APEX group focuses on designing Smart Assistive Technology for older adults and people with disabilities and Computational Methods to Model and Evaluate User Experience (UX). Dr. Fan has authored over 60 peer-review papers in leading HCI and accessibility venues, such as CHI, TOCHI, IMWUT/UbiComp, TVCG, VIS, CSCW, UIST, ASSETS, and TACCESS, and has won numerous paper awards, including Best Paper Honorable Mention Awards at CHI 2023 and UbiComp 2015, Best Paper Award at CHI 2019, and Best Artifact Award at ASSETS 2020. He currently serves as a subcommittee chair at CHI 2024, on the paper award commmitee at CSCW 2023, and on program committees at CSCW 2023 and ASSETS 2023 respectively.
范明明，现任香港科技大学（广州）信息枢纽计算媒体与艺术学域与物联网学域助理教授、博士生导师、无障碍与人机交互课题组（APEX）创始人。同时，兼任香港科技大学综合系统与设计系、计算机科学与工程系教职。2019年于多伦多大学计算机科学系获哲学博士学位。研究方向为智能人机交互、人智协同、无障碍与适老化技术、计算用户体验分析建模方法。在人机交互及无障碍研究领域国际重要学术期刊与会议上发表论文60余篇，包括35余篇中国计算机学会推荐A类（CCF-A）论文，并多次荣获国际论文奖励，如ACM CHI 2023最佳论文荣誉提名奖、ACM CHI 2019最佳论文奖、ACM UbiComp 2015最佳论文荣誉提名奖、ACM ASSETS 2020最佳作品奖等。目前担任多个国内外重要学术职务，包括人机交互顶级学术会议CHI 2024“Accessibility and Aging” 子委员会主席，CSCW 2023 论文奖项评审委员会委员，CSCW 2023及ASSETS 2023程序委员会委员，中国计算机学会(CCF)人机交互专委会执委，中国残疾人康复协会康复工程与辅具技术专业委员会委员等。APEX课题组：https://www.mingmingfan.com/lab/。
Research
Note: *: Corresponding Author (annotated since 2022); #: equal contribution
IMWUT (UbiComp 2023)
Exploring The Opportunities of AR for Enriching Storytelling With Family Photos Among Grandparents and Grandchildren
Zisu Li, Li Feng, Chen Liang, Yuru Huang, Mingming Fan* Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) (Accepted, In press) PDF
ASSETS 2023
Understanding Strategies and Challenges of Conducting Daily Data Analysis (DDA) Among Blind and Low Vision People
Chutian Jiang, Wentao Lei, Emily Kuang, Teng Han, Mingming Fan* The 25th International ACM SIGACCESS Conference on Computers and Accessibility (Accepted, In press) PDF
ASSETS 2023
Understanding Curators' Practices and Challenges of Making Exhibitions More Accessible for Blind and Low Vision People
Yuru Huang#, Jingling Zhang#, Xiaofu Jin, Mingming Fan* The 25th International ACM SIGACCESS Conference on Computers and Accessibility (Accepted, In press) PDF
VINCI 2023
OdorV-Art: An Initial Exploration of An Olfactory Intervention for Appreciating Style Information of Artworks in Virtual Museum
Shumeng Zhang, Ziyan Wang, You Zhou, Hao Cui, Shihan Fu, Zeyu Wang, Mingming Fan* The 16th International Symposium on Visual Information Communication and Interaction (VINCI’23) (Accepted, In press) PDF
TVCG
uxSense: Supporting User Experience Analysis with Visualization and Computer Vision
Andrea Batch, Yipeng Ji, Mingming Fan, Jian Zhao, and Niklas Elmqvist IEEE Transactions on Visualization and Computer Graphics PDF
CHI 2023
CoPracTter: Toward Integrating Personalized Practice Scenarios, Timely Feedback and Social Support into An Online Support Tool for Coping with Stuttering in China
Li Feng, Zeyu Xiong, Xinyi Li, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Bridging the Generational Gap: Exploring How Virtual Reality Supports Remote Communication Between Grandparents and Grandchildren
Xiaoying Wei, Yizheng Gu, Emily Kuang, Xian Wang, Beiyan Cao, Xiaofu, Jin, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Enhancing Older Adults' Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen Devices
Emily Kuang, Ruihuan Chen, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)
Emily Kuang, Ehsan Jahangirzadeh Soure, Mingming Fan*, Jian Zhao, Kristen Shinohara* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Sparkling Silence:Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing Streamers
Beiyan Cao, Changyang He, Muzhi Zhou*, Mingming Fan* ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
"I am the Follower, also the Boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired
Yan Zhang, Ziang Li, Haole Guo, Luyao Wang, Qihe Chen, Wenjie Jiang, Mingming Fan, Guyue Zhou, Jiangtao Gong ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
CHI 2023
Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device Sensing
Zisu Li, Chen Liang, Yue Qin, Yukang Yan, Mingming Fan, Yuntao Wang, Chun Yu, Yuanchun Shi ACM CHI Conference on Human Factors in Computing Systems (CHI'23) PDF
IUI 2023
SmartRecorder: An IMU-based Video Tutorial Creation by Demonstration System for Smartphone Interaction Tasks
Xiaozhu Hu, Yanwen Huang, Bo Liu, Ruolan Wu, Yongquan Hu, Aaron Quigley, Mingming Fan, Chun Yu, Yuanchun Shi ACM IUI '22: 28th International Conference on Intelligent User Interfaces PDF
IwC
Older Adults’ Concurrent and Retrospective Think-Aloud Verbalizations for Identifying User Experience Problems of VR Games
Mingming Fan*, Vinita Tibdewal, Qiwen Zhao, Lizhou Cao, Chao Peng, Runxuan Shu, Yujia Shan Interacting with Computers Online PDF |
PDF
IMWUT (UbiComp 2022)
Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps
Xiaofu Jin, Xiaozhu Hu, Xiaoying Wei, Mingming Fan* UbiComp 2022 Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 6, Issue 3, September 2022, Article No.: 121, https://doi.org/10.1145/3550321 PDF |Video (Youtube)
CSCW 2022
Human-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization
Mingming Fan*, Xianyou Yang, Tsz Tung Yu, Vera Q. Liao, Jian Zhao CSCW 2022 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW1,
Article 96 (April 2022), 32 pages. https://doi.org/10.1145/3512943 PDF
CSCW 2022
Typist Experiment: an Investigation of Human-to-Human Dictation via Role-play to Inform Voice-based Text Authoring
Can Liu, Siying Hu, Li Feng, Mingming Fan CSCW 2022 Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW2,
Article 199 (Nov. 2022)
ASSETS 2022
"I Used To Carry A Wallet, Now I Just Need To Carry My Phone": Understanding Current Banking Practices and Challenges Among Older Adults in China
Xiaofu Jin, Mingming Fan* ASSETS' 2022 In ACM SIGACCESS Conference on Computers and Accessibility (ASSETS' 2022) PDF
IJHCI
PoeticAR: Reviving Traditional Poetry of the Heritage Site of Jichang Garden via Augmented Reality
Jin Tian, Yifan Cao, Lingyi Feng, Dongting Fu, Linping Yuan, Huaming Qu, Yang Wang, Mingming Fan* International Journal of Human-Computer Interaction (In Press) PDF
Chinese CHI 2022
Understanding Older Adults' Perceptions and Challenges in Using AI-enabled Everyday Technologies
Esha Shandilya, Mingming Fan* Chinese CHI 2022 The Tenth International Symposium of Chinese CHI, ACM. PDF
Chinese CHI 2022
Communication in Immersive Social Virtual Reality: A Systematic Review of 10 Years' Studies
Xiaoying Wei#, Xiaofu Jin#, Mingming Fan* Chinese CHI 2022 The Tenth International Symposium of Chinese CHI, ACM. PDF
Chinese CHI 2022
Reducing Stress and Anxiety in the Metaverse: A Systematic Review of Meditation, Mindfulness and Virtual Reality
Xian Wang#, Xiaoyu Wang#, Mingming Fan*, Lik-Hang Lee, Bertram E. Shi, Pan Hui* Chinese CHI 2022 The Tenth International Symposium of Chinese CHI, ACM. PDF
DIS 2022
"It Feels Like Being Locked In A Cage": Understanding Blind or Low Vision Streamers' Perceptions of Content Curation Algorithms
Zhiyi Rong, Mo Zhou, Zhicong Lu*, Mingming Fan* In ACM SIGCHI Conference on Designing Interactive Systems (DIS' 22) (acceptance rate: 21.5%) PDF
IJHCI
Understanding How Older Adults Comprehend COVID-19 Interactive Visualizations via Think-Aloud Protocol
Mingming Fan*, Yiwen Wang, Yuni Xie, Franklin Li, Chunyang Chen International Journal of Human-Computer Interaction PDF | Appendix
CHI 2022
"I Shake The Package To Check If It's Mine": A Study of Package Fetching Practices and Challenges of Blind and Low Vision People in China
Wentao Lei, Mingming Fan*, Juliann Thang In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
"I Don't Want People to Look At Me Differently": Designing User-Defined Above-the-Neck Gestures for People with Upper Body Motor Impairments
Xuan Zhao, Mingming Fan*, Teng Han In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
"Merging Results Is No Easy Task": An International Survey Study of Collaborative Data Analysis Practices Among UX Practitioners
Emily Kuang, Xiaofu Jin, Mingming Fan* In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
From WOW to WHY: Guidelines for Creating the Opening of a Data Video with Cinematic Styles
Xian Xu, Leni Yang, David Yip, Mingming Fan*, Zheng Wei, Huamin Qu In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CHI 2022
"I need to be professional until my new team uses emoji, GIFs, or memes first": New Collaborators’ Perspectives on Using Non-Textual Communication in Virtual Workspaces
Esha Shandilya, Mingming Fan, Garreth Tigwell In CHI Conference on Human Factors in Computing Systems (CHI'22) PDF
CACM
Credit: Getty Images
Eyelid Gestures for People with Motor Impairments
Mingming Fan*, Zhen Li, Franklin Mingzhe Li Communications of the ACM, January 2022, Vol. 65 No. 1, Pages 108-115, 10.1145/3498367 HTML | PDF | Video (Youtube)| Code | Report
Chinese CHI 2021
Think-Aloud Verbalizations for Identifying User Experience Problems: Effects of Language Proficiency with Chinese Non-Native English Speakers
Mingming Fan, Lingyun (Julie) Zhu Chinese CHI 2021 The Ninth International Symposium of Chinese CHI (Chinese CHI 2021), ACM, 11 pages. PDF
TVCG (VIS 2021)
CoUX: Collaborative Visual Analysis of Think-Aloud Usability Test Videos for Digital Interfaces
Ehsan Jahangirzadeh#, Emily Kuang#, Mingming Fan, Jian Zhao (#:equal contribution) IEEE VIS 2021 IEEE Transactions on Visualization and Computer Graphics PDF | Video (Youtube) | Code
UbiComp 2021
Douleur: Creating Pain Sensation with Chemical Stimulant to Enhance User Experience in Virtual Reality
Chutian Jiang#, Yanjun Chen#, Mingming Fan, Liuping Wang, Luyao Shen, Nianlong Li, Wei Sun, Yu Zhang, Feng Tian, Teng Han(#:equal contribution) UbiComp 2021 Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 5, Issue 2, June 2021, Article No.: 66, pp 1–26. PDF
TSE
Accessibile or Not? An Empirical Investigation of Android App Accessibility
Sen Chen, Chunyang Chen, Lingling Fan, Mingming Fan, Xian Zhan, and Yang Liu IEEE Transactions on Software Engineering PDF | Website | Code
DIS 2021
"Too Old to Bank Digitally?": A Survey of Banking Practices and Challenges among Older Adults in China
Xiaofu Jin, Emily Kuang, Mingming Fan In ACM Conference on Designing Interactive Systems (DIS'21), Pages 802–814 PDF | Survey Questions
CHI 2021
Older Adults' Think-Aloud Verbalizations and Speech Features for Identifying User Experience Problems
Mingming Fan, Qiwen Zhao, Vinita Tibdewal In CHI Conference on Human Factors in Computing Systems (CHI'21) PDF | Video (Youtube)
CHI 2021
"I Choose Assistive Devices That Save My Face": A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China
Franklin Mingzhe Li, Di Laura Chen, Mingming Fan, Khai N. Truong In CHI Conference on Human Factors in Computing Systems (CHI'21) PDF
CHI 2021
vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors
Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, Mingming Fan In CHI Conference on Human Factors in Computing Systems (CHI'21) PDF | Video (Youtube)
TVCG (VIS 2021)
ChartSeer: Interactive Steering Exploratory Visual Analysis with Machine Intelligence
Jian Zhao, Mingming Fan, Mi Feng IEEE Transactions on Visualization and Computer Graphics, 2020 PDF | Video (Youtube)
ASSETS 2020
Eyelid Gestures on Mobile Devices for People with Motor Impairments
Mingming Fan#, Zhen Li#, Franklin Mingzhe Li# (#:equal contribution) In 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020, Article No.: 15, pp 1–8 PDF | Video (Youtube)| Talk | Code | Application (Apk file)
| Best Artifact Award
CHI 2020
Mouillé: Exploring Wetness Illusion on Fingertips to Enhance Immersive Experience in VR
Teng Han, Sirui Wang, Sijia Wang, Xiangmin Fan, Jie Liu, Feng Tian, and Mingming Fan In CHI Conference on Human Factors in Computing Systems, 2020 PDF | Video (Youtube) | Talk
TiiS
Automatic Detection of Usability Problem Encounters in Think-Aloud Sessions
Mingming Fan, Yue Li, Khai N. Truong ACM Transactions on Interactive Intelligent Systems (TiiS), Article No. 16, May 2020 PDF
JUS
Practices and Challenges of Using Think-aloud Protocols in Industry: An International Survey
Mingming Fan, Serina Shi, Khai N. Truong Journal of Usability Studies, Vol. 15, Issue 2, February, 2020, pp. 85-102 PDF |Survey
Ph.D. Dissertation
Leveraging Subtle Verbalization and Speech Patterns to Help Evaluators Identify Usability Problem Encounters in Concurrent Think-aloud Sessions
Mingming Fan Ph.D. Dissertation(July 2019) Department of Computer Science, University of Toronto, Toronto, Canada PDF
TVCG (VIS 2019)
VisTA: Integrating Machine Intelligence with Visualization to Support the Investigation of Think-Aloud Sessions
Mingming Fan, Ke Wu, Jian Zhao, Yue Li, Winter Wei, and Khai N. Truong IEEE Transactions on Visualization and Computer Graphics, Vol. 26, Issue 1, January, 2020 PDF | Video (Youtube)
TOCHI (CHI 2020)
Concurrent Think-Aloud Verbalizations and Usability Problems
Mingming Fan, Jinglan Lin, Christina Chung, Khai N. Truong ACM Transactions on Computer-Human Interaction. 26 (5), Article 8, 35 pages, 2019. PDF
IMWUT (UbiComp 2019)
FMT: A Wearable Camera-Based Object Tracking Memory Aid for Older Adults
Franlin Mingzhe Li, Di Laura Chen, Mingming Fan, and Khai N. Truong In Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies PDF | New Scientist Report |ACM DL
CHI 2019
"I feel it is my responsibility to stream”: Streaming and Engaging with Intangible Cultural Heritage through Livestreaming
Zhicong Lu, Michelle Annett, Mingming Fan, Daniel Wigdor In 2019 CHI Conference on Human Factors in Computing Systems PDF |
Best Paper Award
CHI 2019
PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation
on Smartphones
Teng Han, Jie Liu, Khalad Hasan, Mingming Fan, Junhyeok Kim, Jiannan Li, Xiangmin Fan,
Feng Tian, Edward Lank, and Pourang Irani In 2019 CHI Conference on Human Factors in Computing Systems PDF | Video (Youtube)
Internet of Things
Projected Visible Light for 3D Finger Tracking and Device Augmentation on Everyday Objects
Shang Ma, Qiong Liu, Mingming Fan, Phillip Sheu Internet of Things. 2019. Volume 6. Elsevier PDF
TVCG (VIS 2018)
InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming
Zhicong Lu, Mingming Fan, Yun Wang, Jian Zhao, Michelle Annett, Daniel Wigdor IEEE Transactions on Visualization and Computer Graphics, Vol. 25, Issue 1, 2019 PDF | Video (Youtube)
TACCESS (ASSETS 2018)
Guidelines for Creating Senior-Friendly Product Instructions
Mingming Fan, Khai N. Truong ACM Transactions on Accessible Computing 11, 2, Article 9 (June 2018), 35 pages. PDF
ASSETS 2017
BrailleSketch: A Gesture-based Text Entry Method for
People with Visual Impairments
Franklin Li, Mingming Fan, Khai N. Truong In 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS
'17). PDF
ISWC 2017
An Empirical Study of Touch-based Authentication Methods on
Smartwatches
Yue Zhao, Zhongtian Qiu, Yiqing Yang, Weiwei Li, Mingming Fan In 2017 ACM International Symposium on Wearable Computers (ISWC '17). PDF
ISWC 2017
An Empirical Study of Foot Gestures for Hands-Occupied Mobile
Interaction
Mingming Fan, Yizheng Ding, Fang Shen, Yuhui You, Zhi Yu In 2017 ACM International Symposium on Wearable Computers (ISWC '17). PDF
Exploring the Use of Capacitive Sensing to
Externally Measure Liquid Level in Fluid Containers
Mingming Fan, Khai N. Truong, Abhishek Ranjan Knowledge Media Design Institute Technical Report, University of Toronto, 2016 PDF | Video (Youtube)
UbiComp 2015
SoQr: Sonically Quantifying the Content Level inside
Containers
Mingming Fan, Khai N. Truong In 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) PDF | Video (Youtube) |
Best Paper Honorable Mention Award
ISWC 2014
Public Restroom Detection on Mobile Phone via Active Probing
Mingming Fan, Alexander T. Adams, Khai N. Truong In 2014 ACM International Symposium on Wearable Computers (ISWC'14). PDF | Video (Youtube)
HotMobile 2014
HiFi: Hide and Find Digital Content Associated with Physical
Objects via Coded Light
Mingming Fan, Qiong Liu, Hao Tang, Patrick Chiu In 15th Workshop on Mobile Computing Systems and Applications (HotMobile '14). PDF
UbiComp 2012
Augmenting Gesture Recognition with Erlang-Cox Models to
Identify Neurological Disorders in Premature Babies
Mingming Fan, Dana Gravem, Dan Cooper, Donald J Patterson In 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), pp411-420. PDF | Video (Youtube)
Paper Awards
2023
Best Paper Honorable Mention Award, ACM CHI 2023
2020
Best Artifact Award, ACM ASSETS 2020
2019
Best Paper Award, CHI 2019
2015
Best Paper Honorable Mention Award, ACM UbiComp 2015
Services
Technical Program Committee (Selected)
CHI 2024, subcommittee chair (Accessibility and Aging)
Office:
Room 610, Building E2, HKUST(GZ)
Guangzhou, China
Email: mingmingfan@ust.hk
Research Assistant (RA) and Ph.D. Openings: I look for strong candidates who have 1) strong programming skills (e.g., AI/AR/VR, full-stack dev) and/or electronics/hardware prototyping skills (e.g., building working interactive devices), 2) excellent academic performance (e.g., high GPA and ranking), 3) research experience in tackling human-centered problems with computational methods. If this sounds like you, I strongly encourage you to read our papers to ensure you understand what we have been working on and are genuinely interested. Please send me an email with subject "RA/PhD + Name + your university" and attach your CV, transcripts (ranking if avaiable), and English test scores.
Prospective MPhil Students: Our Red bird MPhil program is fully funded and will accept applicants for the 2024/2025 academic year soon. Follow the instructions via this link and apply accordingly.
Recent News
Jan 2023: Seven full papers have been accepted to ACM CHI 2023, the flagship conference of the field of Human-Computer Interaction (HCI).
Jan 2023: One paper has been accepted to IEEE TVCG (Transactions on Visualization and Computer Graphics) journal
Jan 2023: One paper has been accepted to IUI 2023
Feb 2022: Five full papers are accepted to ACM CHI 2022, the flagship conference of the field of Human-Computer Interaction (HCI). Congratulations to the corresponding APEX group members and our collaborators!
Dec 2021: Our work on enabling people with motor impairments to interact with smartphones via eyelid gestures was published in Communications of ACM
Dec 2021: One full paper accepted by CSCW 2022 (published in PACM HCI journal), the premier venue for Computer-supported cooperative work (CSCW) and social computing research.
Congrats to my student Xianyou and the three collaborators: Dennis, Vera and Jian!
Oct 2021: One full paper accepted by Chinese CHI 2021.
Congrats to my student Lingyun (Julie) and collaborators Dennis, Vera and Jian!
July 2021: One full paper accepted by IEEE VIS 2021 (TVCG) Congrats to my student Emily and collaborators Ehsan and Jian!
July 2021: One full paper accepted by IMWUT (UbiComp 2021)
Congrats to all coauthors!
July 2021: Excited to join HKUST as an Assistant Professor!
Look forward to working with colleagues and students at HKUST.
July 2021: Our NSF grant proposal about managing privacy and environment for used and
end-of-life electronic devices has been funded.
Thanks NSF! Congrats to my colleagues Eric, Stacey, Tom, and Willie!
July 2021: Relocated to China after working two wonderful years at RIT.
Thanks to all my wonderful and supportive colleagues and students at RIT! You all rock!
May 2021: Our NSF proposal about developing online labs for building accessible software has been funded! Thanks NSF! Congrats to my colleagues Dan Krutz and Sam Malachowsky!
April 2021: One full paper @ DIS 2021 Congrats to my students Xiaofu and Emily!
Dec 2020: Three full papers @ CHI 2021 Congrats to my students Qiwen and Vinita and also my collaborators!
Best Paper Award
Best Paper Honorable Mention Award
