Mingming Fan's head profile

Mingming Fan is an Assistant Professor in the Computational Media and Arts Thrust and an Affiliated Assistant Professor in the Department of Computer Science and Engineering at The Hong Kong University of Science and Technology (HKUST) in Guangzhou and Clear Water Bay campuses respectively. Before joining HKUST, he was a tenure-track Assistant Professor at Rochester Institute of Technology from 2019 to 2021. He received a Ph.D. from the Department of Computer Science at the University of Toronto in 2019.

Dr. Fan leads the Accessible & Pervasive User EXperience (APEX) Group to research in the field of Human-Computer Interaction and Accessibility. Specifically, his group applies user-centered design (UCD), AI, ML, VR/AR, visualization, sensing, and qualitative methods to 1)innovate User Experience (UX) Methodologies (e.g., Human-AI collaboration), 2)tackle Aging and Accessibility Challenges, and 3)Create Novel VR/AR Experience and Sensing Techniques. His research won Best Paper Award, Best Paper Honorable Mention Award, and Best Artifact Award from top-tier venues in HCI and Accessibility, such as ACM CHI, UbiComp, and ASSETS.

Research

Note: *: equal contribution

TVCG

(VIS 2021)

CoUX: Collaborative Visual Analysis of Think-Aloud Usability Test Videos for Digital Interfaces

Ehsan Jahangirzadeh*, Emily Kuang*, Mingming Fan, Jian Zhao
IEEE VIS 2021 (To Be Presented)
IEEE Transactions on Visualization and Computer Graphics
PDF | Video

IMWUT (UbiComp 2021)

Douleur: Creating Pain Sensation with Chemical Stimulant to Enhance User Experience in Virtual Reality

Chutian Jiang*, Yanjun Chen*, Mingming Fan, Liuping Wang, Luyao Shen, Nianlong Li, Wei Sun, Yu Zhang, Feng Tian, Teng Han
UbiComp 2021
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 5, Issue 2, June 2021, Article No.: 66, pp 1–26.
PDF

TSE

Accessibile or Not? An Empirical Investigation of Android App Accessibility

Sen Chen, Chunyang Chen, Lingling Fan, Mingming Fan, Xian Zhan, and Yang Liu
IEEE Transactions on Software Engineering
PDF | Website | Code

DIS 2021

"Too Old to Bank Digitally?": A Survey of Banking Practices and Challenges among Older Adults in China

Xiaofu Jin, Emily Kuang, Mingming Fan
In ACM Conference on Designing Interactive Systems (DIS'21), Pages 802–814
PDF | Survey Questions

CHI 2021

Older Adults' Think-Aloud Verbalizations and Speech Features for Identifying User Experience Problems

Mingming Fan, Qiwen Zhao, Vinita Tibdewal
In ACM CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Talk

CHI 2021

"I Choose Assistive Devices That Save My Face": A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China

Franklin Mingzhe Li, Di Laura Chen, Mingming Fan, Khai N. Truong
In ACM CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF

CHI 2021

vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors

Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, Mingming Fan
In ACM CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Video

TVCG

ChartSeer: Interactive Steering Exploratory Visual Analysis with Machine Intelligence

Jian Zhao, Mingming Fan, Mi Feng
IEEE Transactions on Visualization and Computer Graphics, 2020
PDF | Video

ASSETS 2020

Eyelid Gestures on Mobile Devices for People with Motor Impairments

Mingming Fan*, Zhen Li*, Franklin Mingzhe Li*
In 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020, Article No.: 15, pp 1–8
PDF | Video | Talk | Code | Application (Apk file) | Best Artifact Award (2nd Place)

CHI 2020

Mouillé: Exploring Wetness Illusion on Fingertips to Enhance Immersive Experience in VR

Teng Han, Sirui Wang, Sijia Wang, Xiangmin Fan, Jie Liu, Feng Tian, and Mingming Fan
In ACM CHI Conference on Human Factors in Computing Systems, 2020
PDF | Video | Talk

TiiS

Automatic Detection of Usability Problem Encounters in Think-Aloud Sessions

Mingming Fan, Yue Li, Khai N. Truong
ACM Transactions on Interactive Intelligent Systems (TiiS), Article No. 16, May 2020
PDF

JUS

Practices and Challenges of Using Think-aloud Protocols in Industry: An International Survey

Mingming Fan, Serina Shi, Khai N. Truong
Journal of Usability Studies, Vol. 15, Issue 2, February, 2020, pp. 85-102
PDF | Survey

Ph.D. Dissertation

Leveraging Subtle Verbalization and Speech Patterns to Help Evaluators Identify Usability Problem Encounters in Concurrent Think-aloud Sessions

Mingming Fan
Ph.D. Dissertation (July 2019)
Department of Computer Science, University of Toronto, Toronto, Canada
PDF

TVCG (VIS 2019)

VisTA: Integrating Machine Intelligence with Visualization to Support the Investigation of Think-Aloud Sessions

Mingming Fan, Ke Wu, Jian Zhao, Yue Li, Winter Wei, and Khai N. Truong
IEEE Transactions on Visualization and Computer Graphics, Vol. 26, Issue 1, January, 2020
PDF | Video

TOCHI

a usability evaluator uses our tool to identify usability problems

Concurrent Think-Aloud Verbalizations and Usability Problems

Mingming Fan, Jinglan Lin, Christina Chung, Khai N. Truong
ACM Transactions on Computer-Human Interaction. 26 (5), Article 8, 35 pages, 2019.
PDF

IMWUT (UbiComp 2019)

FMT: A Wearable Camera-Based Object Tracking Memory Aid for Older Adults

Franlin Mingzhe Li, Di Laura Chen, Mingming Fan, and Khai N. Truong
In Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
PDF | New Scientist Report | ACM DL

CHI 2019

the example images of living streaming for intagible cultural heritage

"I feel it is my responsibility to stream”: Streaming and Engaging with Intangible Cultural Heritage through Livestreaming

Zhicong Lu, Michelle Annett, Mingming Fan, Daniel Wigdor
In 2019 CHI Conference on Human Factors in Computing Systems
PDF | Best Paper Award

CHI 2019

PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation on Smartphones

Teng Han, Jie Liu, Khalad Hasan, Mingming Fan, Junhyeok Kim, Jiannan Li, Xiangmin Fan, Feng Tian, Edward Lank, and Pourang Irani
In 2019 CHI Conference on Human Factors in Computing Systems
PDF | Video

Internet of Things

project profile image. An older adult is writing on the edge of one printed product instructions

Projected Visible Light for 3D Finger Tracking and Device Augmentation on Everyday Objects

Shang Ma, Qiong Liu, Mingming Fan, Phillip Sheu
Internet of Things. 2019. Volume 6. Elsevier
PDF

TVCG (VIS 2018)

InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming

Zhicong Lu, Mingming Fan, Yun Wang, Jian Zhao, Michelle Annett, Daniel Wigdor
IEEE Transactions on Visualization and Computer Graphics, Vol. 25, Issue 1, 2019
PDF | Video

TACCESS

project profile image. An older adult is writing on the edge of one printed product instructions

Guidelines for Creating Senior-Friendly Product Instructions

Mingming Fan, Khai N. Truong
ACM Transactions on Accessible Computing 11, 2, Article 9 (June 2018), 35 pages.
PDF

ASSETS 2017

BrailleSketch: A Gesture-based Text Entry Method for People with Visual Impairments

Franklin Li, Mingming Fan, Khai N. Truong
In 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17).
PDF

ISWC 2017

An Empirical Study of Touch-based Authentication Methods on Smartwatches

Yue Zhao, Zhongtian Qiu, Yiqing Yang, Weiwei Li, Mingming Fan
In 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

ISWC 2017

An Empirical Study of Foot Gestures for Hands-Occupied Mobile Interaction

Mingming Fan, Yizheng Ding, Fang Shen, Yuhui You, Zhi Yu
In 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

Exploring the Use of Capacitive Sensing to Externally Measure Liquid Level in Fluid Containers

Mingming Fan, Khai N. Truong, Abhishek Ranjan
Knowledge Media Design Institute Technical Report, University of Toronto, 2016
PDF | Video

UbiComp 2015

SoQr: Sonically Quantifying the Content Level inside Containers

Mingming Fan, Khai N. Truong
In 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)
PDF | Video | Best Paper Honorable Mention Award

ISWC 2014

Public Restroom Detection on Mobile Phone via Active Probing

Mingming Fan, Alexander T. Adams, Khai N. Truong
In 2014 ACM International Symposium on Wearable Computers (ISWC'14).
PDF | Video

HotMobile 2014

HiFi: Hide and Find Digital Content Associated with Physical Objects via Coded Light

Mingming Fan, Qiong Liu, Hao Tang, Patrick Chiu
In 15th Workshop on Mobile Computing Systems and Applications (HotMobile '14).
PDF

UbiComp 2012

Augmenting Gesture Recognition with Erlang-Cox Models to Identify Neurological Disorders in Premature Babies

Mingming Fan, Dana Gravem, Dan Cooper, Donald J Patterson
In 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), pp411-420.
PDF | Video


Paper Awards

2020 Best Artifact Award (2nd Place), ACM ASSETS 2020
2019 Best Paper Award, ACM CHI 2019
2015 Best Paper Honorable Mention Award, ACM UbiComp 2015

Services

Technical Program Committee

ACM CHI 2022
ACM ASSETS 2021
ACM CHI 2021
ACM ASSETS 2020

Reviewer (Selected)

ACM CHI received "special recognition" for outstanding reviews
ACM Transactions on Computer-Human Interaction (TOCHI)
ACM ASSETS
ACM Transactions on Accessible Computing (TACCESS)
ACM UbiComp / IMWUT received "special recognition" for outstanding reviews
ACM UIST received "special recognition" for outstanding reviews
IEEE VIS

Teaching

Spring 2021 HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices RIT
Spring 2021 ISTE-799: Independent Study RIT
Fall 2020 HCIN-720: Prototyping Wearable and Internet of Things Devices RIT
Spring 2020 HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices RIT
Spring 2020 ISTE-799: Independent Study RIT
Fall 2019 HCIN-720: Prototyping Wearable and Internet of Things Devices RIT

Google scholar
Curriculum Vitae
   @mingming_fan

Office:
Room 1006, IAS Building, HKUST
Clear Water Bay, Hong Kong
Email: mingmingfan@ust.hk

Prospective Ph.D. Students: I'm looking for strongly motivated and talented students, from around the world, to pursue a Ph.D. in HCI, VR/AR, Accessibility, or Human-AI Collaboration starting Fall 2022.

I encourage prospective students with relevant HCI research experience to contact me. However, before emailing me, you should familiarize yourself with my research, explain which research topic of mine genuinely attracts you, and articulate how our research interests match.

The PhD application deadline is Dec. 15 2021, and more info can be found here.

Current HKUST Students: If you're interested in HCI, VR/AR, Accessibility, or Human-AI Collaboration and are eager to leverage advanced technology (e.g., AI, IoT, Visualization, VR/AR) to tackle human-centered, social and societal challenges (e.g., aging, disabilities, human-AI interaction, sustainability, UX), feel free to drop me an email to chat about potential research projects or supervision opportunities.

Recent News

July 2021: One full paper @ IEEE VIS 2021 (TVCG)
Congrats to Emily, Ehsan and Jian!

July 2021: One full paper @ IMWUT (UbiComp 2021)
Congrats to all coauthors!

July 2021: Excited to join HKUST as an Assistant Professor!
Look forward to working with colleagues and students at HKUST.

July 2021: Our NSF grant proposal about managing privacy and environment for used and end-of-life electronic devices has been funded.
Thanks NSF! Congrats to my colleagues Eric, Stacey, Tom, and Willie!

July 2021: Relocated to China after working two wonderful years at RIT.
Thanks to all my wonderful and supportive colleagues and students at RIT! You all rock!

May 2021: Our NSF proposal about developing online labs for building accessible software has been funded!
Thanks NSF! Congrats to my colleagues Dan Krutz and Sam Malachowsky!

April 2021: One full paper @ DIS 2021
Congrats to Xiaofu and Emily!

Dec 2020: Three full papers @ CHI 2021
Congrats to Qiwen, Vinita, and other coauthors!