Mingming Fan's head profile

I am an Assistant Professor in the School of Information, Golisano College of Computing and Information Sciences at the Rochester Institute of Technology since August 2019. I received a Ph.D. in CS from the University of Toronto in July 2019.

I lead the Intelligent and Inclusive Interaction Research Group at RIT. I am also a member of the Center for Accessibility and Inclusion Research (CAIR) and an affiliated member of the Center for Human-Aware Artificial Intelligence (CHAI).

I research at the intersection of Human-Computer Interaction (HCI), Accessibility, and Artificial Intelligence (AI). My research focuses on understanding User Experience (UX) and Accessibility problems via user-centered approaches and addressing them via building human-AI collaborative tools, assistive technologies, and novel interaction methods.

  • Human-AI Collaboration for Identifying UX Problems (AI-Assisted UX Analysis)
    • Understanding Users' Subtle Behavioral Patterns Indicating UX Problems
      e.g., What are subtle behavioral patterns that indicate UX problems? (TOCHI'19, CHI'21)
    • Building AI Models to Detect UX Problems
      e.g., Could AI be built to detect UX problems? (TiiS'20)
    • Designing AI-Assistive Tools to Support UX Evaluators
      e.g., How to design AI-Assisted interactive tools to help UX practitioners analyze UX test sessions? (TVCG'20)
  • Aging and Accessibility
    • Understanding Accessibility Challenges via User-Centered Design
      e.g., How to design user-friendly instructions for older adults? (TACCESS'18)
      e.g., Could mobile and wearable technology be designed as memory-aid for older adults? (IMWUT'19)
    • Designing and Evaluating Assistive Technology
      e.g., How to design eyelid gestures for people with motor impairments to support hands-free interaction? (ASSETS'20)
      e.g., How to design an easy-to-learn gesture-based text-entry method for people with visual impairments? (ASSETS'17)
  • Mobile, Wearable, and Ubiquitous Sensing & Interaction Techniques
    • Novel Sensing Techniques
      e.g., How to unobstrusively monitor the content level inside a container? (UbiComp'15 (Best Paper Honorable Mention Award))
      e.g., How to nonintrusively infer the type of physical space a user is in? (ISWC'14)
    • Novel Interaction Techniques
      e.g., How to enhance VR users' experiences by providing them with non-visual sensations? (CHI'20)

Research


"Too Old to Bank Digitally?": A Survey of Banking Practices and Challenges among Older Adults in China

Xiaofu Jin, Emily Kuang, Mingming Fan
DIS 2021
In ACM Conference on Designing Interactive Systems (DIS'21) (In Press)
PDF

Older Adults' Think-Aloud Verbalizations and Speech Features for Identifying User Experience Problems

Mingming Fan, Qiwen Zhao, Vinita Tibdewal
CHI 2021
In ACM CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Talk

"I Choose Assistive Devices That Save My Face": A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China

Franklin Mingzhe Li, Di Laura Chen, Mingming Fan, Khai N. Truong
CHI 2021
In ACM CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF

vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors

Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, Mingming Fan
CHI 2021
In ACM CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Video

ChartSeer: Interactive Steering Exploratory Visual Analysis with Machine Intelligence

Jian Zhao, Mingming Fan, Mi Feng
TVCG
IEEE Transactions on Visualization and Computer Graphics, 2020 (In Press)
PDF | Video

Eyelid Gestures on Mobile Devices for People with Motor Impairments

Mingming Fan*, Zhen Li*, Franklin Mingzhe Li* (*equal contribution)
ASSETS 2020
In Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020, Article No.: 15, pp 1–8
PDF | Video | Talk | Code | Application (Apk file) | Best Artifact Award (2nd Place)

Mouillé: Exploring Wetness Illusion on Fingertips to Enhance Immersive Experience in VR

Teng Han, Sirui Wang, Sijia Wang, Xiangmin Fan, Jie Liu, Feng Tian, and Mingming Fan
CHI 2020
In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems, 2020
PDF | Video | Talk

Automatic Detection of Usability Problem Encounters in Think-Aloud Sessions

Mingming Fan, Yue Li, Khai N. Truong
TiiS
ACM Transactions on Interactive Intelligent Systems (TiiS), Article No. 16, May 2020
PDF

Practices and Challenges of Using Think-aloud Protocols in Industry: An International Survey

Mingming Fan, Serina Shi, Khai N. Truong
JUS
Journal of Usability Studies, Vol. 15, Issue 2, February, 2020, pp. 85-102
PDF | Survey

Leveraging Subtle Verbalization and Speech Patterns to Help Evaluators Identify Usability Problem Encounters in Concurrent Think-aloud Sessions

Mingming Fan
Ph.D. Dissertation (July 2019)
Department of Computer Science, University of Toronto, Toronto, Canada
PDF

VisTA: Integrating Machine Intelligence with Visualization to Support the Investigation of Think-Aloud Sessions

Mingming Fan, Ke Wu, Jian Zhao, Yue Li, Winter Wei, and Khai N. Truong
TVCG (InfoVis'19)
IEEE Transactions on Visualization and Computer Graphics, Vol. 26, Issue 1, January, 2020
PDF | Video

a usability evaluator uses our tool to identify usability problems

Concurrent Think-Aloud Verbalizations and Usability Problems

Mingming Fan, Jinglan Lin, Christina Chung, Khai N. Truong
TOCHI
ACM Transactions on Computer-Human Interaction. 26 (5), Article 8, 35 pages, 2019.
PDF

FMT: A Wearable Camera-Based Object Tracking Memory Aid for Older Adults

Franlin Mingzhe Li, Di Laura Chen, Mingming Fan, and Khai N. Truong
IMWUT (Presented at UbiComp 2019)
In Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
PDF | New Scientist Report | ACM DL

the example images of living streaming for intagible cultural heritage

"I feel it is my responsibility to stream”: Streaming and Engaging with Intangible Cultural Heritage through Livestreaming

Zhicong Lu, Michelle Annett, Mingming Fan, Daniel Wigdor
CHI 2019
In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
PDF | Best Paper Award

PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation on Smartphones

Teng Han, Jie Liu, Khalad Hasan, Mingming Fan, Junhyeok Kim, Jiannan Li, Xiangmin Fan, Feng Tian, Edward Lank, and Pourang Irani
CHI 2019
In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
PDF | Video

project profile image. An older adult is writing on the edge of one printed product instructions

Projected Visible Light for 3D Finger Tracking and Device Augmentation on Everyday Objects

Shang Ma, Qiong Liu, Mingming Fan, Phillip Sheu
Internet of Things. 2019. Volume 6. Elsevier
PDF

InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming

Zhicong Lu, Mingming Fan, Yun Wang, Jian Zhao, Michelle Annett, Daniel Wigdor
TVCG (VAST'18)
IEEE Transactions on Visualization and Computer Graphics, Vol. 25, Issue 1, 2019
PDF | Video

project profile image. An older adult is writing on the edge of one printed product instructions

Guidelines for Creating Senior-Friendly Product Instructions

Mingming Fan, Khai N. Truong
TACCESS (Presented at ASSETS 2018)
ACM Transactions on Accessible Computing 11, 2, Article 9 (June 2018), 35 pages.
PDF

BrailleSketch: A Gesture-based Text Entry Method for People with Visual Impairments

Franklin Li, Mingming Fan, Khai N. Truong
ASSETS 2017
In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17).
PDF

An Empirical Study of Touch-based Authentication Methods on Smartwatches

Yue Zhao, Zhongtian Qiu, Yiqing Yang, Weiwei Li, Mingming Fan
ISWC 2017
In Proceedings of the 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

An Empirical Study of Foot Gestures for Hands-Occupied Mobile Interaction

Mingming Fan, Yizheng Ding, Fang Shen, Yuhui You, Zhi Yu
ISWC 2017
In Proceedings of the 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

Exploring the Use of Capacitive Sensing to Externally Measure Liquid Level in Fluid Containers

Mingming Fan, Khai N. Truong, Abhishek Ranjan
Knowledge Media Design Institute Technical Report, University of Toronto, 2016
PDF | Video

SoQr: Sonically Quantifying the Content Level inside Containers

Mingming Fan, Khai N. Truong
UbiComp 2015
In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, New York, NY, USA, 3-14. DOI=http://dx.doi.org/10.1145/2750858.2804264
PDF | Video | Best Paper Honorable Mention Award

Public Restroom Detection on Mobile Phone via Active Probing

Mingming Fan, Alexander T. Adams, Khai N. Truong
ISWC 2014
In Proceedings of the 2014 ACM International Symposium on Wearable Computers (ISWC'14).
PDF | Video

HiFi: Hide and Find Digital Content Associated with Physical Objects via Coded Light

Mingming Fan, Qiong Liu, Hao Tang, Patrick Chiu
HotMobile 2014
In Proceedings of the 15th Workshop on Mobile Computing Systems and Applications (HotMobile '14).
PDF

Augmenting Gesture Recognition with Erlang-Cox Models to Identify Neurological Disorders in Premature Babies

Mingming Fan, Dana Gravem, Dan Cooper, Donald J Patterson
UbiComp 2012
In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp'12).
PDF | Video

Paper Awards

2020 Best Artifact Award (2nd Place), ACM ASSETS 2020
2019 Best Paper Award, ACM CHI 2019
2015 Best Paper Honorable Mention Award, ACM UbiComp 2015

Professional Services

Technical Program Committee Member
ACM ASSETS 2021
ACM CHI 2021
ACM ASSETS 2020
Reviewer (Recent)
ACM CHI received "special recognition" for outstanding reviews
ACM Transactions on Computer-Human Interaction (TOCHI)
ACM ASSETS
ACM Transactions on Accessible Computing (TACCESS)
ACM UbiComp / IMWUT received "special recognition" for outstanding reviews
ACM UIST received "special recognition" for outstanding reviews

Teaching

Spring 2021 HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices RIT
Spring 2021 ISTE-799: Independent Study RIT
Fall 2020 HCIN-720: Prototyping Wearable and Internet of Things Devices RIT
Spring 2020 HCIN-722: HCI with Mobile, Wearable, and Ubiquitous Devices RIT
Spring 2020 ISTE-799: Independent Study RIT
Fall 2019 HCIN-720: Prototyping Wearable and Internet of Things Devices RIT

Advising

Please visit my research group for detail: Intelligent and Inclusive Interaction (Triple-Eye) Research Group.


Google scholar
Curriculum Vitae
   @mingming_fan
   @mfan
   @mingming_fan
   mingming.fan@rit.edu

Recent News

May 2021: Our NSF proposal about developing online labs for building accessible software has been awarded!
Congrats to my colleagues Dan Krutz and Sam Malachowsky!

April 2021: One full paper @ DIS 2021
Congrats to Xiaofu and Emily!

Dec 2020: Three full papers @ CHI 2021
Congrats to Qiwen, Vinita, and other coauthors!