logo logo

Accessible & Pervasive User EXperience (APEX) Group

Note: *: Corresponding Author (annotated since 2022); #: equal contribution

TVCG

uxSense: Supporting User Experience Analysis with Visualization and Computer Vision

Andrea Batch, Yipeng Ji, Mingming Fan, Jian Zhao, and Niklas Elmqvist
IEEE Transactions on Visualization and Computer Graphics
PDF

CHI 2023

CoPracTter: Toward Integrating Personalized Practice Scenarios, Timely Feedback and Social Support into An Online Support Tool for Coping with Stuttering in China

Li Feng, Zeyu Xiong, Xinyi Li, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Bridging the Generational Gap: Exploring How Virtual Reality Supports Remote Communication Between Grandparents and Grandchildren

Xiaoying Wei, Yizheng Gu, Emily Kuang, Xian Wang, Beiyan Cao, Xiaofu, Jin, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Enhancing Older Adults' Gesture Typing Experience Using the T9 Keyboard on Small Touchscreen Devices

Emily Kuang, Ruihuan Chen, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Collaboration with Conversational AI Assistants for UX Evaluation: Questions and How to Ask them (Voice vs. Text)

Emily Kuang, Ehsan Jahangirzadeh Soure, Mingming Fan*, Jian Zhao, Kristen Shinohara*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Sparkling Silence:Practices and Challenges of Livestreaming Among Deaf or Hard of Hearing Streamers

Beiyan Cao, Changyang He, Muzhi Zhou*, Mingming Fan*
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

"I am the Follower, also the Boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired

Yan Zhang, Ziang Li, Haole Guo, Luyao Wang, Qihe Chen, Wenjie Jiang, Mingming Fan, Guyue Zhou, Jiangtao Gong
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

CHI 2023

Enabling Voice-Accompanying Hand-to-Face Gesture Recognition with Cross-Device Sensing

Zisu Li, Chen Liang, Yue Qin, Yukang Yan, Mingming Fan, Yuntao Wang, Chun Yu, Yuanchun Shi
ACM CHI Conference on Human Factors in Computing Systems (CHI'23)
PDF

IwC

Older Adults’ Concurrent and Retrospective Think-Aloud Verbalizations for Identifying User Experience Problems of VR Games

Mingming Fan*, Vinita Tibdewal, Qiwen Zhao, Lizhou Cao, Chao Peng, Runxuan Shu, Yujia Shan
Interacting with Computers
PDF

UbiComp 2022

Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps

Xiaofu Jin, Xiaozhu Hu, Xiaoying Wei, Mingming Fan*
UbiComp 2022
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 6, Issue 3, September 2022, Article No.: 121, https://doi.org/10.1145/3550321
PDF | Video (Youtube)

CSCW 2022

Human-AI Collaboration for UX Evaluation: Effects of Explanation and Synchronization

Mingming Fan*, Xianyou Yang, Tsz Tung Yu, Vera Q. Liao, Jian Zhao
CSCW 2022
Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW1, Article 96 (April 2022), 32 pages. https://doi.org/10.1145/3512943
PDF

CSCW 2022

Typist Experiment: an Investigation of Human-to-Human Dictation via Role-play to Inform Voice-based Text Authoring

Can Liu, Siying Hu, Li Feng, Mingming Fan
CSCW 2022
Proceedings of the ACM on Human-Computer Interaction (PACM HCI), 6, CSCW2, Article 199 (Nov. 2022)
PDF

ASSETS 2022

"I Used To Carry A Wallet, Now I Just Need To Carry My Phone": Understanding Current Banking Practices and Challenges Among Older Adults in China

Xiaofu Jin, Mingming Fan*
ASSETS' 2022
In ACM SIGACCESS Conference on Computers and Accessibility (ASSETS' 2022)
PDF

IJHCI

PoeticAR: Reviving Traditional Poetry of the Heritage Site of Jichang Garden via Augmented Reality

Jin Tian, Yifan Cao, Lingyi Feng, Dongting Fu, Linping Yuan, Huaming Qu, Yang Wang, Mingming Fan*
International Journal of Human-Computer Interaction (In Press)
PDF

Chinese CHI 2022

Understanding Older Adults' Perceptions and Challenges in Using AI-enabled Everyday Technologies

Esha Shandilya, Mingming Fan*
Chinese CHI 2022
The Tenth International Symposium of Chinese CHI, ACM.
PDF

Chinese CHI 2022

Communication in Immersive Social Virtual Reality: A Systematic Review of 10 Years' Studies

Xiaoying Wei#, Xiaofu Jin#, Mingming Fan*
Chinese CHI 2022
The Tenth International Symposium of Chinese CHI, ACM.
PDF

Chinese CHI 2022

Reducing Stress and Anxiety in the Metaverse: A Systematic Review of Meditation, Mindfulness and Virtual Reality

Xian Wang#, Xiaoyu Wang#, Mingming Fan*, Lik-Hang Lee, Bertram E. Shi, Pan Hui*
Chinese CHI 2022
The Tenth International Symposium of Chinese CHI, ACM.
PDF

DIS 2022

"It Feels Like Being Locked In A Cage": Understanding Blind or Low Vision Streamers' Perceptions of Content Curation Algorithms

Zhiyi Rong, Mo Zhou, Zhicong Lu*, Mingming Fan*
In ACM SIGCHI Conference on Designing Interactive Systems (DIS' 22) (acceptance rate: 21.5%)
PDF

IJHCI

Understanding How Older Adults Comprehend COVID-19 Interactive Visualizations via Think-Aloud Protocol

Mingming Fan*, Yiwen Wang, Yuni Xie, Franklin Li, Chunyang Chen
International Journal of Human-Computer Interaction
PDF | Appendix

CHI 2022

"I Shake The Package To Check If It's Mine": A Study of Package Fetching Practices and Challenges of Blind and Low Vision People in China

Wentao Lei, Mingming Fan*, Juliann Thang
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

"I Don't Want People to Look At Me Differently": Designing User-Defined Above-the-Neck Gestures for People with Upper Body Motor Impairments

Xuan Zhao, Mingming Fan*, Teng Han
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

"Merging Results Is No Easy Task": An International Survey Study of Collaborative Data Analysis Practices Among UX Practitioners

Emily Kuang, Xiaofu Jin, Mingming Fan*
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

From WOW to WHY: Guidelines for Creating the Opening of a Data Video with Cinematic Styles

Xian Xu, Leni Yang, David Yip, Mingming Fan*, Zheng Wei, Huamin Qu
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CHI 2022

"I need to be professional until my new team uses emoji, GIFs, or memes first": New Collaborators’ Perspectives on Using Non-Textual Communication in Virtual Workspaces

Esha Shandilya, Mingming Fan, Garreth Tigwell
In CHI Conference on Human Factors in Computing Systems (CHI'22)
PDF

CACM

Credit: Getty Images

Eyelid Gestures for People with Motor Impairments

Mingming Fan*, Zhen Li, Franklin Mingzhe Li
Communications of the ACM, January 2022, Vol. 65 No. 1, Pages 108-115, 10.1145/3498367
HTML | PDF | Video (Youtube) | Code | Report

Chinese CHI 2021

Think-Aloud Verbalizations for Identifying User Experience Problems: Effects of Language Proficiency with Chinese Non-Native English Speakers

Mingming Fan, Lingyun (Julie) Zhu
Chinese CHI 2021
The Ninth International Symposium of Chinese CHI (Chinese CHI 2021), ACM, 11 pages.
PDF

TVCG (VIS 2021)

CoUX: Collaborative Visual Analysis of Think-Aloud Usability Test Videos for Digital Interfaces

Ehsan Jahangirzadeh#, Emily Kuang#, Mingming Fan, Jian Zhao (#: equal contribution)
IEEE VIS 2021
IEEE Transactions on Visualization and Computer Graphics
PDF | Video (Youtube) | Code

IMWUT (UbiComp 2021)

Douleur: Creating Pain Sensation with Chemical Stimulant to Enhance User Experience in Virtual Reality

Chutian Jiang#, Yanjun Chen#, Mingming Fan, Liuping Wang, Luyao Shen, Nianlong Li, Wei Sun, Yu Zhang, Feng Tian, Teng Han (#: equal contribution)
UbiComp 2021
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Volume 5, Issue 2, June 2021, Article No.: 66, pp 1–26.
PDF

TSE

Accessibile or Not? An Empirical Investigation of Android App Accessibility

Sen Chen, Chunyang Chen, Lingling Fan, Mingming Fan, Xian Zhan, and Yang Liu
IEEE Transactions on Software Engineering
PDF | Website | Code

DIS 2021

"Too Old to Bank Digitally?": A Survey of Banking Practices and Challenges among Older Adults in China

Xiaofu Jin, Emily Kuang, Mingming Fan
In ACM Conference on Designing Interactive Systems (DIS'21)
PDF | Survey Questions

CHI 2021

Older Adults' Think-Aloud Verbalizations and Speech Features for Identifying User Experience Problems

Mingming Fan, Qiwen Zhao, Vinita Tibdewal
In CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Video (Youtube)

CHI 2021

"I Choose Assistive Devices That Save My Face": A Study on Perceptions of Accessibility and Assistive Technology Use Conducted in China

Franklin Mingzhe Li, Di Laura Chen, Mingming Fan, Khai N. Truong
In CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF

CHI 2021

vMirror: Enhancing the Interaction with Occluded or Distant Objects in VR with Virtual Mirrors

Nianlong Li, Zhengquan Zhang, Can Liu, Zengyao Yang, Yinan Fu, Feng Tian, Teng Han, Mingming Fan
In CHI Conference on Human Factors in Computing Systems (CHI'21)
PDF | Video (Youtube)

TVCG (VIS 2021)

ChartSeer: Interactive Steering Exploratory Visual Analysis with Machine Intelligence

Jian Zhao, Mingming Fan, Mi Feng
IEEE Transactions on Visualization and Computer Graphics, 2020
PDF | Video (Youtube)

ASSETS 2020

Eyelid Gestures on Mobile Devices for People with Motor Impairments

Mingming Fan#, Zhen Li#, Franklin Mingzhe Li# (#: equal contribution)
In 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020, Article No.: 15, pp 1–8
PDF | Video (Youtube) | Talk | Code | Application (Apk file) | Best Artifact Award

CHI 2020

Mouillé: Exploring Wetness Illusion on Fingertips to Enhance Immersive Experience in VR

Teng Han, Sirui Wang, Sijia Wang, Xiangmin Fan, Jie Liu, Feng Tian, and Mingming Fan
In CHI Conference on Human Factors in Computing Systems, 2020
PDF | Video | Video (Youtube)

TiiS

Automatic Detection of Usability Problem Encounters in Think-Aloud Sessions

Mingming Fan, Yue Li, Khai N. Truong
ACM Transactions on Interactive Intelligent Systems (TiiS), Article No. 16, May 2020
PDF

JUS

Practices and Challenges of Using Think-aloud Protocols in Industry: An International Survey

Mingming Fan, Serina Shi, Khai N. Truong
Journal of Usability Studies, Vol. 15, Issue 2, February, 2020, pp. 85-102
PDF | Survey

TVCG (VIS 2019)

VisTA: Integrating Machine Intelligence with Visualization to Support the Investigation of Think-Aloud Sessions

Mingming Fan, Ke Wu, Jian Zhao, Yue Li, Winter Wei, and Khai N. Truong
IEEE Transactions on Visualization and Computer Graphics, Vol. 26, Issue 1, January, 2020
PDF | Video (Youtube)

TOCHI (CHI 2020)

a usability evaluator uses our tool to identify usability problems

Concurrent Think-Aloud Verbalizations and Usability Problems

Mingming Fan, Jinglan Lin, Christina Chung, Khai N. Truong
ACM Transactions on Computer-Human Interaction. 26 (5), Article 8, 35 pages, 2019.
PDF

IMWUT (UbiComp 2019)

FMT: A Wearable Camera-Based Object Tracking Memory Aid for Older Adults

Franlin Mingzhe Li, Di Laura Chen, Mingming Fan, and Khai N. Truong
In Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
PDF | New Scientist Report | ACM DL

CHI 2019

the example images of living streaming for intagible cultural heritage

"I feel it is my responsibility to stream”: Streaming and Engaging with Intangible Cultural Heritage through Livestreaming

Zhicong Lu, Michelle Annett, Mingming Fan, Daniel Wigdor
In 2019 CHI Conference on Human Factors in Computing Systems
PDF | Best Paper Award

CHI 2019

PinchList: Leveraging Pinch Gestures for Hierarchical List Navigation on Smartphones

Teng Han, Jie Liu, Khalad Hasan, Mingming Fan, Junhyeok Kim, Jiannan Li, Xiangmin Fan, Feng Tian, Edward Lank, and Pourang Irani
In 2019 CHI Conference on Human Factors in Computing Systems
PDF | Video (Youtube)

Internet of Things

project profile image. An older adult is writing on the edge of one printed product instructions

Projected Visible Light for 3D Finger Tracking and Device Augmentation on Everyday Objects

Shang Ma, Qiong Liu, Mingming Fan, Phillip Sheu
Internet of Things. 2019. Volume 6. Elsevier
PDF

TVCG (VIS 2018)

InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming

Zhicong Lu, Mingming Fan, Yun Wang, Jian Zhao, Michelle Annett, Daniel Wigdor
IEEE Transactions on Visualization and Computer Graphics, Vol. 25, Issue 1, 2019
PDF | Video (Youtube)

TACCESS (ASSETS 2018)

project profile image. An older adult is writing on the edge of one printed product instructions

Guidelines for Creating Senior-Friendly Product Instructions

Mingming Fan, Khai N. Truong
ACM Transactions on Accessible Computing 11, 2, Article 9 (June 2018), 35 pages.
PDF

ASSETS 2017

BrailleSketch: A Gesture-based Text Entry Method for People with Visual Impairments

Franklin Li, Mingming Fan, Khai N. Truong
In 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17).
PDF

ISWC 2017

An Empirical Study of Touch-based Authentication Methods on Smartwatches

Yue Zhao, Zhongtian Qiu, Yiqing Yang, Weiwei Li, Mingming Fan
In 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

ISWC 2017

An Empirical Study of Foot Gestures for Hands-Occupied Mobile Interaction

Mingming Fan, Yizheng Ding, Fang Shen, Yuhui You, Zhi Yu
In 2017 ACM International Symposium on Wearable Computers (ISWC '17).
PDF

Exploring the Use of Capacitive Sensing to Externally Measure Liquid Level in Fluid Containers

Mingming Fan, Khai N. Truong, Abhishek Ranjan
Knowledge Media Design Institute Technical Report, University of Toronto, 2016
PDF | Video (Youtube)

UbiComp 2015

SoQr: Sonically Quantifying the Content Level inside Containers

Mingming Fan, Khai N. Truong
In 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp)
PDF | Video (Youtube) | Best Paper Honorable Mention Award

ISWC 2014

Public Restroom Detection on Mobile Phone via Active Probing

Mingming Fan, Alexander T. Adams, Khai N. Truong
In 2014 ACM International Symposium on Wearable Computers (ISWC'14).
PDF | Video (Youtube)

HotMobile 2014

HiFi: Hide and Find Digital Content Associated with Physical Objects via Coded Light

Mingming Fan, Qiong Liu, Hao Tang, Patrick Chiu
In 15th Workshop on Mobile Computing Systems and Applications (HotMobile '14).
PDF

UbiComp 2012

Augmenting Gesture Recognition with Erlang-Cox Models to Identify Neurological Disorders in Premature Babies

Mingming Fan, Dana Gravem, Dan Cooper, Donald J Patterson
In 2012 ACM Conference on Ubiquitous Computing (UbiComp'12), pp411-420.
PDF | Video (Youtube)