Visualization practitioners have traditionally focused on evaluating the outcome of the visual analytic process, as opposed to studying how that process unfolds. Since user strategy would likely influence the outcome of visual analysis and the nature of insights acquired, it is important to understand how the analytic behavior of users is shaped by variations in the design of the visualization interface. This paper presents a technique for evaluating user behavior in exploratory visual analysis scenarios. We characterize visual exploration as a fluid activity involving transitions between mental and interaction states. We show how micro-patterns in these transitions can be captured and analyzed quantitatively to reveal differences in the exploratory behavior of users, given variations in the visualization interface.

Categories and Subject Descriptors
H.5.2 [Information Interfaces and Presentation]: User Interfaces/Evaluation/methodology

Keywords
Exploratory visual analysis; insight-based evaluation.

PDF

Reda, K., Johnson, A., Leigh, J., Papka, M., Evaluating User Behavior and Strategy During Visual Exploration, Proceedings of the 2014 BELIV Workshop: Beyond Time and Errors: Novel Evaluation Methods for Visualization, Paris, France, November 10th, 2014.