Cognitive Aspects of Visualization Use
Although some research has examined effects of various features of visualizations on users’ cognition, most of the focus has been on perception and low-level cognitive processes, rather than on high-level cognitive processes and structures (e.g., mental models, metaphors, and abstract reasoning). Because visualizations are used for more than simple and quick perceptual judgments—and because data visualization is moving increasingly beyond specialist-use only and into the realm of general public use—it is important to have a principled understanding of the high-level cognitive processes and structures with which average users interpret and make sense of visualizations. In this area of research, we investigate effects of different visualization and interaction techniques on user cognition. We also investigate how cognitive structures, like mental models and metaphors, influence how people interpret and reason with visual information.
Related Publications
2023
Zhang, Zixu; Parsons, Paul
Designing Visual Displays for Deep Space Habitats: Challenges and Opportunities from a Cognitive Task Analysis with ISS Conference Forthcoming
Proceedings of the 67th Human Factors and Ergonomics Society Annual Meeting, Forthcoming.
@conference{ZhangParsonsHFES2023,
title = {Designing Visual Displays for Deep Space Habitats: Challenges and Opportunities from a Cognitive Task Analysis with ISS},
author = {Zixu Zhang and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2023/08/ZhangParsons-2023-HFES-Challenges-and-Opportunities.pdf, Zhang and Parsons - 2023 - Visual Displays for Deep Space Habitats [paper]},
year = {2023},
date = {2023-10-16},
urldate = {2023-10-16},
booktitle = {Proceedings of the 67th Human Factors and Ergonomics Society Annual Meeting},
keywords = {},
pubstate = {forthcoming},
tppubtype = {conference}
}
2022
Parsons, Paul; Zhang, Zixu
Visual Communication of Potential Anomalies with Boundary Lines in ISS Mission Control Workshop
IEEE VIS Workshop on Visualization for Communication (VisComm ’22), Late-Breaking Work, 2022.
@workshop{Parsons2022,
title = {Visual Communication of Potential Anomalies with Boundary Lines in ISS Mission Control},
author = {Paul Parsons and Zixu Zhang},
url = {https://www.dvclab.net/wp-content/uploads/2023/08/Parsons-Zhang-2022-VisComm-Boundary-Lines.pdf, Parsons and Zhang - 2022 - Boundary Lines [PAPER]},
year = {2022},
date = {2022-10-17},
urldate = {2022-10-17},
booktitle = { IEEE VIS Workshop on Visualization for Communication (VisComm ’22), Late-Breaking Work},
keywords = {},
pubstate = {published},
tppubtype = {workshop}
}
Parsons, Paul; Zhang, Zixu; Murray, Jackson
Adaptive Performance: A Generative Theory for HCI Design in Extraterrestrial Habitats Workshop
SpaceCHI 2.0: Advancing Human-Computer Interaction for Space Exploration. A Workshop at ACM CHI 2022, 2022.
@workshop{Parsonsetal-2022-AdaptivePerformance,
title = {Adaptive Performance: A Generative Theory for HCI Design in Extraterrestrial Habitats},
author = {Paul Parsons and Zixu Zhang and Jackson Murray},
url = {https://www.dvclab.net/wp-content/uploads/2022/04/SpaceCHI_2022-2.pdf, Parsons et al. - 2022 - Adaptive Performance SpaceCHI [PAPER]},
year = {2022},
date = {2022-04-30},
urldate = {2022-04-30},
booktitle = {SpaceCHI 2.0: Advancing Human-Computer Interaction for Space Exploration. A Workshop at ACM CHI 2022},
keywords = {},
pubstate = {published},
tppubtype = {workshop}
}
2018
Parsons, Paul
Promoting Representational Fluency for Cognitive Bias Mitigation in Information Visualization Book Section
In: Ellis, Geoffrey (Ed.): Cognitive Biases in Visualizations, pp. 137–147, Springer International Publishing, Cham, 2018, ISBN: 978-3-319-95830-9 978-3-319-95831-6.
@incollection{ellis_promoting_2018,
title = {Promoting Representational Fluency for Cognitive Bias Mitigation in Information Visualization},
author = {Paul Parsons},
editor = {Geoffrey Ellis},
url = {https://www.dvclab.net/wp-content/uploads/2021/10/Parsons2018_Chapter_PromotingRepresentationalFluen-2.pdf, Parsons - 2018 - Promoting Representational Fluency [PDF]},
doi = {10.1007/978-3-319-95831-6_10},
isbn = {978-3-319-95830-9 978-3-319-95831-6},
year = {2018},
date = {2018-01-01},
urldate = {2018-01-01},
booktitle = {Cognitive Biases in Visualizations},
pages = {137--147},
publisher = {Springer International Publishing},
address = {Cham},
keywords = {},
pubstate = {published},
tppubtype = {incollection}
}
Parsons, Paul
Conceptual Metaphor Theory as a Foundation for Communicative Visualization Design Conference
IEEE VIS Workshop on Visualization for Communication (VisComm), Berlin, Germany, 2018.
@conference{parsons_conceptual_2018,
title = {Conceptual Metaphor Theory as a Foundation for Communicative Visualization Design},
author = {Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2019/02/Parsons-Conceptual-Metaphor-Theory-as-a-Foundation-for-Com.pdf, Parsons - 2018 - Conceptual Metaphor Theory},
year = {2018},
date = {2018-01-01},
booktitle = {IEEE VIS Workshop on Visualization for Communication (VisComm)},
pages = {6},
address = {Berlin, Germany},
abstract = {Interest in communicative visualization has been growing in recent years. However, despite this growth, a solid theoretical foundation has not been established. In this paper I examine the role that conceptual metaphor theory may contribute to such a foundation. I present a brief background on conceptual metaphor theory, including a discussion on image schemas, conceptual metaphors, and embodied cognition. I speculate on the role of conceptual metaphor for explaining and (re)designing communicative visualizations by providing and discussing a small set of examples as anecdotal evidence of the possible value of conceptual metaphor. Finally, I discuss implications of conceptual metaphor theory for communicative visualization design and present some ideas for future research on this topic.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Interest in communicative visualization has been growing in recent years. However, despite this growth, a solid theoretical foundation has not been established. In this paper I examine the role that conceptual metaphor theory may contribute to such a foundation. I present a brief background on conceptual metaphor theory, including a discussion on image schemas, conceptual metaphors, and embodied cognition. I speculate on the role of conceptual metaphor for explaining and (re)designing communicative visualizations by providing and discussing a small set of examples as anecdotal evidence of the possible value of conceptual metaphor. Finally, I discuss implications of conceptual metaphor theory for communicative visualization design and present some ideas for future research on this topic. Baigelenov, Ali; Parsons, Paul
Interactivity Factors in Visualization-Based Exploratory Search Conference
Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW), CHI EA '18 ACM, New York, NY, USA, 2018, ISBN: 978-1-4503-5621-3.
@conference{baigelenov_interactivity_2018,
title = {Interactivity Factors in Visualization-Based Exploratory Search},
author = {Ali Baigelenov and Paul Parsons},
url = {http://doi.acm.org/10.1145/3170427.3188558},
doi = {10.1145/3170427.3188558},
isbn = {978-1-4503-5621-3},
year = {2018},
date = {2018-01-01},
urldate = {2019-01-25},
booktitle = {Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW)},
pages = {LBW009:1--LBW009:6},
publisher = {ACM},
address = {New York, NY, USA},
series = {CHI EA '18},
abstract = {Designing interactive visualizations is challenging, especially in complex, open-ended contexts. Although numerous interaction techniques have been developed, there is a lack of holistic theoretical guidance in the visualization literature on designing interactivity, where interactivity refers to the overall quality of interaction between a user and a visualization tool. In this work, we aim to contribute to a deeper understanding of the design and evaluation of interactivity by exploring user perceptions in an exploratory context. We report the findings of a lab study and reflect on its potential implications for visualization designers and researchers.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Designing interactive visualizations is challenging, especially in complex, open-ended contexts. Although numerous interaction techniques have been developed, there is a lack of holistic theoretical guidance in the visualization literature on designing interactivity, where interactivity refers to the overall quality of interaction between a user and a visualization tool. In this work, we aim to contribute to a deeper understanding of the design and evaluation of interactivity by exploring user perceptions in an exploratory context. We report the findings of a lab study and reflect on its potential implications for visualization designers and researchers.2017
Saenz, Michael; Baigelenov, Ali; Hung, Ya-Hsin; Parsons, Paul
Reexamining the cognitive utility of 3D visualizations using augmented reality holograms Proceedings Article
In: IEEE VIS Workshop on Immersive Analytics, pp. 5, Phoenix, AZ, 2017.
@inproceedings{saenz_reexamining_2017,
title = {Reexamining the cognitive utility of 3D visualizations using augmented reality holograms},
author = {Michael Saenz and Ali Baigelenov and Ya-Hsin Hung and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2020/02/Saenz-et-al.-2017-Reexamining-the-cognitive-utility-of-3D-visualizations-using-augmented-reality-holograms.pdf},
year = {2017},
date = {2017-10-01},
booktitle = {IEEE VIS Workshop on Immersive Analytics},
pages = {5},
address = {Phoenix, AZ},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Baigelenov, Ali; Saenz, Michael; Hung, Ya-Hsin; Parsons, Paul
Toward an Understanding of Observational Advantages in Information Visualization Conference
IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts, Phoenix, AZ, 2017.
@conference{baigelenov_toward_2017,
title = {Toward an Understanding of Observational Advantages in Information Visualization},
author = {Ali Baigelenov and Michael Saenz and Ya-Hsin Hung and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2019/02/Baigelenov-et-al.-Toward-an-Understanding-of-Observational-Advantage.pdf},
year = {2017},
date = {2017-10-01},
booktitle = {IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts},
pages = {3},
address = {Phoenix, AZ},
abstract = {Visualizations act as cognitive aids by making reasoning tractable. To choose an appropriate visualization, designers need to know about the cognitive advantages and disadvantages of different visualization techniques. While considerable research has focused on low-level perceptual issues related to visual encodings and judgments, less research has focused on the cognitive operations that are supported by visualization techniques. We conducted a pilot study using mixed methods to uncover properties of some common visualization techniques that allow propositional statements to be directly observed rather than indirectly inferred. We describe the results of our study and discuss potential benefits of this line of research to visualization designers and researchers.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Visualizations act as cognitive aids by making reasoning tractable. To choose an appropriate visualization, designers need to know about the cognitive advantages and disadvantages of different visualization techniques. While considerable research has focused on low-level perceptual issues related to visual encodings and judgments, less research has focused on the cognitive operations that are supported by visualization techniques. We conducted a pilot study using mixed methods to uncover properties of some common visualization techniques that allow propositional statements to be directly observed rather than indirectly inferred. We describe the results of our study and discuss potential benefits of this line of research to visualization designers and researchers. Hung, Ya-Hsin; Parsons, Paul
Evaluating User Engagement in Information Visualization Using Mixed Methods Proceedings Article
In: IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts, pp. 2, Phoenix, AZ, 2017.
@inproceedings{hung_evaluating_2017,
title = {Evaluating User Engagement in Information Visualization Using Mixed Methods},
author = {Ya-Hsin Hung and Paul Parsons},
year = {2017},
date = {2017-10-01},
booktitle = {IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts},
pages = {2},
address = {Phoenix, AZ},
abstract = {Engagement is an important aspect of user experience, yet its evaluation has not received much attention in the InfoVis literature. For visualization design and evaluation, it is useful to understand both the characteristics of user engagement and how engagement develops and changes over time. We describe a study that used a mixed-methods approach to evaluate user engagement with two different types of visualizations. Multiple qualitative and quantitative methods—including think aloud, eye-tracking, questionnaires, and interviews—were employed. We report initial results involving verbal protocols and eye-tracking data. We reflect on the findings and discuss plans for further data analysis and future research.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Engagement is an important aspect of user experience, yet its evaluation has not received much attention in the InfoVis literature. For visualization design and evaluation, it is useful to understand both the characteristics of user engagement and how engagement develops and changes over time. We describe a study that used a mixed-methods approach to evaluate user engagement with two different types of visualizations. Multiple qualitative and quantitative methods—including think aloud, eye-tracking, questionnaires, and interviews—were employed. We report initial results involving verbal protocols and eye-tracking data. We reflect on the findings and discuss plans for further data analysis and future research. Hung, Ya-Hsin; Parsons, Paul
Assessing User Engagement in Information Visualization Proceedings Article
In: Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW), pp. 1708–1717, ACM, New York, NY, USA, 2017, ISBN: 978-1-4503-4656-6.
@inproceedings{hung_assessing_2017,
title = {Assessing User Engagement in Information Visualization},
author = {Ya-Hsin Hung and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2022/10/Hung-Parsons-2017-Assessing-User-Engagement.pdf, Hung & Parsons - 2017 - Assessing User Engagement [PAPER]},
doi = {10.1145/3027063.3053113},
isbn = {978-1-4503-4656-6},
year = {2017},
date = {2017-01-01},
urldate = {2017-01-01},
booktitle = {Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW)},
pages = {1708--1717},
publisher = {ACM},
address = {New York, NY, USA},
series = {CHI EA '17},
abstract = {Engagement is an important aspect of user experience. While some researchers have investigated user engagement in the context of information visualization, there is still a lack of scholarship on the topic. In this paper we briefly explore the role and significance of user engagement in information visualization, and discuss challenges in its characterization and assessment. We present VisEngage, a self-assessment questionnaire that provides insight into 11 different characteristics of user engagement. We report the results of an online pilot study that was conducted using VisEngage, and reflect on its potential utility for visualization researchers and designers.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Engagement is an important aspect of user experience. While some researchers have investigated user engagement in the context of information visualization, there is still a lack of scholarship on the topic. In this paper we briefly explore the role and significance of user engagement in information visualization, and discuss challenges in its characterization and assessment. We present VisEngage, a self-assessment questionnaire that provides insight into 11 different characteristics of user engagement. We report the results of an online pilot study that was conducted using VisEngage, and reflect on its potential utility for visualization researchers and designers.2016
Sedig, Kamran; Parsons, Paul; Liang, Hai-Ning; Morey, Jim
Supporting Sensemaking of Complex Objects with Visualizations: Visibility and Complementarity of Interactions Journal Article
In: Informatics, vol. 3, no. 4, pp. 20, 2016.
@article{sedig_supporting_2016,
title = {Supporting Sensemaking of Complex Objects with Visualizations: Visibility and Complementarity of Interactions},
author = {Kamran Sedig and Paul Parsons and Hai-Ning Liang and Jim Morey},
url = {https://www.mdpi.com/2227-9709/3/4/20},
doi = {10.3390/informatics3040020},
year = {2016},
date = {2016-01-01},
urldate = {2019-01-25},
journal = {Informatics},
volume = {3},
number = {4},
pages = {20},
abstract = {Making sense of complex objects is difficult, and typically requires the use of external representations to support cognitive demands while reasoning about the objects. Visualizations are one type of external representation that can be used to support sensemaking activities. In this paper, we investigate the role of two design strategies in making the interactive features of visualizations more supportive of users’ exploratory needs when trying to make sense of complex objects. These two strategies are visibility and complementarity of interactions. We employ a theoretical framework concerned with human–information interaction and complex cognitive activities to inform, contextualize, and interpret the effects of the design strategies. The two strategies are incorporated in the design of Polyvise, a visualization tool that supports making sense of complex four-dimensional geometric objects. A mixed-methods study was conducted to evaluate the design strategies and the overall usability of Polyvise. We report the findings of the study, discuss some implications for the design of visualization tools that support sensemaking of complex objects, and propose five design guidelines. We anticipate that our results are transferrable to other contexts, and that these two design strategies can be used broadly in visualization tools intended to support activities with complex objects and information spaces.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Making sense of complex objects is difficult, and typically requires the use of external representations to support cognitive demands while reasoning about the objects. Visualizations are one type of external representation that can be used to support sensemaking activities. In this paper, we investigate the role of two design strategies in making the interactive features of visualizations more supportive of users’ exploratory needs when trying to make sense of complex objects. These two strategies are visibility and complementarity of interactions. We employ a theoretical framework concerned with human–information interaction and complex cognitive activities to inform, contextualize, and interpret the effects of the design strategies. The two strategies are incorporated in the design of Polyvise, a visualization tool that supports making sense of complex four-dimensional geometric objects. A mixed-methods study was conducted to evaluate the design strategies and the overall usability of Polyvise. We report the findings of the study, discuss some implications for the design of visualization tools that support sensemaking of complex objects, and propose five design guidelines. We anticipate that our results are transferrable to other contexts, and that these two design strategies can be used broadly in visualization tools intended to support activities with complex objects and information spaces.2014
Sedig, Kamran; Parsons, Paul; Dittmer, Mark; Haworth, Robert
Human-centered interactivity of visualization tools: Micro- and macro-level considerations Book Chapter
In: Huang, Weidong (Ed.): Handbook of Human-Centric Visualization, pp. 717–743, Springer, New York, 2014.
@inbook{Sedig2012a,
title = {Human-centered interactivity of visualization tools: Micro- and macro-level considerations},
author = {Kamran Sedig and Paul Parsons and Mark Dittmer and Robert Haworth},
editor = {Weidong Huang},
doi = {10.1007/978-1-4614-7485-2 29},
year = {2014},
date = {2014-01-01},
booktitle = {Handbook of Human-Centric Visualization},
pages = {717--743},
publisher = {Springer},
address = {New York},
abstract = {Visualization tools can support and enhance the performance of complex cognitive activities such as sensemaking, problemsolving, and analytical reasoning. To do so effectively, however, a human-centered approach to their design and eval- uation is required. One way to make visualization tools human-centered is to make them interactive. Although interaction allows a user to adjust the features of the tool to suit his or her cognitive and contextual needs, it is the quality of interaction that largely determines how well complexcognitive activities are supported. In this chapter, interactivity is conceptualized as the quality of interaction. As interactivity is a broad and complex construct, we categorize it into two levels: micro and macro. Interactivity at the micro level emerges from the structural elements of individual interactions. Interactivity at the macro level emerges from the combi- nation, sequencing, and aggregate properties and relationships of interactions as a user performs an activity. Twelvemicro-level interactivity elements and five macro- level interactivity factors are identified andcharacterized. The framework presented in this chapter can provide some structure and facilitate a systematic approach to design and evaluation of interactivity in human-centered visualization tools.},
keywords = {},
pubstate = {published},
tppubtype = {inbook}
}
Visualization tools can support and enhance the performance of complex cognitive activities such as sensemaking, problemsolving, and analytical reasoning. To do so effectively, however, a human-centered approach to their design and eval- uation is required. One way to make visualization tools human-centered is to make them interactive. Although interaction allows a user to adjust the features of the tool to suit his or her cognitive and contextual needs, it is the quality of interaction that largely determines how well complexcognitive activities are supported. In this chapter, interactivity is conceptualized as the quality of interaction. As interactivity is a broad and complex construct, we categorize it into two levels: micro and macro. Interactivity at the micro level emerges from the structural elements of individual interactions. Interactivity at the macro level emerges from the combi- nation, sequencing, and aggregate properties and relationships of interactions as a user performs an activity. Twelvemicro-level interactivity elements and five macro- level interactivity factors are identified andcharacterized. The framework presented in this chapter can provide some structure and facilitate a systematic approach to design and evaluation of interactivity in human-centered visualization tools. Parsons, Paul; Sedig, Kamran
Distribution of Information Processing while Performing Complex Cognitive Activities with Visualization Tools Book Chapter
In: Huang, Weidong (Ed.): Handbook of Human-Centric Visualization, pp. 693–715, Springer, New York, 2014.
@inbook{Parsons2013,
title = {Distribution of Information Processing while Performing Complex Cognitive Activities with Visualization Tools},
author = {Paul Parsons and Kamran Sedig},
editor = {Weidong Huang},
doi = {10.1007/978-1-4614-7485-2 28},
year = {2014},
date = {2014-01-01},
booktitle = {Handbook of Human-Centric Visualization},
pages = {693--715},
publisher = {Springer},
address = {New York},
abstract = {When using visualization tools to perform complex cognitive activities, such as sense-making, analytical reasoning, and learning, human users and visu- alization tools form a joint cognitive system. Through processing and transfer of informationwithin and among the components of this system, complex problems are solved, complex decisions are made, and complex cognitive processes emerge—all in a manner that would not be easily performable by the human or the visualization tool alone. Although researchers have recognized this, no systematic treatment of how to best distribute the information-processing load during the performance of complex cognitive activities is available in the existing literature. While previous research has identified some relevant principles that shed light on this issue, the pertinent research findings are not integrated into coherent models and frameworks, and are scattered acrossmany disciplines, such as cognitive psychology, educational psychology, information visualization, data analytics, and computer science. This chapter provides an initial examination of this issue by identifying and discussing some key concerns, integrating some fundamental concepts, and highlighting some current research gaps that require future study. The issues examined in this chapter are of importance to many domains, including visual analytics, data and information visualization, human-informationinteraction, educational and cognitive technologies, and human-computer interaction design. The approach taken in this chapter is human-centered, focusing on the distribution of information processing with the ultimate purpose of supporting the complex cognitive activities of human users of visualization tools.},
keywords = {},
pubstate = {published},
tppubtype = {inbook}
}
When using visualization tools to perform complex cognitive activities, such as sense-making, analytical reasoning, and learning, human users and visu- alization tools form a joint cognitive system. Through processing and transfer of informationwithin and among the components of this system, complex problems are solved, complex decisions are made, and complex cognitive processes emerge—all in a manner that would not be easily performable by the human or the visualization tool alone. Although researchers have recognized this, no systematic treatment of how to best distribute the information-processing load during the performance of complex cognitive activities is available in the existing literature. While previous research has identified some relevant principles that shed light on this issue, the pertinent research findings are not integrated into coherent models and frameworks, and are scattered acrossmany disciplines, such as cognitive psychology, educational psychology, information visualization, data analytics, and computer science. This chapter provides an initial examination of this issue by identifying and discussing some key concerns, integrating some fundamental concepts, and highlighting some current research gaps that require future study. The issues examined in this chapter are of importance to many domains, including visual analytics, data and information visualization, human-informationinteraction, educational and cognitive technologies, and human-computer interaction design. The approach taken in this chapter is human-centered, focusing on the distribution of information processing with the ultimate purpose of supporting the complex cognitive activities of human users of visualization tools. Parsons, Paul; Sedig, Kamran
Common visualizations: Their cognitive utility Book Chapter
In: Huang, Weidong (Ed.): Handbook of Human-Centric Visualization, pp. 671–691, Springer, New York, 2014.
@inbook{Parsons-Common,
title = {Common visualizations: Their cognitive utility},
author = {Paul Parsons and Kamran Sedig},
editor = {Weidong Huang},
doi = {10.1007/978-1-4614-7485-2 27},
year = {2014},
date = {2014-01-01},
booktitle = {Handbook of Human-Centric Visualization},
pages = {671--691},
publisher = {Springer},
address = {New York},
abstract = {Visualizations have numerous benefits for problem solving, sense mak- ing, decision making, learning, analytical reasoning, and other high-level cognitive activities. Research in cognitive science has demonstrated that visualizations fun- damentally influence cognitive processing and the overall performance of such aforementioned activities. However, although researchers often suggest that visu- alizations support, enhance, and/or amplify cognition, little research has examined the cognitive utility of different visualizations in a systematic and comprehensive manner. Rather, visualization research is often focused only on low-level cognitive and perceptual issues. To design visualizations that effectively support high-level cognitive activities, a strong understanding of the cognitive effects of different visual forms is required. To examine thisissue, this chapter draws on research from a number of relevant domains, including information and data visualization, visual analytics, cognitive and perceptual psychology, and diagrammatic reasoning. This chapter identifies and clarifies some important terms and discusses the current state of research and practice. In addition, a number of common visualizations are identified, their cognitive and perceptual influences are examined, and some implications for the performance of high-level cognitive activities are discussed. Readers from various fields in which a human-centered approach to visualization is necessary, such as health informatics, data and information visualization, visual analytics, journalism, education, and human-information interaction,will likely find this chapter a useful reference for research, design, and/or evaluation purposes. P.},
keywords = {},
pubstate = {published},
tppubtype = {inbook}
}
Visualizations have numerous benefits for problem solving, sense mak- ing, decision making, learning, analytical reasoning, and other high-level cognitive activities. Research in cognitive science has demonstrated that visualizations fun- damentally influence cognitive processing and the overall performance of such aforementioned activities. However, although researchers often suggest that visu- alizations support, enhance, and/or amplify cognition, little research has examined the cognitive utility of different visualizations in a systematic and comprehensive manner. Rather, visualization research is often focused only on low-level cognitive and perceptual issues. To design visualizations that effectively support high-level cognitive activities, a strong understanding of the cognitive effects of different visual forms is required. To examine thisissue, this chapter draws on research from a number of relevant domains, including information and data visualization, visual analytics, cognitive and perceptual psychology, and diagrammatic reasoning. This chapter identifies and clarifies some important terms and discusses the current state of research and practice. In addition, a number of common visualizations are identified, their cognitive and perceptual influences are examined, and some implications for the performance of high-level cognitive activities are discussed. Readers from various fields in which a human-centered approach to visualization is necessary, such as health informatics, data and information visualization, visual analytics, journalism, education, and human-information interaction,will likely find this chapter a useful reference for research, design, and/or evaluation purposes. P. Parsons, Paul; Sedig, Kamran
Adjustable properties of visual representations: Improving the quality of human-information interaction Journal Article
In: Journal of the Association for Information Science and Technology, vol. 65, no. 3, pp. 455–482, 2014, ISSN: 23301635, (arXiv: 0803.1716
ISBN: 978-0-88986-920-2).
@article{Parsons2012ab,
title = {Adjustable properties of visual representations: Improving the quality of human-information interaction},
author = {Paul Parsons and Kamran Sedig},
url = {http://doi.wiley.com/10.1002/asi.23002},
doi = {10.1002/asi.23002},
issn = {23301635},
year = {2014},
date = {2014-01-01},
urldate = {2014-01-16},
journal = {Journal of the Association for Information Science and Technology},
volume = {65},
number = {3},
pages = {455--482},
abstract = {Complex cognitive activities, such as analytical reasoning, problem solving, and sense making, are often performed through the mediation of interactive computational tools. Examples include visual analytics, decision support, and educational tools. Through interaction with visual representations of information at the visual interface of these tools, a joint, coordinated cognitive system is formed. This partnership results in a number of relational properties—those depending on both humans and tools—that researchers and designers must be aware of if such tools are to effectively support the performance of complex cognitive activities. This article presents 10 properties of interactive visual representations that are essential and relational and whose values can be adjusted through interaction. By adjusting the values of these properties, better coordination between humans and tools can be effected, leading to higher quality performance of complex cognitive activities. This article examines how the values of these properties affect cognitive processing and visual reasoning and demonstrates the necessity of making their values adjustable—all of which is situated within a broader theoretical framework concerned with human-information interaction in complex cognitive activities. This framework can facilitate systematic research, design, and evaluation in numerous fields including information visualization, health informatics, visual analytics, and educational technology.},
note = {arXiv: 0803.1716
ISBN: 978-0-88986-920-2},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Complex cognitive activities, such as analytical reasoning, problem solving, and sense making, are often performed through the mediation of interactive computational tools. Examples include visual analytics, decision support, and educational tools. Through interaction with visual representations of information at the visual interface of these tools, a joint, coordinated cognitive system is formed. This partnership results in a number of relational properties—those depending on both humans and tools—that researchers and designers must be aware of if such tools are to effectively support the performance of complex cognitive activities. This article presents 10 properties of interactive visual representations that are essential and relational and whose values can be adjusted through interaction. By adjusting the values of these properties, better coordination between humans and tools can be effected, leading to higher quality performance of complex cognitive activities. This article examines how the values of these properties affect cognitive processing and visual reasoning and demonstrates the necessity of making their values adjustable—all of which is situated within a broader theoretical framework concerned with human-information interaction in complex cognitive activities. This framework can facilitate systematic research, design, and evaluation in numerous fields including information visualization, health informatics, visual analytics, and educational technology.2013
Sedig, Kamran; Parsons, Paul
Interaction Design for Complex Cognitive Activities with Visual Representations: A Pattern-Based Approach Journal Article
In: AIS Transactions on Human-Computer Interaction, vol. 5, no. 2, pp. 84–133, 2013.
@article{Sedig2013,
title = {Interaction Design for Complex Cognitive Activities with Visual Representations: A Pattern-Based Approach},
author = {Kamran Sedig and Paul Parsons},
url = {http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1057&context=thci},
year = {2013},
date = {2013-01-01},
journal = {AIS Transactions on Human-Computer Interaction},
volume = {5},
number = {2},
pages = {84--133},
abstract = {This paper is concerned with interaction design for visualization-based computational tools that support the performance of complex cognitive activities, such as analytical reasoning, sense making, decision making, problem solving, learning, planning, and knowledge discovery. In this paper, a number of foundational concepts related to interaction and complex cognitive activities are syncretized into a coherent theoretical framework. This framework is general, in the sense that it is applicable to all technologies, platforms, tools, users, activities, and visual representations. Included in the framework is a catalog of 32 fundamental epistemic action patterns, with each action pattern being characterized and examined in terms of its utility in supporting different complex cognitive activities. This catalog of action patterns is comprehensive, covering a broad range of interactions that are performed by a diverse group of users for all kinds of tasks and activities. The presented framework is also generative, in that it can stimulate creativity and innovation in research and design for a number of domains and disciplines, including data and information visualization, visual analytics, digital libraries, health informatics, learning sciences and technologies, personal information management, decision support, information systems, and knowledge management.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
This paper is concerned with interaction design for visualization-based computational tools that support the performance of complex cognitive activities, such as analytical reasoning, sense making, decision making, problem solving, learning, planning, and knowledge discovery. In this paper, a number of foundational concepts related to interaction and complex cognitive activities are syncretized into a coherent theoretical framework. This framework is general, in the sense that it is applicable to all technologies, platforms, tools, users, activities, and visual representations. Included in the framework is a catalog of 32 fundamental epistemic action patterns, with each action pattern being characterized and examined in terms of its utility in supporting different complex cognitive activities. This catalog of action patterns is comprehensive, covering a broad range of interactions that are performed by a diverse group of users for all kinds of tasks and activities. The presented framework is also generative, in that it can stimulate creativity and innovation in research and design for a number of domains and disciplines, including data and information visualization, visual analytics, digital libraries, health informatics, learning sciences and technologies, personal information management, decision support, information systems, and knowledge management.
2023
Zhang, Zixu; Parsons, Paul
Designing Visual Displays for Deep Space Habitats: Challenges and Opportunities from a Cognitive Task Analysis with ISS Conference Forthcoming
Proceedings of the 67th Human Factors and Ergonomics Society Annual Meeting, Forthcoming.
@conference{ZhangParsonsHFES2023,
title = {Designing Visual Displays for Deep Space Habitats: Challenges and Opportunities from a Cognitive Task Analysis with ISS},
author = {Zixu Zhang and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2023/08/ZhangParsons-2023-HFES-Challenges-and-Opportunities.pdf, Zhang and Parsons - 2023 - Visual Displays for Deep Space Habitats [paper]},
year = {2023},
date = {2023-10-16},
urldate = {2023-10-16},
booktitle = {Proceedings of the 67th Human Factors and Ergonomics Society Annual Meeting},
keywords = {},
pubstate = {forthcoming},
tppubtype = {conference}
}
2022
Parsons, Paul; Zhang, Zixu
Visual Communication of Potential Anomalies with Boundary Lines in ISS Mission Control Workshop
IEEE VIS Workshop on Visualization for Communication (VisComm ’22), Late-Breaking Work, 2022.
@workshop{Parsons2022,
title = {Visual Communication of Potential Anomalies with Boundary Lines in ISS Mission Control},
author = {Paul Parsons and Zixu Zhang},
url = {https://www.dvclab.net/wp-content/uploads/2023/08/Parsons-Zhang-2022-VisComm-Boundary-Lines.pdf, Parsons and Zhang - 2022 - Boundary Lines [PAPER]},
year = {2022},
date = {2022-10-17},
urldate = {2022-10-17},
booktitle = { IEEE VIS Workshop on Visualization for Communication (VisComm ’22), Late-Breaking Work},
keywords = {},
pubstate = {published},
tppubtype = {workshop}
}
Parsons, Paul; Zhang, Zixu; Murray, Jackson
Adaptive Performance: A Generative Theory for HCI Design in Extraterrestrial Habitats Workshop
SpaceCHI 2.0: Advancing Human-Computer Interaction for Space Exploration. A Workshop at ACM CHI 2022, 2022.
@workshop{Parsonsetal-2022-AdaptivePerformance,
title = {Adaptive Performance: A Generative Theory for HCI Design in Extraterrestrial Habitats},
author = {Paul Parsons and Zixu Zhang and Jackson Murray},
url = {https://www.dvclab.net/wp-content/uploads/2022/04/SpaceCHI_2022-2.pdf, Parsons et al. - 2022 - Adaptive Performance SpaceCHI [PAPER]},
year = {2022},
date = {2022-04-30},
urldate = {2022-04-30},
booktitle = {SpaceCHI 2.0: Advancing Human-Computer Interaction for Space Exploration. A Workshop at ACM CHI 2022},
keywords = {},
pubstate = {published},
tppubtype = {workshop}
}
2018
Parsons, Paul
Promoting Representational Fluency for Cognitive Bias Mitigation in Information Visualization Book Section
In: Ellis, Geoffrey (Ed.): Cognitive Biases in Visualizations, pp. 137–147, Springer International Publishing, Cham, 2018, ISBN: 978-3-319-95830-9 978-3-319-95831-6.
@incollection{ellis_promoting_2018,
title = {Promoting Representational Fluency for Cognitive Bias Mitigation in Information Visualization},
author = {Paul Parsons},
editor = {Geoffrey Ellis},
url = {https://www.dvclab.net/wp-content/uploads/2021/10/Parsons2018_Chapter_PromotingRepresentationalFluen-2.pdf, Parsons - 2018 - Promoting Representational Fluency [PDF]},
doi = {10.1007/978-3-319-95831-6_10},
isbn = {978-3-319-95830-9 978-3-319-95831-6},
year = {2018},
date = {2018-01-01},
urldate = {2018-01-01},
booktitle = {Cognitive Biases in Visualizations},
pages = {137--147},
publisher = {Springer International Publishing},
address = {Cham},
keywords = {},
pubstate = {published},
tppubtype = {incollection}
}
Parsons, Paul
Conceptual Metaphor Theory as a Foundation for Communicative Visualization Design Conference
IEEE VIS Workshop on Visualization for Communication (VisComm), Berlin, Germany, 2018.
@conference{parsons_conceptual_2018,
title = {Conceptual Metaphor Theory as a Foundation for Communicative Visualization Design},
author = {Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2019/02/Parsons-Conceptual-Metaphor-Theory-as-a-Foundation-for-Com.pdf, Parsons - 2018 - Conceptual Metaphor Theory},
year = {2018},
date = {2018-01-01},
booktitle = {IEEE VIS Workshop on Visualization for Communication (VisComm)},
pages = {6},
address = {Berlin, Germany},
abstract = {Interest in communicative visualization has been growing in recent years. However, despite this growth, a solid theoretical foundation has not been established. In this paper I examine the role that conceptual metaphor theory may contribute to such a foundation. I present a brief background on conceptual metaphor theory, including a discussion on image schemas, conceptual metaphors, and embodied cognition. I speculate on the role of conceptual metaphor for explaining and (re)designing communicative visualizations by providing and discussing a small set of examples as anecdotal evidence of the possible value of conceptual metaphor. Finally, I discuss implications of conceptual metaphor theory for communicative visualization design and present some ideas for future research on this topic.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Interest in communicative visualization has been growing in recent years. However, despite this growth, a solid theoretical foundation has not been established. In this paper I examine the role that conceptual metaphor theory may contribute to such a foundation. I present a brief background on conceptual metaphor theory, including a discussion on image schemas, conceptual metaphors, and embodied cognition. I speculate on the role of conceptual metaphor for explaining and (re)designing communicative visualizations by providing and discussing a small set of examples as anecdotal evidence of the possible value of conceptual metaphor. Finally, I discuss implications of conceptual metaphor theory for communicative visualization design and present some ideas for future research on this topic.
Baigelenov, Ali; Parsons, Paul
Interactivity Factors in Visualization-Based Exploratory Search Conference
Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW), CHI EA '18 ACM, New York, NY, USA, 2018, ISBN: 978-1-4503-5621-3.
@conference{baigelenov_interactivity_2018,
title = {Interactivity Factors in Visualization-Based Exploratory Search},
author = {Ali Baigelenov and Paul Parsons},
url = {http://doi.acm.org/10.1145/3170427.3188558},
doi = {10.1145/3170427.3188558},
isbn = {978-1-4503-5621-3},
year = {2018},
date = {2018-01-01},
urldate = {2019-01-25},
booktitle = {Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW)},
pages = {LBW009:1--LBW009:6},
publisher = {ACM},
address = {New York, NY, USA},
series = {CHI EA '18},
abstract = {Designing interactive visualizations is challenging, especially in complex, open-ended contexts. Although numerous interaction techniques have been developed, there is a lack of holistic theoretical guidance in the visualization literature on designing interactivity, where interactivity refers to the overall quality of interaction between a user and a visualization tool. In this work, we aim to contribute to a deeper understanding of the design and evaluation of interactivity by exploring user perceptions in an exploratory context. We report the findings of a lab study and reflect on its potential implications for visualization designers and researchers.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Designing interactive visualizations is challenging, especially in complex, open-ended contexts. Although numerous interaction techniques have been developed, there is a lack of holistic theoretical guidance in the visualization literature on designing interactivity, where interactivity refers to the overall quality of interaction between a user and a visualization tool. In this work, we aim to contribute to a deeper understanding of the design and evaluation of interactivity by exploring user perceptions in an exploratory context. We report the findings of a lab study and reflect on its potential implications for visualization designers and researchers.
2017
Saenz, Michael; Baigelenov, Ali; Hung, Ya-Hsin; Parsons, Paul
Reexamining the cognitive utility of 3D visualizations using augmented reality holograms Proceedings Article
In: IEEE VIS Workshop on Immersive Analytics, pp. 5, Phoenix, AZ, 2017.
@inproceedings{saenz_reexamining_2017,
title = {Reexamining the cognitive utility of 3D visualizations using augmented reality holograms},
author = {Michael Saenz and Ali Baigelenov and Ya-Hsin Hung and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2020/02/Saenz-et-al.-2017-Reexamining-the-cognitive-utility-of-3D-visualizations-using-augmented-reality-holograms.pdf},
year = {2017},
date = {2017-10-01},
booktitle = {IEEE VIS Workshop on Immersive Analytics},
pages = {5},
address = {Phoenix, AZ},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Baigelenov, Ali; Saenz, Michael; Hung, Ya-Hsin; Parsons, Paul
Toward an Understanding of Observational Advantages in Information Visualization Conference
IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts, Phoenix, AZ, 2017.
@conference{baigelenov_toward_2017,
title = {Toward an Understanding of Observational Advantages in Information Visualization},
author = {Ali Baigelenov and Michael Saenz and Ya-Hsin Hung and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2019/02/Baigelenov-et-al.-Toward-an-Understanding-of-Observational-Advantage.pdf},
year = {2017},
date = {2017-10-01},
booktitle = {IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts},
pages = {3},
address = {Phoenix, AZ},
abstract = {Visualizations act as cognitive aids by making reasoning tractable. To choose an appropriate visualization, designers need to know about the cognitive advantages and disadvantages of different visualization techniques. While considerable research has focused on low-level perceptual issues related to visual encodings and judgments, less research has focused on the cognitive operations that are supported by visualization techniques. We conducted a pilot study using mixed methods to uncover properties of some common visualization techniques that allow propositional statements to be directly observed rather than indirectly inferred. We describe the results of our study and discuss potential benefits of this line of research to visualization designers and researchers.},
keywords = {},
pubstate = {published},
tppubtype = {conference}
}
Visualizations act as cognitive aids by making reasoning tractable. To choose an appropriate visualization, designers need to know about the cognitive advantages and disadvantages of different visualization techniques. While considerable research has focused on low-level perceptual issues related to visual encodings and judgments, less research has focused on the cognitive operations that are supported by visualization techniques. We conducted a pilot study using mixed methods to uncover properties of some common visualization techniques that allow propositional statements to be directly observed rather than indirectly inferred. We describe the results of our study and discuss potential benefits of this line of research to visualization designers and researchers.
Hung, Ya-Hsin; Parsons, Paul
Evaluating User Engagement in Information Visualization Using Mixed Methods Proceedings Article
In: IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts, pp. 2, Phoenix, AZ, 2017.
@inproceedings{hung_evaluating_2017,
title = {Evaluating User Engagement in Information Visualization Using Mixed Methods},
author = {Ya-Hsin Hung and Paul Parsons},
year = {2017},
date = {2017-10-01},
booktitle = {IEEE VIS '17: Proceedings of the 2017 IEEE Conference on Information Visualization, Poster Abstracts},
pages = {2},
address = {Phoenix, AZ},
abstract = {Engagement is an important aspect of user experience, yet its evaluation has not received much attention in the InfoVis literature. For visualization design and evaluation, it is useful to understand both the characteristics of user engagement and how engagement develops and changes over time. We describe a study that used a mixed-methods approach to evaluate user engagement with two different types of visualizations. Multiple qualitative and quantitative methods—including think aloud, eye-tracking, questionnaires, and interviews—were employed. We report initial results involving verbal protocols and eye-tracking data. We reflect on the findings and discuss plans for further data analysis and future research.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Engagement is an important aspect of user experience, yet its evaluation has not received much attention in the InfoVis literature. For visualization design and evaluation, it is useful to understand both the characteristics of user engagement and how engagement develops and changes over time. We describe a study that used a mixed-methods approach to evaluate user engagement with two different types of visualizations. Multiple qualitative and quantitative methods—including think aloud, eye-tracking, questionnaires, and interviews—were employed. We report initial results involving verbal protocols and eye-tracking data. We reflect on the findings and discuss plans for further data analysis and future research.
Hung, Ya-Hsin; Parsons, Paul
Assessing User Engagement in Information Visualization Proceedings Article
In: Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW), pp. 1708–1717, ACM, New York, NY, USA, 2017, ISBN: 978-1-4503-4656-6.
@inproceedings{hung_assessing_2017,
title = {Assessing User Engagement in Information Visualization},
author = {Ya-Hsin Hung and Paul Parsons},
url = {https://www.dvclab.net/wp-content/uploads/2022/10/Hung-Parsons-2017-Assessing-User-Engagement.pdf, Hung & Parsons - 2017 - Assessing User Engagement [PAPER]},
doi = {10.1145/3027063.3053113},
isbn = {978-1-4503-4656-6},
year = {2017},
date = {2017-01-01},
urldate = {2017-01-01},
booktitle = {Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI LBW)},
pages = {1708--1717},
publisher = {ACM},
address = {New York, NY, USA},
series = {CHI EA '17},
abstract = {Engagement is an important aspect of user experience. While some researchers have investigated user engagement in the context of information visualization, there is still a lack of scholarship on the topic. In this paper we briefly explore the role and significance of user engagement in information visualization, and discuss challenges in its characterization and assessment. We present VisEngage, a self-assessment questionnaire that provides insight into 11 different characteristics of user engagement. We report the results of an online pilot study that was conducted using VisEngage, and reflect on its potential utility for visualization researchers and designers.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Engagement is an important aspect of user experience. While some researchers have investigated user engagement in the context of information visualization, there is still a lack of scholarship on the topic. In this paper we briefly explore the role and significance of user engagement in information visualization, and discuss challenges in its characterization and assessment. We present VisEngage, a self-assessment questionnaire that provides insight into 11 different characteristics of user engagement. We report the results of an online pilot study that was conducted using VisEngage, and reflect on its potential utility for visualization researchers and designers.
2016
Sedig, Kamran; Parsons, Paul; Liang, Hai-Ning; Morey, Jim
Supporting Sensemaking of Complex Objects with Visualizations: Visibility and Complementarity of Interactions Journal Article
In: Informatics, vol. 3, no. 4, pp. 20, 2016.
@article{sedig_supporting_2016,
title = {Supporting Sensemaking of Complex Objects with Visualizations: Visibility and Complementarity of Interactions},
author = {Kamran Sedig and Paul Parsons and Hai-Ning Liang and Jim Morey},
url = {https://www.mdpi.com/2227-9709/3/4/20},
doi = {10.3390/informatics3040020},
year = {2016},
date = {2016-01-01},
urldate = {2019-01-25},
journal = {Informatics},
volume = {3},
number = {4},
pages = {20},
abstract = {Making sense of complex objects is difficult, and typically requires the use of external representations to support cognitive demands while reasoning about the objects. Visualizations are one type of external representation that can be used to support sensemaking activities. In this paper, we investigate the role of two design strategies in making the interactive features of visualizations more supportive of users’ exploratory needs when trying to make sense of complex objects. These two strategies are visibility and complementarity of interactions. We employ a theoretical framework concerned with human–information interaction and complex cognitive activities to inform, contextualize, and interpret the effects of the design strategies. The two strategies are incorporated in the design of Polyvise, a visualization tool that supports making sense of complex four-dimensional geometric objects. A mixed-methods study was conducted to evaluate the design strategies and the overall usability of Polyvise. We report the findings of the study, discuss some implications for the design of visualization tools that support sensemaking of complex objects, and propose five design guidelines. We anticipate that our results are transferrable to other contexts, and that these two design strategies can be used broadly in visualization tools intended to support activities with complex objects and information spaces.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Making sense of complex objects is difficult, and typically requires the use of external representations to support cognitive demands while reasoning about the objects. Visualizations are one type of external representation that can be used to support sensemaking activities. In this paper, we investigate the role of two design strategies in making the interactive features of visualizations more supportive of users’ exploratory needs when trying to make sense of complex objects. These two strategies are visibility and complementarity of interactions. We employ a theoretical framework concerned with human–information interaction and complex cognitive activities to inform, contextualize, and interpret the effects of the design strategies. The two strategies are incorporated in the design of Polyvise, a visualization tool that supports making sense of complex four-dimensional geometric objects. A mixed-methods study was conducted to evaluate the design strategies and the overall usability of Polyvise. We report the findings of the study, discuss some implications for the design of visualization tools that support sensemaking of complex objects, and propose five design guidelines. We anticipate that our results are transferrable to other contexts, and that these two design strategies can be used broadly in visualization tools intended to support activities with complex objects and information spaces.
2014
Sedig, Kamran; Parsons, Paul; Dittmer, Mark; Haworth, Robert
Human-centered interactivity of visualization tools: Micro- and macro-level considerations Book Chapter
In: Huang, Weidong (Ed.): Handbook of Human-Centric Visualization, pp. 717–743, Springer, New York, 2014.
@inbook{Sedig2012a,
title = {Human-centered interactivity of visualization tools: Micro- and macro-level considerations},
author = {Kamran Sedig and Paul Parsons and Mark Dittmer and Robert Haworth},
editor = {Weidong Huang},
doi = {10.1007/978-1-4614-7485-2 29},
year = {2014},
date = {2014-01-01},
booktitle = {Handbook of Human-Centric Visualization},
pages = {717--743},
publisher = {Springer},
address = {New York},
abstract = {Visualization tools can support and enhance the performance of complex cognitive activities such as sensemaking, problemsolving, and analytical reasoning. To do so effectively, however, a human-centered approach to their design and eval- uation is required. One way to make visualization tools human-centered is to make them interactive. Although interaction allows a user to adjust the features of the tool to suit his or her cognitive and contextual needs, it is the quality of interaction that largely determines how well complexcognitive activities are supported. In this chapter, interactivity is conceptualized as the quality of interaction. As interactivity is a broad and complex construct, we categorize it into two levels: micro and macro. Interactivity at the micro level emerges from the structural elements of individual interactions. Interactivity at the macro level emerges from the combi- nation, sequencing, and aggregate properties and relationships of interactions as a user performs an activity. Twelvemicro-level interactivity elements and five macro- level interactivity factors are identified andcharacterized. The framework presented in this chapter can provide some structure and facilitate a systematic approach to design and evaluation of interactivity in human-centered visualization tools.},
keywords = {},
pubstate = {published},
tppubtype = {inbook}
}
Visualization tools can support and enhance the performance of complex cognitive activities such as sensemaking, problemsolving, and analytical reasoning. To do so effectively, however, a human-centered approach to their design and eval- uation is required. One way to make visualization tools human-centered is to make them interactive. Although interaction allows a user to adjust the features of the tool to suit his or her cognitive and contextual needs, it is the quality of interaction that largely determines how well complexcognitive activities are supported. In this chapter, interactivity is conceptualized as the quality of interaction. As interactivity is a broad and complex construct, we categorize it into two levels: micro and macro. Interactivity at the micro level emerges from the structural elements of individual interactions. Interactivity at the macro level emerges from the combi- nation, sequencing, and aggregate properties and relationships of interactions as a user performs an activity. Twelvemicro-level interactivity elements and five macro- level interactivity factors are identified andcharacterized. The framework presented in this chapter can provide some structure and facilitate a systematic approach to design and evaluation of interactivity in human-centered visualization tools.
Parsons, Paul; Sedig, Kamran
Distribution of Information Processing while Performing Complex Cognitive Activities with Visualization Tools Book Chapter
In: Huang, Weidong (Ed.): Handbook of Human-Centric Visualization, pp. 693–715, Springer, New York, 2014.
@inbook{Parsons2013,
title = {Distribution of Information Processing while Performing Complex Cognitive Activities with Visualization Tools},
author = {Paul Parsons and Kamran Sedig},
editor = {Weidong Huang},
doi = {10.1007/978-1-4614-7485-2 28},
year = {2014},
date = {2014-01-01},
booktitle = {Handbook of Human-Centric Visualization},
pages = {693--715},
publisher = {Springer},
address = {New York},
abstract = {When using visualization tools to perform complex cognitive activities, such as sense-making, analytical reasoning, and learning, human users and visu- alization tools form a joint cognitive system. Through processing and transfer of informationwithin and among the components of this system, complex problems are solved, complex decisions are made, and complex cognitive processes emerge—all in a manner that would not be easily performable by the human or the visualization tool alone. Although researchers have recognized this, no systematic treatment of how to best distribute the information-processing load during the performance of complex cognitive activities is available in the existing literature. While previous research has identified some relevant principles that shed light on this issue, the pertinent research findings are not integrated into coherent models and frameworks, and are scattered acrossmany disciplines, such as cognitive psychology, educational psychology, information visualization, data analytics, and computer science. This chapter provides an initial examination of this issue by identifying and discussing some key concerns, integrating some fundamental concepts, and highlighting some current research gaps that require future study. The issues examined in this chapter are of importance to many domains, including visual analytics, data and information visualization, human-informationinteraction, educational and cognitive technologies, and human-computer interaction design. The approach taken in this chapter is human-centered, focusing on the distribution of information processing with the ultimate purpose of supporting the complex cognitive activities of human users of visualization tools.},
keywords = {},
pubstate = {published},
tppubtype = {inbook}
}
When using visualization tools to perform complex cognitive activities, such as sense-making, analytical reasoning, and learning, human users and visu- alization tools form a joint cognitive system. Through processing and transfer of informationwithin and among the components of this system, complex problems are solved, complex decisions are made, and complex cognitive processes emerge—all in a manner that would not be easily performable by the human or the visualization tool alone. Although researchers have recognized this, no systematic treatment of how to best distribute the information-processing load during the performance of complex cognitive activities is available in the existing literature. While previous research has identified some relevant principles that shed light on this issue, the pertinent research findings are not integrated into coherent models and frameworks, and are scattered acrossmany disciplines, such as cognitive psychology, educational psychology, information visualization, data analytics, and computer science. This chapter provides an initial examination of this issue by identifying and discussing some key concerns, integrating some fundamental concepts, and highlighting some current research gaps that require future study. The issues examined in this chapter are of importance to many domains, including visual analytics, data and information visualization, human-informationinteraction, educational and cognitive technologies, and human-computer interaction design. The approach taken in this chapter is human-centered, focusing on the distribution of information processing with the ultimate purpose of supporting the complex cognitive activities of human users of visualization tools.
Parsons, Paul; Sedig, Kamran
Common visualizations: Their cognitive utility Book Chapter
In: Huang, Weidong (Ed.): Handbook of Human-Centric Visualization, pp. 671–691, Springer, New York, 2014.
@inbook{Parsons-Common,
title = {Common visualizations: Their cognitive utility},
author = {Paul Parsons and Kamran Sedig},
editor = {Weidong Huang},
doi = {10.1007/978-1-4614-7485-2 27},
year = {2014},
date = {2014-01-01},
booktitle = {Handbook of Human-Centric Visualization},
pages = {671--691},
publisher = {Springer},
address = {New York},
abstract = {Visualizations have numerous benefits for problem solving, sense mak- ing, decision making, learning, analytical reasoning, and other high-level cognitive activities. Research in cognitive science has demonstrated that visualizations fun- damentally influence cognitive processing and the overall performance of such aforementioned activities. However, although researchers often suggest that visu- alizations support, enhance, and/or amplify cognition, little research has examined the cognitive utility of different visualizations in a systematic and comprehensive manner. Rather, visualization research is often focused only on low-level cognitive and perceptual issues. To design visualizations that effectively support high-level cognitive activities, a strong understanding of the cognitive effects of different visual forms is required. To examine thisissue, this chapter draws on research from a number of relevant domains, including information and data visualization, visual analytics, cognitive and perceptual psychology, and diagrammatic reasoning. This chapter identifies and clarifies some important terms and discusses the current state of research and practice. In addition, a number of common visualizations are identified, their cognitive and perceptual influences are examined, and some implications for the performance of high-level cognitive activities are discussed. Readers from various fields in which a human-centered approach to visualization is necessary, such as health informatics, data and information visualization, visual analytics, journalism, education, and human-information interaction,will likely find this chapter a useful reference for research, design, and/or evaluation purposes. P.},
keywords = {},
pubstate = {published},
tppubtype = {inbook}
}
Visualizations have numerous benefits for problem solving, sense mak- ing, decision making, learning, analytical reasoning, and other high-level cognitive activities. Research in cognitive science has demonstrated that visualizations fun- damentally influence cognitive processing and the overall performance of such aforementioned activities. However, although researchers often suggest that visu- alizations support, enhance, and/or amplify cognition, little research has examined the cognitive utility of different visualizations in a systematic and comprehensive manner. Rather, visualization research is often focused only on low-level cognitive and perceptual issues. To design visualizations that effectively support high-level cognitive activities, a strong understanding of the cognitive effects of different visual forms is required. To examine thisissue, this chapter draws on research from a number of relevant domains, including information and data visualization, visual analytics, cognitive and perceptual psychology, and diagrammatic reasoning. This chapter identifies and clarifies some important terms and discusses the current state of research and practice. In addition, a number of common visualizations are identified, their cognitive and perceptual influences are examined, and some implications for the performance of high-level cognitive activities are discussed. Readers from various fields in which a human-centered approach to visualization is necessary, such as health informatics, data and information visualization, visual analytics, journalism, education, and human-information interaction,will likely find this chapter a useful reference for research, design, and/or evaluation purposes. P.
Parsons, Paul; Sedig, Kamran
Adjustable properties of visual representations: Improving the quality of human-information interaction Journal Article
In: Journal of the Association for Information Science and Technology, vol. 65, no. 3, pp. 455–482, 2014, ISSN: 23301635, (arXiv: 0803.1716 ISBN: 978-0-88986-920-2).
@article{Parsons2012ab,
title = {Adjustable properties of visual representations: Improving the quality of human-information interaction},
author = {Paul Parsons and Kamran Sedig},
url = {http://doi.wiley.com/10.1002/asi.23002},
doi = {10.1002/asi.23002},
issn = {23301635},
year = {2014},
date = {2014-01-01},
urldate = {2014-01-16},
journal = {Journal of the Association for Information Science and Technology},
volume = {65},
number = {3},
pages = {455--482},
abstract = {Complex cognitive activities, such as analytical reasoning, problem solving, and sense making, are often performed through the mediation of interactive computational tools. Examples include visual analytics, decision support, and educational tools. Through interaction with visual representations of information at the visual interface of these tools, a joint, coordinated cognitive system is formed. This partnership results in a number of relational properties—those depending on both humans and tools—that researchers and designers must be aware of if such tools are to effectively support the performance of complex cognitive activities. This article presents 10 properties of interactive visual representations that are essential and relational and whose values can be adjusted through interaction. By adjusting the values of these properties, better coordination between humans and tools can be effected, leading to higher quality performance of complex cognitive activities. This article examines how the values of these properties affect cognitive processing and visual reasoning and demonstrates the necessity of making their values adjustable—all of which is situated within a broader theoretical framework concerned with human-information interaction in complex cognitive activities. This framework can facilitate systematic research, design, and evaluation in numerous fields including information visualization, health informatics, visual analytics, and educational technology.},
note = {arXiv: 0803.1716
ISBN: 978-0-88986-920-2},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
Complex cognitive activities, such as analytical reasoning, problem solving, and sense making, are often performed through the mediation of interactive computational tools. Examples include visual analytics, decision support, and educational tools. Through interaction with visual representations of information at the visual interface of these tools, a joint, coordinated cognitive system is formed. This partnership results in a number of relational properties—those depending on both humans and tools—that researchers and designers must be aware of if such tools are to effectively support the performance of complex cognitive activities. This article presents 10 properties of interactive visual representations that are essential and relational and whose values can be adjusted through interaction. By adjusting the values of these properties, better coordination between humans and tools can be effected, leading to higher quality performance of complex cognitive activities. This article examines how the values of these properties affect cognitive processing and visual reasoning and demonstrates the necessity of making their values adjustable—all of which is situated within a broader theoretical framework concerned with human-information interaction in complex cognitive activities. This framework can facilitate systematic research, design, and evaluation in numerous fields including information visualization, health informatics, visual analytics, and educational technology.
2013
Sedig, Kamran; Parsons, Paul
Interaction Design for Complex Cognitive Activities with Visual Representations: A Pattern-Based Approach Journal Article
In: AIS Transactions on Human-Computer Interaction, vol. 5, no. 2, pp. 84–133, 2013.
@article{Sedig2013,
title = {Interaction Design for Complex Cognitive Activities with Visual Representations: A Pattern-Based Approach},
author = {Kamran Sedig and Paul Parsons},
url = {http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1057&context=thci},
year = {2013},
date = {2013-01-01},
journal = {AIS Transactions on Human-Computer Interaction},
volume = {5},
number = {2},
pages = {84--133},
abstract = {This paper is concerned with interaction design for visualization-based computational tools that support the performance of complex cognitive activities, such as analytical reasoning, sense making, decision making, problem solving, learning, planning, and knowledge discovery. In this paper, a number of foundational concepts related to interaction and complex cognitive activities are syncretized into a coherent theoretical framework. This framework is general, in the sense that it is applicable to all technologies, platforms, tools, users, activities, and visual representations. Included in the framework is a catalog of 32 fundamental epistemic action patterns, with each action pattern being characterized and examined in terms of its utility in supporting different complex cognitive activities. This catalog of action patterns is comprehensive, covering a broad range of interactions that are performed by a diverse group of users for all kinds of tasks and activities. The presented framework is also generative, in that it can stimulate creativity and innovation in research and design for a number of domains and disciplines, including data and information visualization, visual analytics, digital libraries, health informatics, learning sciences and technologies, personal information management, decision support, information systems, and knowledge management.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
This paper is concerned with interaction design for visualization-based computational tools that support the performance of complex cognitive activities, such as analytical reasoning, sense making, decision making, problem solving, learning, planning, and knowledge discovery. In this paper, a number of foundational concepts related to interaction and complex cognitive activities are syncretized into a coherent theoretical framework. This framework is general, in the sense that it is applicable to all technologies, platforms, tools, users, activities, and visual representations. Included in the framework is a catalog of 32 fundamental epistemic action patterns, with each action pattern being characterized and examined in terms of its utility in supporting different complex cognitive activities. This catalog of action patterns is comprehensive, covering a broad range of interactions that are performed by a diverse group of users for all kinds of tasks and activities. The presented framework is also generative, in that it can stimulate creativity and innovation in research and design for a number of domains and disciplines, including data and information visualization, visual analytics, digital libraries, health informatics, learning sciences and technologies, personal information management, decision support, information systems, and knowledge management.