Modelling the Sense-Making of Diagrams Using Image Schemas

Author(s): Bourou, Dimitra Anna; Schorlemmer, Marco; Plaza, Enric | Abstract: We model the sense-making process of diagrams as conceptual blends of the diagrams’ geometric configurations with apt image schemas.We specify image schemas and geometric configurations with typed FOL theories. In addition, for the latter, we utilise some Qualitative Spatial Reasoning formalisms. Using an algebraic specification language, we can compute the conceptual blends of image schemas and geometry as category-theoretic colimits.We show through several examples how this model captures the sort of direct inferences we confer to diagrammatic representations due to our embodied cognition. We argue that this approach to sense-making might be of value for the design and application of diagrammatic and graphical visualisations, as well as for AI in general.