A Multi-Criteria Decision Support Framework for Interactive Adaptive Systems Evaluation

Many usability evaluation methods for interactive adaptive systems exist in the literature. There is not yet an agreement in the adaptive system community about which method is more useful than another in specific evaluation situations. This raises the question, “What is (are) the best evaluation method(s) that need(s) to be used in specific evaluation constraints?” This paper presents possible directions to address this issue by proposing a multi-criteria decision support framework for selecting the appropriate evaluation methods for interactive adaptive systems. The proposed decision support framework is applied to determine the suitable usability evaluation methods for a specific adaptation layer of a given adaptive hypermedia system.