Generating multiple choice questions from ontologies: Lessons learnt

Ontologies with potential educational value are available in di↵erent domains. However, it is still unclear how such ontologies can be exploited to generate useful instructional content, e.g., assessment questions. In this paper, we present an approach to automatically generate multiple-choice questions from OWL ontologies. We describe a psychologically-plausible theory to control the di culty of questions. Our contributions include designing a protocol to evaluate the characteristics of the generated questions, in particular, question di culty. We report on our experience on generating questions from ontologies and present promising results of evaluating our di culty-control theory.