A novel platform to simplify human observer performance experiments in clinical reading environments

Human observer performance experiments (HOPE) are frequently carried out in controlled environments in order to maximize the influence of the performance parameter under study. As an example, the amount of ambient reading variables can be kept as low as possible during HOPE. This is contrasting with the dynamic nature of a clinical reading environment that may therefore be suboptimal for the majority of the experiments. The aim of current work was to extend our previously developed software platform Sara² to cope with the influences of the reading environment on HOPE experiments. Generic modules for ROC, LROC, FROC, MAFC and visual grading analysis/image quality criteria (VGA/IQC) experiments were developed for 2D and 3D input images. Additional modules were included in the platform for finding unexpected interruptions due to clinical emergencies by means of idle time and for mouse trajectory monitoring. Also a generic approach towards the inclusion of reading questionnaires and a RFID enabled secured login system was added. Next, we created a sensor network consisting of off-the-shelf components which continuously monitor ambient reading conditions like: temperature, ambient lighting, humidity, ambient noise levels and observer reading distance. These measured parameters can be synchronized with the reading findings. Finally we included a link to incorporate the use of specialized 3rd party PACS viewers in our software framework. Using the proposed software and hardware solution, we could simplify the setup and the performing of HOPE in clinical reading environments and we can now properly control our reading experiments.