Advanced On-the-Job Training System: System Level Testing and Evaluation - Lessons Learned

Abstract : This lessons learned paper discusses the need to closely examine the constructs used to measure the Testing and Evaluation objectives, to use a flexible and comprehensive Master Test Plan, and to collect background data to assess the influence of human factors on the deployment of the system. Standardized and practical training on the deployed technology will facilitate acceptance and use of the system. Optimal compatibility with the Advanced on- the-job Training System was found with those participants who were computer literate, used the system on a regular basis, and were involved in On-the-Job Training. An additional implication is to keep the evaluation and analysis practical and simple. Keywords: Job training; Training systems.