Robotized Counselor Evaluation using Linguistic Detection of Feeling Polarity Change

In Japan, many people suffer from bad conditions of their mental health with an increasing tendency that should be alarmed. For this reason, a counseling robot was created in our former work and enhanced more and more. Our former quantitative evaluation based on the utterance amount. Here, we provide a new solution on evaluating this system. We introduce an evaluation polarity of the utterance contents by using a polarity dictionary This evaluates the feeling polarity of utterances by positive through negative degree on a scale from -1 (negative) to +1 (positive). Combined with generally used conventional impression evaluation by a questionnaire, it provides a much better way to evaluate the performance of our Counseling Agent Robot.