On task effects in NLG corpus elicitation: A replication study using mixed effects modeling

Task effects in NLG corpus elicitation recently started to receive more attention, but are usu- ally not modeled statistically. We present a controlled replication of the study by Van Mil- tenburg et al. (2018b), contrasting spoken with written descriptions. We collected additional written Dutch descriptions to supplement the spoken data from the DIDEC corpus, and an- alyzed the descriptions using mixed effects modeling to account for variation between par- ticipants and items. Our results show that the effects of modality largely disappear in a con- trolled setting.