Overview of the NTCIR-11 Recognizing Inference in TExt and Validation (RITE-VAL) Task

System Valida5on Subtask Language Task Description Acronym Test Data Size Submissions Top Macro-F1 Top Accuracy Top Team (Run Num.) Fact Validation Simplified Chinese Multi-Classification CS-FV 613 12 38.93 44.05 III&CYUT (05) Traditional Chinese Multi-Classification CT-FV 613 15 39.51 44.70 III&CYUT (02) Japanese Binary Classification JA-FV 514 30 61.93 63.23 NUL (03) Passage Search -514 3 ---English Binary Classification EN-FV 188 9 53.17 55.85 BnO (01) System Validation Simplified Chinese Binary Classification CS-SVBC 1,200 23 61.51 62.33 BUPTTeam (05) Multi-Classification CS-SVMC 1,200 18 44.39 51.83 WUST (01) Traditional Chinese Binary Classification CT-SVBC 1,200 17 56.24 56.25 III&CYUT (04) Multi-Classification CT-SVMC 1,200 17 40.54 43.33 III&CYUT (05) Japanese Binary Classification JA-SV 1,379 26 69.59 77.81 NUL (04) Total 170 Active participating team: 23 teams • 11 from Japan • 7 from Taiwan • 4 from China • 1 from Norway • 1 from Vietnam (One team consists of people from Japan and Vietnam.)