Malina Florea

University of Manchester

Author Statistics

Papers

Citation

H-Index

i-10 index

Research Trends

Author Order

Document Type

Co-Authors

Oskar Wysocki

Idiap Research Institute

André Freitas

University of Manchester

Dónal Landers

Cancer Research UK Manchester Institute

Cooperative Institutions

Idiap Research Institute

Cancer Research UK Manchester Institute

University of Manchester

Health Information Management

Gdańsk University of Technology

Deutsches Zentrum für Luft- und Raumfahrt e. V. (DLR)

Manchester Academic Health Science Centre

The Christie NHS Foundation Trust

Iscte – Instituto Universitário de Lisboa

Hong Kong Polytechnic University

Author Statistics

Papers

Citation

H-Index

i-10 index

Research Field

What is SemEval evaluating?: A Systematic Analysis of Evaluation Campaigns in NLP

arXiv (Cornell University) (2020)

Oskar Wysocki Malina Florea André Freitas

SemEval is the primary venue in the NLP community for the proposal of new challenges and for the systematic empirical evaluation of NLP systems. This paper provides a systematic quantitative analysis of SemEval aiming to evidence the patterns of the contributions behind SemEval. By understanding the distribution of task types, metrics, architectures, participation and citations over time we aim to answer the question on what is being evaluated by SemEval.

SemEval

Source

Cite

Citations (0)

What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP

arXiv (Cornell University) (2020)

Oskar Wysocki Malina Florea André Freitas

SemEval

Source

Cite

Citations (0)

Architectures of Meaning, A Systematic Corpus Analysis of NLP Systems

arXiv (Cornell University) (2021)

Oskar Wysocki Malina Florea Dónal Landers André Freitas

This paper proposes a novel statistical corpus analysis framework targeted towards the interpretation of Natural Language Processing (NLP) architectural patterns at scale. The proposed approach combines saturation-based lexicon construction, statistical corpus analysis methods and graph collocations to induce a synthesis representation of NLP architectural patterns from corpora. The framework is validated in the full corpus of Semeval tasks and demonstrated coherent architectural patterns which can be used to answer architectural questions on a data-driven fashion, providing a systematic mechanism to interpret a largely dynamic and exponentially growing field.

Corpus Linguistics

10.48550/arxiv.2107.08124

Cite

Citations (0)

What is SemEval evaluating? A Systematic Analysis of Evaluation Campaigns in NLP

Oskar Wysocki Malina Florea Dónal Landers André Freitas

SemEval

10.18653/v1/2021.eval4nlp-1.21

Cite

Citations (1)