BLiMP: A Benchmark of Linguistic Minimal Pairs for English

Alex Warstadt,Alicia Parrish,Haokun Liu,Anhad Mohananey,Wei Peng,Sheng-Fu Wang,Samuel R. Bowman

BLiMP: A Benchmark of Linguistic Minimal Pairs for English

2020

Alex Warstadt
Alicia Parrish
Haokun Liu
Anhad Mohananey
Wei Peng
Sheng-Fu Wang
Samuel R. Bowman

We introduce The Benchmark of Linguistic Minimal Pairs (BLiMP),1 a challenge set for evaluating the linguistic knowledge of language models (LMs) on major grammatical phenomena in English. BLiMP co...

Keywords:

Blimp
Computer science
Artificial intelligence
n-gram
Language model
Natural language processing

Correction
Source
Cite
Save
Machine Reading By IdeaReader

References

Citations