On Crowdsourcing Relevance Magnitudes for Information Retrieval Evaluation

Magnitude estimation is a psychophysical scaling technique for the measurement of sensation, where observers assign numbers to stimuli in response to their perceived intensity. We investigate the u...