... the evaluation: manual evaluation is adifficult, time-consuming process and not ap-plicable within efficient development of sys-tems. Automatic evaluation requires a cor-pus of questions and ... selection of natural questions. Thearticles varied in topic, degree of formality and theamount of details; from ”Horror film” and ”Christ-mas worldwide” to ”G-Man (Half-Life)” and ”His-tory of London”. ... were grouped into groups of 5.Each HIT consisted of 5 assignments, and a $0.05reward was offered for each HIT.QRepHIT required the least amount of design and trials, and workers were delighted...