Publication:
Beyond independent agreement: A tournament selection approach for quality assurance of human computation tasks

Simple item page
cris.author.scopus-author-id55737843900
cris.author.scopus-author-id8454170300
cris.author.scopus-author-id16643068200
dc.contributor.authorSun, Yu An
dc.contributor.authorRoy, Shourya
dc.contributor.authorLittle, Greg D.
dc.date.accessioned2023-09-20T05:34:04Z
dc.date.available2023-09-20T05:34:04Z
dc.date.issued02-11-2011
dc.description.abstractQuality assurance remains a key topic in human computation research field. Prior work indicates independent agreement is effective for low difficulty tasks, but has limitations. This paper addresses this problem by proposing a tournament selection based quality control process. The experimental results from this paper show that the human are better at identifying the correct answers than producing them themselves. Copyright © 2011, Association for the Advancement of Artificial Intelligence. All rights reserved.
dc.identifier.scopus2-s2.0-80055050754
dc.identifier.urihttps://apicris.irins.org/handle/IITM2023/48769
dc.relation.ispartofseriesAAAI Workshop - Technical Report
dc.sourceAAAI Workshop - Technical Report
dc.titleBeyond independent agreement: A tournament selection approach for quality assurance of human computation tasks
dc.typeConference Proceeding
dspace.entity.typePublication
oaire.citation.endPage118
oaire.citation.startPage113
oaire.citation.volumeWS-11-11
oairecerif.author.affiliation#PLACEHOLDER_PARENT_METADATA_VALUE#
oairecerif.author.affiliation#PLACEHOLDER_PARENT_METADATA_VALUE#
oairecerif.author.affiliation#PLACEHOLDER_PARENT_METADATA_VALUE#
person.affiliation.cityChennai
person.affiliation.cityNorwalk
person.affiliation.cityCambridge
person.affiliation.id60025757
person.affiliation.id60019463
person.affiliation.id60006320
person.affiliation.nameIndian Institute of Technology Madras
person.affiliation.nameXerox Corporation
person.affiliation.nameMIT Computer Science &amp
person.affiliation.nameArtificial Intelligence Laboratory
Files
Collections
Publication8