Assessing the accuracy of four popular face recognition tools for inferring gender, age, and race

Soon Gyo Jung, Jisun An, Haewoon Kwak, Joni Salminen, Bernard James Jansen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

In this research, we evaluate four widely used face detection tools, which are Face++, IBM Bluemix Visual Recognition, AWS Rekognition, and Microsoft Azure Face API, using multiple datasets to determine their accuracy in inferring user attributes, including gender, race, and age. Results show that the tools are generally proficient at determining gender, with accuracy rates greater than 90%, except for IBM Bluemix. Concerning race, only one of the four tools provides this capability, Face++, with an accuracy rate of greater than 90%, although the evaluation was performed on a high-quality dataset. Inferring age appears to be a challenging problem, as all four tools performed poorly. The findings of our quantitative evaluation are helpful for future computational social science research using these tools, as their accuracy needs to be taken into account when applied to classifying individuals on social media and other contexts. Triangulation and manual verification are suggested for researchers employing these tools.

Original languageEnglish (US)
Title of host publication12th International AAAI Conference on Web and Social Media, ICWSM 2018
PublisherAAAI press
Pages624-627
Number of pages4
ISBN (Electronic)9781577357988
StatePublished - Jan 1 2018
Event12th International AAAI Conference on Web and Social Media, ICWSM 2018 - Palo Alto, United States
Duration: Jun 25 2018Jun 28 2018

Other

Other12th International AAAI Conference on Web and Social Media, ICWSM 2018
CountryUnited States
CityPalo Alto
Period6/25/186/28/18

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Assessing the accuracy of four popular face recognition tools for inferring gender, age, and race'. Together they form a unique fingerprint.

  • Cite this

    Jung, S. G., An, J., Kwak, H., Salminen, J., & Jansen, B. J. (2018). Assessing the accuracy of four popular face recognition tools for inferring gender, age, and race. In 12th International AAAI Conference on Web and Social Media, ICWSM 2018 (pp. 624-627). AAAI press.