TY - GEN
T1 - Analyzing vocabulary intersections of expert annotations and topic models for data practices in privacy policies
AU - Liu, Frederick
AU - Wilson, Shomir
AU - Schaub, Florian
AU - Sadeh, Norman
PY - 2016/1/1
Y1 - 2016/1/1
N2 - Privacy policies are commonly used to inform users about the data collection and use practices of websites, mobile apps, and other products and services. However, the average Internet user struggles to understand the contents of these documents and generally does not read them. Natural language and machine learning techniques offer the promise of automatically extracting relevant statements from privacy policies to help generate succinct summaries, but current techniques require large amounts of annotated data. The highest quality annotations require law experts, but their efforts do not scale efficiently. In this paper, we present results on bridging the gap between privacy practice categories defined by law experts with topics learned from Non-negative Matrix Factorization (NMF). To do this, we investigate the intersections between vocabulary sets identified as most significant for each category, using a logistic regression model, and vocabulary sets identified by topic modeling. The intersections exhibit strong matches between some categories and topics, although other categories have weaker affinities with topics. Our results show a path forward for applying unsupervised methods to the determination of data practice categories in privacy policy text.
AB - Privacy policies are commonly used to inform users about the data collection and use practices of websites, mobile apps, and other products and services. However, the average Internet user struggles to understand the contents of these documents and generally does not read them. Natural language and machine learning techniques offer the promise of automatically extracting relevant statements from privacy policies to help generate succinct summaries, but current techniques require large amounts of annotated data. The highest quality annotations require law experts, but their efforts do not scale efficiently. In this paper, we present results on bridging the gap between privacy practice categories defined by law experts with topics learned from Non-negative Matrix Factorization (NMF). To do this, we investigate the intersections between vocabulary sets identified as most significant for each category, using a logistic regression model, and vocabulary sets identified by topic modeling. The intersections exhibit strong matches between some categories and topics, although other categories have weaker affinities with topics. Our results show a path forward for applying unsupervised methods to the determination of data practice categories in privacy policy text.
UR - http://www.scopus.com/inward/record.url?scp=85025807127&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85025807127&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85025807127
T3 - AAAI Fall Symposium - Technical Report
SP - 264
EP - 269
BT - FS-16-01
PB - AI Access Foundation
T2 - 2016 AAAI Fall Symposium
Y2 - 17 November 2016 through 19 November 2016
ER -