Learning User Latent Attributes on Social Media
thesisposted on 2020-05-15, 14:35 authored by Binxuan HuangBinxuan Huang
In recent years, there is a growing interest in using social media to understand social phenomena. Researchers have demonstrated many important applications of using
online social media to understand real world events, such as presidential election prediction, earthquake early detection, and disaster management. A social media site is mixed with different types of users, in terms of gender, location, ideology, and etc. Different types of users may have different motivations, different opinions towards certain topics, different resources at their disposal, different behaviors in events. If researchers want to understand what is happening on a social media site, it is important to know where a post comes from, who wrote this post, and which party the author
belongs to. However, this information is not explicitly provided by users. In this thesis, the goal is to predict users’ latent attributes such as their locations, social identities, and political orientations. Thanks to the massive text data on social media, we can learn rich knowledge from text to predict users’ attributes. In the meanwhile, text data from social media often comes with a significant amount of meta
data. Furthermore, data from social networks also contains rich connection information, eg. mentioning, following. It is still a challenge task to combine text, meta data, user
network together for user attributes prediction.
In this thesis, I approach user attributes prediction at three levels — single post, user timeline, graph-level classification. I start with a global location prediction system that uses one single tweet as input to learn one user’s location. It utilizes
location-related features in a tweet, such as text and user profile metadata. I extend the tweet-level prediction system to user-level, which combines multiple posts in one
user’s timeline. I demonstrate the effectiveness of this model on the task of user social identity classification. An improved user-level hierarchical location prediction model is also presented. In these described models, I mainly focus on learning user attributes from users themselves. In the next step, I consider social graph as additional information to improve performance. Users connected in a social network often show similarities in certain aspects, which is a well-known phenomenon called social homophily. Experiments demonstrate that combining a social graph dramatically improves the performance of our prediction system compared to the previous user-level method. As a case study of the attributes prediction system, I apply the method on a real world emergency event — the novel coronavirus outbreak starting from 2019. I demonstrate that we gain better understanding of the public conversation during this
global emergency event.
- Institute for Software Research
- Doctor of Philosophy (PhD)