Online dating research

Online dating has shed its stigma as matchmaker for the awkward (Goodwin 1990) to claim a new prominence in the social lives of millions of users. In August 2003 alone, 40 million unique users visited online dating sites in the United States alone, according to U.S. News & World Report -- that's about half the number of single adults in the U.S. Given their prevalence, it seems likely that online dating systems have begun to influence not only individual lives but also cultural notions of love and attraction with their overflowing catalogues of potential partners and their sometimes idiosyncratic choices of personal characteristics to highlight. But despite the incredible number of people using these services, we know little about how users perceive each other and interact through these mediated channels, or how such technologies might affect their selection of partners for dating, sex, and marriage.

Millennia of evolution have left humans with a set of perceptual and interpretive processes that allow us efficiently to identify desirable potential partners -- what happens when we go online and forfeit most of the sensory channels that drive this well-refined offline process? How can we improve the design of online dating systems to help users make better-informed decisions about whom they wish to contact and follow those decisions with effective communication? Moreover, might what we learn about searching and matching in a romantic context generalize to non-romantic situations, like matching potential employees with employers? To answer these questions, we have undertaken a research agenda with an integrative, multi-method approach grounded in social psychological theory and powered by data mining, statistical analysis, and interactive visualization.

Who's involved?
Current work

We are currently pursuing two research tracks related to online dating. The first is post hoc quantitative analysis of messaging behavior and profile characteristics, an expansion in scope and method of the work begun in Andrew Fiore's master's thesis. The second is a series of surveys administered to online dating users about their perceptions and expectations of potential partners whom they meet through online personal ads. In the following sections, we describe both tracks of research.

Track I: Quantitative behavioral analysis

Analysis of the characteristics and behavioral patterns of online dating users has the potential to yield rich insight into what users seek in a date and how they evaluate potential partners. Studying users of large real-world systems in particular would give us reliable evidence about online dating behavior because we can study a large group from a diverse population, ensuring that we can generalize confidently from our findings.

Quantitative analysis allows us to characterize the users of an online dating Web site and compare them to other populations, offline and online. Analysis of communicating pairs (cf. Klohnen & Mendelsohn 1998) lets us infer what characteristics people are actually looking for in a potential partner and how these demonstrated preferences compare with those they claim to seek. It's possible, too, that different subpopulations of users within the site are seeking entirely different things and using different evaluative techniques. Breaking down our analysis into demographic subgroups would allow us to compare these approaches.

Specifically, we plan to answer the following questions for as many data sets as we can obtain:

Analyses like these will help inform better designs of online dating systems. For example, knowing what characteristics users actually use to make decisions about whom to contact would allow us to create profiles that more accurately present and even highlight these characteristics, making the decision process quicker and easier. Information about which characteristics successful couples have in common can be used to improve suggested matches. Additionally, knowledge about the differing behavior of various subpopulations of users could facilitate adaptive interfaces that adjust to the needs of individual users.

Method

We will employ a variety of analytic methods to make sense of a large volume of social-transactional data from online dating Web sites. We begin with descriptive techniques, examining central tendencies and distributions, and data visualization to spot trends. Relational (correlation, regression) and comparative (t-tests, non-parametric significance test) tools permit the exploration specific hypotheses about the factors that influence messaging behavior. Techniques like clustering and factor analysis will identify emergent patterns of communication and classes of user behavior.

New techniques for dyadic analysis (e.g., Klohnen and Mendelsohn 1998, Fiore and Donath 2005) allow us to compare the characteristics of selected dyads, like a romantic couple or a pair of users who are communicating online, to the characteristics of all random pairings of people in the sample. These techniques compensate for the baseline similarity that most groups of people exhibit in personality and attitudinal characteristics, which varies substantially by characteristic but is typically much greater than zero.

Furthermore, as in Fiore's master's thesis, we will continue to develop novel software tools for visualization and interactive data analysis. For that project, Fiore built a database-backed visualization application that combined user-configurable scatterplot arrays with transparent, social-network-style connection overlays. This tool presented visually how different subsets of the population were communicating with each other and among themselves, inspiring the dyadic analysis described above.

Track II: Examining perception and expectation

Interpersonal perception relies on a variety of sophisticated mechanisms that humans have evolved over time. Computer-mediated communication, however, offers only a limited set of communicative channels compared to face-to-face interaction, forcing users to employ other (historically unusual) means to evaluate potential partners. What are the implications of this restriction for mate perception and selection? Are users of online dating choosing qualitatively different mates than they would if they were meeting them offline? This question has not only personal but also societal implications for our notions of love, sex, marriage, and family. More concretely, users of online dating systems often express disappointment in their experiences, particularly after meeting in person a potential partner with whom they have corresponded only online. We hypothesize that this disappointment stems from users' systematic misperception of one another through mediated channels in general and online dating profiles in particular. Walther et al. (2001) show that communication over sparse channels can lead to idealization; if this is the case, disappointment in online dating could stem from overly optimistic expectations formed prior to meeting in person. This research seeks to identify on what dimensions, to what degree, and for what reasons online dating users might misperceive each other, in particular when the misperception leads to disappointment. Knowledge of the mechanism behind this process will enable designers to create online dating systems that present information and communications in such a way as to prevent the distorted perception of the misperceived cues, or at least mitigate their consequences. Some of the dimensions on which users might misperceive one another that this work will investigate include demographics such as age, ethnicity, religion, height, weight; physical attractiveness; hobbies and interests; political affiliations; similarity to one's "ideal partner"; style of relationship desired, e.g., marriage vs. casual dating; and personality traits as indexed by the canonical Big Five -- Extraversion, Agreeableness, Openness to experience, Neuroticism, and Conscientiousness.

Method

It is likely that users of online personals systematically misperceive the people with whom they communicate through these systems, yet we do not know on what dimensions or to what degree this misperception happens. To find out, we plan to survey users about their perceptions and expectations of the people they meet through online dating services both before and after they meet face-to-face. The surveys will include questions about personality, attractiveness, and perceived commonalities with the communication partners.

To gain the fullest picture of the changes in expectations that users might experience, we will survey both people in a communicating pair of users both before and after they meet in person. The full sequence is: Person A and Person B begin communicating through the online dating site. The system detects their communication and sends them each a pre-date survey about the other -- that is, Person A reports on his/her perceptions and expectations of Person B, and vice versa. Person A and Person B meet face-to-face and learn more about each other. Subsequently, the system sends Person A and Person B each a post-date survey about the other to gauge their perceptions and expectations following their face-to-face meeting. To analyze the survey responses, we will compare the participants' pre-date and post-date responses to determine how their initial perceptions changed with in-person interaction, and on what dimensions they were pleasantly surprised or disappointed.

To accomplish this, automated survey software will obtain informed consent from an initial random sample of online dating users. Because we wish to gather data from dyads, not just individuals, however, it is insufficient to take a random sample, because both members of any given communicating pair are unlikely to belong to it. So it is necessary to employ a technique similar to "snowball" sampling -- the survey system will automatically detect when a previously consenting user contacts or is contacted by another user. If that user is not part of the survey pool, the system will automatically send him or her an invitation to participate. Thus, the sample will expand in a way that maximizes the number of complete dyads it includes.

Theoretical background

Many theories of computer-mediated communication describe the medium as impoverished in one way or another -- it might be less than real time, or the information conveyed might be of limited richness (e.g., text only), compared to face-to-face interaction. How does this affect the user's experience of communicating through such a channel? Joseph Walther (1996) proposed a theory of "hyperpersonal" communication that might explain what happens: when the channel is impoverished, users can't get as much information as quickly as they would face-to-face, so they fill in the blanks optimistically about their conversational partner. That is, in some sense they idealize them in light of incomplete information. Walther's later work established that this effect is most powerful -- generating the greatest interpersonal affinity -- in long-term online interactions in which participants never see photos of each other (Walther et al. 2001). By contrast, Walther et al. found the least social affinity occurred in short-term online interactions without photographs -- a finding particularly germane to online dating, where many users remain unwilling or unable to post photos of themselves with their profiles.

Research in social psychology has shown that similarity in attitudes, political beliefs, and factors like religiosity predict attraction. (For good summaries, see Fisher 1992; Brehm et al. 2002; Buss 2003; and Buss & Barnes 1986). Proximity, and with it frequent exposure to a person, also plays a major part. Personality may be more complicated, but some recent work suggests that similarity in some personality traits is desirable, but in other traits, complementarity is better. Klohnen and Mendelsohn (1998) found that people prefer similarity in traits that they like in themselves, and complementarity in traits that they dislike in themselves -- more precisely, those traits that do not match their conception of ideal self. Work in this area is ongoing, and some studies suggest that those characteristics that predict initial attraction might not predict long-term relationship satisfaction, and vice versa (Klohnen & Luo 2003; Watson et al. 2004).

For more information about the theory behind this work, please see our annotated bibliography, Attraction, Selection, and Satisfaction -- Understanding what makes happy couples, which provides summaries of 20 important articles about relationship research.

Conclusion: The matching problem

The problem of matching two entities for mutual benefit goes beyond the realm of romance. Employers and employees undertake a similar process in trying to pair a good worker with a good job. Real estate buyers and sellers, too, go through similar steps: search, presentation and perception, and communication -- in this case, negotiation1. What this research reveals about the efficacy of computer systems to mediate the matching problem in a romantic context may well bring insight into how to solve similar problems in a variety of important domains. Thus, although the present work focuses on interpersonal relationships, the analytic techniques and design principles that result will likely apply more broadly.

1 Thanks to Marc Smith for suggesting the housing market as another parallel.

Papers we've written

Fiore, A.T., Taylor, L.S., Mendelsohn, G.A., and M.A. Hearst. "Assessing Attractiveness in Online Dating Profiles." [PDF] In Proc. ACM Computer-Human Interaction 2008, Florence, Italy.

DiMicco, J.M., Lakshmipathy, V., and A.T. Fiore. Conductive Chat: Instant Messaging With a Skin Conductivity Channel [PDF] Poster, Computer-Supported Cooperative Work 2002.

Fiore, A.T. Romantic Regressions: An Analysis of Behavior in Online Dating Systems, Master's thesis, MIT Media Lab.

Fiore, A.T., and J.S. Donath. "Homophily in Online Dating: When Do You Like Someone Like Yourself?." [PDF] Short paper, Computer-Human Interaction 2005.

Fiore, A.T., and J.S. Donath. "Online Personals: An Overview." [PDF] Short paper, Computer-Human Interaction 2004.

Fiore, A.T., Frost, J., and J.S. Donath. "'Scientists, designers seek same for good conversation': A Workshop on Online Dating." [PDF] Workshop, Computer-Human Interaction 2004.

Mendelsohn, G.A., Bleiweiss, O., Canny, J., and M. Williams. Variations in Role-playing and Personality "Leakage" as a Function of Communication Medium. [PDF]

Mendelsohn, G.A., and L.H. Shaw. Computer-Mediated Relating: Liking and Self-Disclosure in Online Interactions. [PDF]

Shaw, L.H. Liking and Self-Disclosure in Computer-Mediated and Face-to-Face Interactions. [PDF] Master's thesis, University of California, Berkeley, Department of Psychology.

Other relevant papers

Brehm, Miller, Perlman, and Campbell. Intimate Relationships 3e. New York: McGraw-Hill Higher Education, 2002.

Buss, D. The Evolution of Desire: Strategies of Human Mating 4e. New York: Basic Books, 2003.

Buss, D. and M. Barnes. "Preferences in human mate selection." In J. of Personality and Social Psychology 50, 1986, pp. 559-570.

Fisher, H. Anatomy of Love: A natural history of mating, marriage, and why we stray. New York: Fawcett-Columbine,1992.

Frost, J. Decision Making in the Information Age: A Study of and Design for Online Dating. PhD thesis, MIT Media Lab, 2005.

Goodwin, R. "Dating agency members: Are they 'different'?" In J. of Social and Personal Relationships 7, 1990, pp. 423-430.

Hancock, J.T., Thom-Santelli, J., and T. Ritchie. Deception and design: The impact of communication technologies on lying behavior. Paper, Computer Human Interaction 2004.

Hitsch, G., Hortaçsu, A., and D. Ariely. What Makes You Click? An Empirical Analysis of Online Dating. [PDF] 2004.

Klohnen, E.C., & S. Luo. "Interpersonal Attraction and Personality: What Is Attractive -- Self Similarity, Ideal Similarity, Complementarity, or Attachment Security?" Journal of Personality and Social Psychology 85 (4), 2003, pp. 709-722.

Klohnen, E.C., & G.A. Mendelsohn. "Partner Selection for Personality Characteristics: A Couple-Centered Approach." In Personality and Social Psychology Bulletin 24(3), March 1998, pp. 268-278.

Murray, S.L., Holmes, J.G., Griffin, D.W. "The benefits of positive illusions: Idealization and the construction of satisfaction in close relationships." In Journal of Personality and Social Psychology 70(1), Jan. 1996, pp. 79-98.

Walther, J. B. "Computer-mediated communication: Impersonal, interpersonal, and hyperpersonal interaction." In Comm. Research 23, 1996, pp. 3-43.

Walther, J.B., Slovacek, C.L., & L.C.Tidwell. "Is a Picture Worth a Thousand Words? Photographic Images in Long-Term and Short-Term Computer-Mediated Communication." In Comm. Research 28(1), February 2001, pp. 105-134.

Watson, D., Klohnen, E.C., Casillas, A., Simms, E.N., Haig, J., & D.S. Berry. "Match Makers and Deal Breakers: Analyses of Assortative Mating in Newlywed Couples." Journal of Personality 72 (5), 2004, pp. 1029-1068.

Witmer, D.F. Risky Business: Why People Feel Safe in Sexually Expicit On-Line Communication. Journal of Computer-Mediated Communication, 2(4), 1997.

Yum, Y.-O., and Hara, K. Computer-mediated relationship development: A cross-cultural comparison. Journal of Computer-Mediated Communication, 11(1), article 7, 2005.

Links