research highlights doi:10.1145/ 2133806.2 1 3 3 8 2 9

Technical Perspective Who Knows? Searching for Expertise on the Social Web By Ed H. Chi

It is difficult to remember what people had to do to find the answer to a question before the Web. Imagine it is 1990, before the age of search engines, and of course, Wikipedia. You have no access to a library, and available reference books are not enough. The only option you might have is to call a friend who might know the answer. In fact, this option is so important, it is baked into the game “Who Wants to be a Millionaire?” as one of the three lifeline options to take when you are stumped for an answer. This natural instinct to call someone is also baked into the DNA of Aardvark, the social question and answering (QA) engine described in the following paper by D. Horowitz and S. Kamvar. When you turn to the phone, one of the first steps you have to figure out is who to call. This is the expertise location or question-routing problem in social QA research. At a high level, this seems like a great computer science problem. You have people as nodes, and their relationships and interactions as edges, and you want to model people’s interests and expertise, as well as the frequency and recency of their interactions with each other. You will use these models to route questions. Your mind races with possible algorithms and user modeling approaches to apply. Yes, conceptually you would probably be correct with many of these ideas, but in practice, building Aardvark is much more complex and difficult. First, you must figure out how to build accurate user models for each user on the whole Web, even with sparse data for many users, including brand new users of your system. Second, you have to scale this system to millions of users, and be able to do the question routing in milliseconds. You also want to try and get answers that are good and return them as quickly as possible.

110

co mm unicatio ns o f t h e ac m

Third, potential answerers (read: humans) are finicky: they do not want you to spam them; they do not like being interrupted if they are in the middle of another conversation; and they don’t like it when you call them up at weird hours of the day (no matter if you know their time zone or not). In order words, you must deal with the real human context and its associated social interaction. Finally, you need to socially engineer the growth of this system, so that early users get experiences good enough to rave about your service and recommend it to other users. You want to build trust, and you want a network effect, such that, as each user joins the system, the whole system becomes even more useful to those already there. Before Aardvark, social QA systems used a wide variety of techniques to route questions, most often using experience/reputation points or monetary rewards as incentives. Many services, such as Yahoo! Answers focused on building communities, and turning the act of answering into a pointbased game. Instead, Horowitz, Kamvar and their team at Aardvark pushed the envelope and built a different service that focused on getting answers as quickly as possible; from someone you are socially connected to; and who is likely to be an expert on the topic. How did they do it? On speed: By connecting Aardvark to a chat service (Google Chat), it exploited and delivered on that expectation of immediacy. In our age of instant knowledge via search engines and Wikipedia, this impedance match is a particularly nice touch that, perhaps ironically, humanizes the experience so it feels like a phone call. Interestingly enough, in a pioneering QA system called AnswerGarden, Mark Ackerman observed that users were often more satisfied when an answer came back

| a p r i l 201 2 | vo l . 5 5 | no. 4

quickly, even if the answer was somewhat less than perfect.1 On social interactions: Aardvark places emphasis on the social interaction just as much as getting the information—just as if there was a smart assistant who knew your Rolodex and made that phone call for you. Indeed, in Evans and Chi,2 we showed how social interactions were present and pervasive throughout the information seeking episode—before, during, and after the core search task. On expertise: Aardvark skillfully exploited the design knowledge gained from years of search engine research to scale the algorithms so that it can route those questions to others who are most likely able to answer it at that very moment. In fact, they followed the original meme of describing the “anatomy” of a search engine in describing their own system—a meme worth repeating in all areas of computer science involved in engineering real-world systems. Users want one thing—getting their questions answered immediately. Search engines have played that role for many years now. It can be argued that the greatest impact computers have had on the human endeavor is the Web search engine, whose development and refinement seems to be the epitome of computer science. That was before the Web truly became social. In the brave new social Web, search will be different, and reading this paper will give you a sense of the direction social search engines are headed. References 1. Ackerman, M.S. Augmenting organizational memory: A field study of answer garden. ACM Trans. Inf. Syst. 16, 3 (July 1998), 203-224; http://doi.acm. org/10.1145/290159.290160 2. Evans, B.M. and Chi, E.H. An elaborated model of social search. Information Processing & Management; http://dx.doi.org/10.1016/j.ipm.2009.10.012 Ed H. Chi ([email protected]) is staff research scientist at Google Research, Mountain View, CA. © 2012 ACM 0001-0782/12/04 $10.00

searching for expertise on the social web ... - Research

ready there. Before Aardvark, social QA systems used a wide variety of techniques to route questions, most often using ex- perience/reputation points or mon-.

461KB Sizes 0 Downloads 254 Views

Recommend Documents

Who knows?: searching for expertise on the ... - ACM Digital Library
ple had to do to find the answer to a question before the Web. Imagine it is. 1990, before the age of search engines, and of course, Wikipedia. You have.

Searching the Web by Voice - CiteSeerX
query traffic is covered by the vocabulary of the lan- ... according to their likelihood ratios, and selecting all ... discovery algorithm considers all n − 1 possible.

Leveraging Social Context for Searching Social Media
Oct 30, 2008 - social media sites depends on providing tools that allow users to productively ... Social media is composed of multiple “social” data struc- tures that are ..... on Web Search and Data Mining, pages 183–194, New. York, 2008.

What Are People Searching on Government Web Sites? - School of ...
tion Science and Technology 56, 13 (2005), 1363–1376. 3. Cooley, R. ... College of Business Administration at the University of Toledo, OH. Olivia R. Liu Sheng ...

Effective Web Searching on Mobile Devices
the time limit, and these were regarded as missing data. We chose the ... alternative visualization of page structure, such documents could be segmented at.

what are people searching on government web ... - Semantic Scholar
through the Internet. Due in part to this Act, large amounts of government infor- mation have been put online and made publicly accessible. The provision of ..... 0. 100. 200. 300. 400. 500. 600. 700. 800. 900. 1000. 3/1/2003. 4/1/2003. 5/1/2003. 6/1

job searching with social media for dummies pdf
job searching with social media for dummies pdf. job searching with social media for dummies pdf. Open. Extract. Open with. Sign In. Main menu. Displaying job ...

Searching for superspreaders of information in real-world social ...
Searching for superspreaders of information in real-world social media.pdf. Searching for superspreaders of information in real-world social media.pdf. Open.

Searching for Build Debt: Experiences ... - Research at Google
include additional metadata about building the project [3],. [4]. BUILD files are for the most part manually maintained, and this lack of automation can be a ...

Research Proposal on Social Network ...
Research Proposal on Social Network Recommendation Systems. Nabi A. Rezvani. 1 Introduction. Recommendation systems have been the topic of a lot of ...

Research Proposal on Social Network ...
social network-specific recommendations that can be offered to their users,data and ... To tackle those problems, two approaches have been proposed [9, 10].

Summerhill Revisited: Searching for a Perspective on ...
helped him with his work; in the warm dedication to Hart in his well- ... be quite remarkable.3 However, in a letter which now appears in the bookAll the Best,.

Current Trends in the Integration of Searching ... - Research at Google
school argues that guided navigation is superfluous since free form search has ... school advocates the use of meta-data for narrowing large sets of results, and ...

Searching for Activation Functions - arXiv
Oct 27, 2017 - Practically, Swish can be implemented with a single line code change in most deep learning libraries, such as TensorFlow (Abadi et al., 2016) (e.g., x * tf.sigmoid(beta * x) or tf.nn.swish(x) if using a version of TensorFlow released a

Social annotations in web search - Research at Google
diversity, and personal relevance of social information on- line makes it a .... Beyond web search and social question-answering systems, simply displaying or ...

Searching the Scriptures study
Duplication of copyrighted material for commercial use is strictly prohibited. Committed to Excellence in Communicating Biblical Truth and Its Application. S01.

Ethics Expertise Instruments in Social Work Institutions
aims to implement in all sectors of activity. In our research, we aim to audit the implementation of these policies at the level of the services of social work, as part ...

Searching the Scriptures study
reminds us that God still uses imperfect people. • We are stabilized when we have similar experiences. Think of Abraham and. Sarah's heartache through years of infertility, their grief over moving away from their homeland, or their intense family c

Searching the Scriptures study
Duplication of copyrighted material for commercial use is strictly prohibited. Committed to Excellence in Communicating Biblical Truth and Its Application. S22.

Searching the Scriptures study
(Genesis 22:5, emphasis added). Don't miss the implication of the little pronoun we: “we will come right back.” Somehow, Abraham knew. Isaac would return with him. What trust! STUDY. ABRAHAM: ONE NOMAD'S AMAZING. JOURNEY OF FAITH. Portrait of a H

Towards a Framework for Social Web Platforms: The ...
Sensitive handling of data, a stable and fast website, rules of behavior, and ... users, but omitting a clear and well-structured approach, resulting in a series of arising ..... Information Growth Through 2010”, IDC white paper, www.emc.com.

Social cognition on the Internet - testing constraints on social ...
as such: it is about social complexity and the limits. placed on ... Page 3 of 10. Social cognition on the Internet - testing constraints on social network size.pdf.

Towards a Framework for Social Web Platforms: The ...
factors and challenges for communities and social networks is available .... publicly available to the best of our knowledge. As it can ... From a business view, we.