Social Signals: Any Impacts in Search?

3. Signals Diversity

Social Signals: Any Impacts in Search?

Information Retrieval, Social Signals, Popularity, Reputation, Freshness, Diversity, Ranking

►Context:

Exploiting social signals to enhance a search.

Do the quality, temporality and diversity of signals matter to capture relevant

documents?

►Research Questions:

How to estimate the popularity and reputation of a resource using social signals?

What is the impact of signals diversity and signals freshness on IR system?

How to normalize signals with resource age?

1. Introduction

TemporalityDiversity

Origin

NatureRating

54321Signification

Ismail Badache and Mohand Boughanem

IRIS Team - IRIT - Paul Sabatier University, Toulouse

{Badache, Boughanem}@irit.fr

►Signals freshness in a resource

►Signals normalization with resource age

4. Time-Aware Signals

2. Signals and Properties

5. Experimental Evaluation

Baselines

0,0487

0,0517

0,05

Lucene Solr BM25 ML.Hiemstra

Facebook

0,0689 0,0711 0,06780,0559 0,0531

Like Share Comment Rating Tag

Social Signals Individually

+23% +27% +21%

+11% +5%

Social Signals Grouped

0,0791

0,078

0,08010,0787

0,0888

TotalFB Popularity Reputation

AllCriteria AllProperties

+55%

+41%

+41%

+38%

+43%

Reputation

AllProperties

Resource Age

0,07080,0796

0,0711 0,0695

0,058

Like Share Comment Rating Tag

+5%+19%+4%

+12%+3%

Date of Signal

0,0732

Rating

+31%

0,1223

0,110,1114

0,1301

Naïve Bayes (CFS) Naïve Bayes (WRP)

SVM (SVM) J48 (RLF)

+132%

+99%+96%

+118%

Machine Learning (Signals)

Time-Aware Signals

0,0840,0862

0,08910,0915

0,0976

TotalFB Popularity Reputation

AllCriteria AllProperties

Signals Diversity

+11%

+10%

+16%

►Dataset:

- INEX Social Book Search 2015.

- 208 INEX SBS Topics and their relevance judgments.

Property Social signal Social Network

Popularity

Number of Comment Facebook

Number of Share Facebook

Number of Tag Amazon/LT

ReputationNumber of Like Facebook

Number of Rating Amazon/LT

Table 1. Exploited social signals in quantification