Transcript
Page 1: Organizing the People’s Voices on Political Controversies

Organizing the People’s Voices on Political Controversies

Rawia AwadallahGerhard Weikum

Max-Planck Institute for Informatics, Germany

Maya Ramanath

IIT-Delhi, India

Page 2: Organizing the People’s Voices on Political Controversies

Politicians have opinions(but none of us can remember them)

• Lots of issues, stake-holders, opinions• Great to have an

“opinion-base” which tells us who stands where

Page 3: Organizing the People’s Voices on Political Controversies

An opinion-baseEntity Polarit

y Topic Context

Barack Obama supports Military Action in Libya

“…President Obama Authorizes Limited Military Action in Libya...”

Nicolas Sarkozy supports Military Action in Libya

“…Sarkozy supports military action in Libya…”

UN Security Council

supports No-Fly Zone on Libya

“…U.N. Security Council approves no-fly zone in Libya…”

Germany opposes No-Fly Zone on Libya

“…Germany blocks plans for Libya no fly zone…”

Page 4: Organizing the People’s Voices on Political Controversies

Opinion Network

Barack_Obama Angela_Merkel UN_Security_Council

Military_Action_in_Libya No-fly_Zone Gaddafi’s_Response_to_Civil_War

Libyan_Civil_War_2011

War_Crimes_in_Libya

Illegal_Immigration

SS

O OS

Entities

Facets

Topic Hierarchy

Page 5: Organizing the People’s Voices on Political Controversies

OpinioNetItCandidate Opinion- Snippets

Entity and facet

extraction

Canonical forms for entities

and facets

Organization of topic hierarchy

War on TerrorAfghanistan_WarTaliban_

NegotiationsDrone_Strikes

Iraq_WarSuicide_Bombin

gs

EntityAfghan President

FacetTalks with Taliban

Hamid_KarzaiAfghan PresidentKarzai

Taliban_NegotiationsTaliban TalksTalks with Taliban

Page 6: Organizing the People’s Voices on Political Controversies

Prime Minister David Cameron met Mr Gates in Downing Street on Monday and restated his support for American strategy in Afghanistan.

Acquiring Snippets• “Web”– Newspapers: AlJazeera, CNN,

BBC– Wikipedia

• Seed phrases as queries– “he supports”, “she supports”– “he voted for”, “he voted

against”

Candidate Opinion- Snippets

Republican Senator Jon Kyl is a supporter of the Arizona immigration law

Robert Gates, the US defence secretary, has acknowledged that projections that are based on proposed military timelines may not be accurate, but stressed that the Pentagon is not exempt from belt-tightening because of its charge of defending the country.

Page 7: Organizing the People’s Voices on Political Controversies

Prime Minister David Cameron met Mr Gates in Downing Street on Monday and restated his support for American strategy in Afghanistan.

Republican Senator Jon Kyl is a supporter of the Arizona immigration law

Entity and facet• Parse sentence to extract

entity and facet– Dependency parsing used:

look for subject and object– Lots of heuristics

• Expected parsing to be easy– It was easier, not easy

Entity and facet

extraction

Candidate Opinion- Snippets

Robert Gates, the US defence secretary, has acknowledged that projections that are based on proposed military timelines may not be accurate, but stressed that the Pentagon is not exempt from belt-tightening because of its charge of defending the country.

Page 8: Organizing the People’s Voices on Political Controversies

Raw facets and entities• Lots of entities

“Gaddaffi”, “Qaddaffi”“Obama”, “U.S. President”

• Lots of raw facets“UN mandate against Libya”“use of force against Libyan civilians”“military air strikes on Libyan cities”“coalition air strikes on Libya”

Entity and facet

extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facets

Page 9: Organizing the People’s Voices on Political Controversies

Canonical names• Canonical names derived

from YAGOEntity and

facet extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facetsBarack_Oba

ma

Obama President Obama

Barack Hussein Obama

Michelle_Obama

means

preferred meaning

means

Page 10: Organizing the People’s Voices on Political Controversies

Canonical facets (1/3)• Wikipedia– Good source for labels– Topics not always controversial

• Debatepedia– Lots of debates– Debates mean controversial

topics• Map to Debatepedia, then to

Wikipedia

Entity and facet

extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facets

Page 11: Organizing the People’s Voices on Political Controversies

Canonical facets (2/3)

Entity and facet

extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facets

Article title

Category 1, 2,…

ARTICLETEXT

Article title

Category 1, 2,…

ARTICLETEXT

Article title

Category 1, 2,…

ARTICLETEXT

D1k

Category 1, 2,…

ARTICLETEXT

TOPIC T1

Article title

Category 1, 2,…

ARTICLETEXT

Article title

Category 1, 2,…

ARTICLETEXT

Article title

Category 1, 2,…

ARTICLETEXT

Dnj

Category 1, 2,…

ARTICLETEXT

TOPIC Tn

Debatepedia Articles

Page 12: Organizing the People’s Voices on Political Controversies

Canonical facets (3/3)

Entity and facet

extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facets

Article title

Category 1, 2,…

ARTICLETEXT

Topic T, Document Di

• Used for ranking debates• Scores of top-10 results used to

discard “useless” facets• Title of top debate used for

canonical name

Raw facet, f

Page 13: Organizing the People’s Voices on Political Controversies

Topic Hierarchy• Debatepedia to Wikipedia

Entity and facet

extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facets

Organization of topic hierarchy

Canonical facet name + documentArticle title

Category 1, 2,…

ARTICLETEXT

ARTICLETEXT

Article title

Category 1, 2,…

ARTICLETEXT

Article title

Category 1, 2,…

ARTICLETEXT

Article title

Category 1, 2,…

ARTICLETEXT

Top 3 Wikipedia articles

Top 3 Wikipedia categories Candidate categories

Page 14: Organizing the People’s Voices on Political Controversies

Constructing the hierarchy

Entity and facet

extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facets

Organization of topic hierarchy

Iran-Iraq War

Iraq War

Iran’s nuclear energy

Bilateral relations of Israel

Israel’s weapons of mass destruction

Israeli-Palestinian conflict Israeli

Nuclear Energy

Iran’s nuclear program

Iran’s weapons

Iran’s politics

410

Depends on no. of raw facets mapped to it

Depends on no. of common subcategories

Page 15: Organizing the People’s Voices on Political Controversies

Constructing the hierarchy

Entity and facet

extraction

Candidate Opinion- Snippets

Canonical forms for entities

and facets

Organization of topic hierarchy

Iran-Iraq War

Iraq War

Bilateral relations of Israel

Israel’s weapons of

mass destructionIsraeli-

Palestinian conflict

Israeli Nuclear Energy

Iran’s nuclear program

Iran’s weapons

Iran’s politics

Iran’s nuclear energy

Graph coarsening algorithm to cluster leads to a hypergraph

Page 16: Organizing the People’s Voices on Political Controversies

Building a lexicon• Unsupervised– Query Google with

<entity, facet> pairs• Supervised (details in the

paper)– n-grams–mutual information– synonyms and

antonyms

Candidate Opinion- Snippets

Entity and facet

extraction

Lexicon of Support/O

ppose phrases

Canonical forms for entities

and facets

Organization of topic hierarchy

Page 17: Organizing the People’s Voices on Political Controversies

Lexicon of support/oppose phrases

Obama strongly defends US Military Action in Libya Barack Obama has aligned himself with Nicolas Sarkozy by committing to support military action in Libya US President Barack Obama defended his decision to launch military action in Libya President Obama said Saturday that he had authorized limited military action in Libya President Obama tells Americans that he ordered military action in Libya

SUPPORT OPPOSE

approve criticized

acknowledge speak againstcampaigned for

campaigned against

strongly defends attacks

Unsupervised

Page 18: Organizing the People’s Voices on Political Controversies

Evaluation• End-to-end experiments (Metric:

Precision)– Random sample– Focused sample– Ground truth set

• Quality of topic hierarchy • Quality of support/oppose lexicon

Page 19: Organizing the People’s Voices on Political Controversies

End-to-end experiments

AlJazeera

BBC CNN Googl

eNYTime

sWikipedi

aOvera

ll

# 970 3349

2650 6861 9877 5941 29648

Prec. 0.72 0.6

6 0.78 0.79 0.74 0.69 0.72

2000 randomly selected opinions were evaluated

Errors in extraction• Attributing the opinion to the incorrect entity (45%)• Facet extraction (45%)• Seeds were incorrect (9%)

Page 20: Organizing the People’s Voices on Political Controversies

Thank you

Time to express your opinions!

Candidate Opinion- Snippets

Entity and facet

extraction

Lexicon of Support/O

ppose phrases

Canonical forms for entities

and facets

Organization of topic hierarchy


Recommended