Relatedness-based Multi-Entity Summarization

Kalpa Gunaratna1, Amir Hossein Yazdavar1, Krishnaprasad Thirunarayan1,

Amit Sheth1, and Gong Cheng2

1Kno.e.sis Center, Wright State University, Dayton OH, USA2National Key Laboratory for Novel Software Technology, Nanjing University, China

Reading news online

Within one month of the iPod nano and iTunes phone special event, Apple Computer announced today another special event to be held on October 12. It is to be held at the California Theater in downtown San Jose, California. The invitation reads, “One more thing…”, the teasing tagline of Steve Jobs.

Text enriched by entity linking with knowledge bases

Within one month of the iPod nano and iTunes phone special event, Apple Computer announced today another special event to be held on October 12. It is to be held at the California Theater in downtown San Jose, California. The invitation reads, “One more thing…”, the teasing tagline of Steve Jobs.

Text enriched by entity linking with knowledge bases

Within one month of the iPod nano and iTunes phone special event, Apple Computer announced today another special event to be held on October 12. It is to be held at the California Theater in downtown San Jose, California. The invitation reads, “One more thing…”, the teasing tagline of Steve Jobs.

Apple Inc. is an American multinational technology company headquartered in Cupertino, California that …

such as a textual pop-up from Wikipedia

Text enriched by entity linking with knowledge bases

Within one month of the iPod nano and iTunes phone special event, Apple Computer announced today another special event to be held on October 12. It is to be held at the California Theater in downtown San Jose, California. The invitation reads, “One more thing…”, the teasing tagline of Steve Jobs.

or a structured pop-up from DBpedia or Wikidata

founders:Steve_jobsproduct: IPodlocation: Californiaindustry: Consumer_electronics

An entity can have several hundred property-value pairs (called features).

… …

An entity can have several hundred property-value pairs (called features).

… …

An entity summary is a subset of k features (to fit in a pop-up).

Entity summarization(previous research)• Problem statement (k=3, in this example)

Entity summarization(previous research)• Problem statement (k=3, in this example)

• Research challenge• To select important and diverse features

Text enriched by entity linking with knowledge bases

Within one month of the iPod nano and iTunes phone special event, Apple Computer announced today another special event to be held on October 12. It is to be held at the California Theater in downtown San Jose, California. The invitation reads, “One more thing…”, the teasing tagline of Steve Jobs.

founders:Steve_jobsproduct: IPodlocation: Californiaindustry: Consumer_electronics

Text enriched by entity linking with knowledge bases

Within one month of the iPod nano and iTunesphone special event, Apple Computer announced today another special event to be held on October 12. It is to be held at the California Theater in downtown San Jose, California. The invitation reads, “One more thing…”, the teasing tagline of Steve Jobs.

founders:Steve_jobsproduct: IPodlocation: Californiaindustry: Consumer_electronics

after: Tim_CookknownFor: Microcomputer_revolutiontitle: Apple_Inc.birthPlace: California

Text enriched by entity linking with knowledge bases

Within one month of the iPod nano and iTunesphone special event, Apple Computer announced today another special event to be held on October 12. It is to be held at the California Theater in downtown San Jose, California. The invitation reads, “One more thing…”, the teasing tagline of Steve Jobs.

founders:Steve_jobsproduct: IPodlocation: Californiaindustry: Consumer_electronics

after: Tim_CookknownFor: Microcomputer_revolutiontitle: Apple_Inc.birthPlace: California

Multi-entity summarization

• Problem statement (n=3, k=3, in this example)

• New research challenge• To select intra-entity important and diverse features• To select inter-entity related features

i.e., context-dependent entity summarization (context: other entities)

Multi-entity summarization

• Problem statement (n=3, k=3, in this example)

• New research challenge• To select intra-entity important and diverse features• To select inter-entity related features

i.e., context-dependent entity summarization (context: other entities)

Multi-entity summarization

• Problem statement (n=3, k=3, in this example)

• New research challenge• To select intra-entity important and diverse features• To select inter-entity related features

i.e., context-dependent entity summarization (context: other entities)

• Multi-entity summarization as aQuadratic Multidimensional Knapsack Problem (QMKP),to jointly generate summaries for n entities

Problem formulation

• Multi-entity summarization as aQuadratic Multidimensional Knapsack Problem (QMKP),to jointly generate summaries for n entities

Problem formulation

Profit earned by selecting a feature f:Intra-entity importance of f

• Multi-entity summarization as aQuadratic Multidimensional Knapsack Problem (QMKP),to jointly generate summaries for n entities

Problem formulation

Profit earned by selecting a feature f:Intra-entity importance of f

Profit earned by selecting two features fi and fj describing the same entity:Intra-entity dissimilarity between fi and fj

• Multi-entity summarization as aQuadratic Multidimensional Knapsack Problem (QMKP),to jointly generate summaries for n entities

Problem formulation

Profit earned by selecting two features fi and fj describing the same entity:Intra-entity dissimilarity between fi and fj

Profit earned by selecting a feature f:Intra-entity importance of f

Profit earned by selecting two features fi and fj describing different entities:Inter-entity relatedness between fi and fj

• Multi-entity summarization as aQuadratic Multidimensional Knapsack Problem (QMKP),to jointly generate summaries for n entities

Problem formulation

Profit earned by selecting two features fi and fj describing the same entity:Intra-entity dissimilarity between fi and fj

Profit earned by selecting a feature f:Intra-entity importance of f

Profit earned by selecting two features fi and fj describing different entities:Inter-entity relatedness between fi and fj

n constraints:Selecting at most k features for each of the n entities

Solution

• A GRASP algorithm for QMKP

• Measures• Importance of a feature (i.e., property-value pair):

Informativeness of feature * popularity of value

• Dissimilarity between two features:Negative semantic similarity

• Relatedness between two features:Semantic similarity

Solution

• A GRASP algorithm for QMKP

• Measures• Importance of a feature (i.e., property-value pair):

Informativeness of feature * popularity of value

• Dissimilarity between two features:Negative semantic similarity

• Relatedness between two features:Semantic similarity WordNet-based similarity between properties +

graph-embedding-based similarity between values

User study

• 2 datasets on news, linked with entities in DBpedia

• 3 entity summarizers• REMES: our multi-entity summarizer

• FACES & RELIN: two state-of-the-art entity summarizers

Take-home messages

• Multi-entity summarization (MES)• finds applications (e.g., news item presentation)

• faces new research challenges (e.g., inter-entity relatedness)

• needs specialized approaches

• Future work• Improved methods for relatedness-based MES

• Extended methods for novel applications of MES