by - Machines€¦ · The Genesis Story Understanding and Story Telling System A 21st Century Step toward Artiﬁcial Intelligence by Patrick Henry Winston Abstract: Story understanding

CBMM Memo No. 019 June 10, 2014

The Genesis Story Understanding and Story Telling SystemA 21st Century Step toward Artificial Intelligence

by

Patrick Henry Winston

Abstract: Story understanding is an important differentiator of human intelligence, perhaps the most importantdifferentiator. The Genesis system was built to model and explore aspects of story understanding using simplyexpressed, 20-100 sentence stories drawn from sources ranging from fairy tales to Shakespeare’s plays. I describeGenesis at work as it reflects on its reading, searching for concepts, reads stories with controllable allegiancesand cultural biases, models personality traits, answers basic questions about why and when, notes concept onsets,anticipating trouble, calculates similarity using concepts, models question-driven interpretation, aligns similarstories for analogical reasoning, develops summaries, and tells and persuades using a reader model. I conclude withthoughts on how Genesis would describe people in pictures and video, thus engaging with the CBMM challengeproblem.

This work was supported, in part, by the Center for Brains, Minds andMachines (CBMM), funded by NSF STC award CCF - 1231216.

Vision: a distinguishing difference and a shared substrateMarvin Minsky published Steps toward Artificial Intelligence a little more than 50 years ago (1961). Now, half acentury later, Deep Blue, Watson, and Siri amaze everyone and stand as testaments to engineering skill, but theapplications dreamed of in 1961 remain far from realized:

• No language system has the common sense required to understand what it is reading and the implications thatflow from common sense understanding.

• No vision system understands the visual world well enough to report instances of more than a handful of the 48actions cited in DARPA’s 2010 Mind’s Eye BAA.

Why are there no such systems? I think it is because we remain ignorant of how our species is different fromothers, and we remain ignorant of how the differences are enabled by a shared substrate.

In this white paper, I focus on story understanding, which I believe is the key difference between us and all otherprimates, living and extinct. I catalog our work on story-understanding tools, describing some of the capabilitiesof our Genesis story-understanding system.

Steps: Specify behavior, develop representations, build GenesisIt is evident that we learn a great deal about life from stories, which include fairy and folk tales, religious parables,ethnic narratives, entertainment, news, history, literature, and experience. It is also evident that we learn a greatdeal professionally from case studies in law, business, medicine, defense, diplomacy, science, and engineering.

To understand how we understand and learn from stories, I believe we must first specify the behavior we wantto model, then develop a suite of constraint exposing representations, then build our Genesis story understandingsystem so as to test our ideas. I believe success will lead to understanding human intelligence and to paradigm-shifting engineering practice built on that understanding.

What Genesis modelsI have elaborated on our perspective in a trilogy: The Strong Story Hypothesis and the Directed Perception Hypoth-esis (2011) introduces two key hypotheses about human intelligence and ties story telling to directed perception;The Right Way (2012b) emphasizes mythological steps; and The next 50 years: A personal view (2012a) focuseson asking the right questions about how we are different from other primates and how we are the same.

My purpose here is to add to those previous papers an account of what the Genesis system now models by wayof reading, deliberating, reflecting, cultural bias, personality understanding, question answering, onset detection,similarity measurement, similarity based retrieval, question driven interpretation, analogical interpretation, readeraware story telling, persuasion, and summary.

Genesis reads stories, common sense rules, and concept descriptionsWe of the Genesis Group spend a lot of time with a short summary of Macbeth. Shakespeare, in general, tells usabout the human condition, his plays constitute a good anvil for hammering out story understanding ideas.

Macbeth is a thane and Macduff is a thane. Lady Macbeth is evil and greedy. Duncan is the king, andMacbeth is Duncan’s successor. Duncan is an enemy of Cawdor. Macduff is an enemy of Cawdor. Duncanis Macduff’s friend. Macbeth defeated Cawdor. Duncan becomes happy because Macbeth defeatedCawdor. Witches had visions and danced. Macbeth talks with Witches. Witches make predictions.Witches astonish Macbeth. Macbeth becomes Thane of Cawdor. Duncan rewarded Macbeth becauseDuncan became happy. Macbeth wants to become king because Lady Macbeth persuaded Macbeth towant to become the king. Macbeth invites Duncan to dinner. Duncan goes to bed. Duncan’s guardsbecome drunk and sleep. Macbeth murders Duncan. Macbeth murders guards. Macbeth becomes king.Malcolm and Donalbain flee. Macbeth’s murdering Duncan leads to Macduff’s fleeing to England. Then,Macduff’s fleeing to England leads to Macbeth’s murdering Lady Macduff. Macbeth hallucinates at a

1

http://dspace.mit.edu/handle/1721.1/67693



http://groups.csail.mit.edu/genesis/papers/2012bica-phw

dinner. Lady Macbeth says he hallucinates often. Everyone leaves. Macbeth’s murdering Duncan leadsto Lady Macbeth’s becoming distraught. Lady Macbeth has bad dreams. Lady Macbeth thinks she hasblood on her hands. Lady Macbeth kills herself. Birham Wood is a forest. Burnham Wood goes toDunsinane. Macduff’s army attacks Macbeth’s castle. Macduff curses Macbeth. Macbeth refuses tosurrender. Macduff kills Macbeth. The end.

I noted early on that what works for Macbeth works also for other kinds of conflict. All of the infrastructureand much of the knowledge developed to deal with Macbeth transferred over to our work on the Estonia-Russiacyber war of 2007.

Estonia built Estonia’s computer networks. Estonia insulted Russia because Estonia relocated a warmemorial. Russia wanted to harm Estonia. Someone attacked Estonia’s computer networks after Estoniaharmed Russia. Russia attacked Estonia’s computer networks. The attack on Estonia’s computer networksincluded the jamming of the web sites. The jamming of the sites showed that someone did not respectEstonia. Estonia created a center to study computer security. Estonia believed other states would supportthe center. The end.

The Estonia-Russia cyber war is much like other conflicts. Dealing, for example, with the Congo civil war ina retrieval experiment introduced no challenges.

Genesis deploys common sense rules to develop basic understanding

07:46:09 EDT 13-Apr-2014

AboutReadDemonstrate

Macbeth/revenge

Total time elapsed: 13.9 sec

Story reading time: 4.9 sec

Total elements: 81

Inferred elements: 38

Explicit elements: 43

Discoveries: 9

Concepts: 14

Inferences: 64

Rules: 39

Analysis

100%100%

SuicidePyrrhic victoryPyrrhic victoryMistake because har...Mistake because har...Mistake because unh...Answered prayerSuccessRevenge

Lady Macbethis Macbeth's

wife.

Macbeth is LadyMacbeth'shusband.

Macbeth is LadyMacbeth's

relation.


friend.

Macbeth is LadyMacbeth's friend.


relation.



friend.


relation.

Macbeth is LadyMacbeth's

relation.

Lady Macduffis Macduff's

wife.

Macduff is LadyMacduff'shusband.

Macduff is LadyMacduff's relation.


friend.

Macduff is LadyMacduff's friend.


relation.



friend.


relation.


Macduff isCawdor'senemy.

Duncan isCawdor'senemy.

Macduff isDuncan's

friend.

Duncan isMacduff's

friend.

MacbethdefeatsCawdor.

Duncanbecomeshappy.

DuncanrewardsMacbeth.

Lady Macbethpersuades Macbethto want to become

king.

Macbethwants to

become king.

Duncanis a king.

Macbeth isDuncan's

successor.

MacbethmurdersDuncan.

Duncanbecomes

dead.

Macbethbecomes

king.

Lady Macbethbecomes

queen.

Macbethbecomeshappy.

Macbethharms

Duncan.

Macbethharms

Macduff.

Macbethharms

Duncan.

Macbethharms Lady

Macduff.

Macbethharms

Macduff.

Lady Macduffbecomesunhappy.

Macbethangers Lady

Macduff.

Macduffbecomesunhappy.

Macbethangers

Macduff.

Macduffflees to

England.

Lady Macbethbecomes

distraught.

Macbethmurders Lady

Macduff.

Lady Macduffbecomes

dead.

Macbethharms Lady

Macduff.

Macbethharms

Macduff.

Macbethharms

Duncan.

Macbethharms

Macduff.

Macbethharms Lady

Macduff.


Macbethangers

Macduff.

Lady Macbethkills herself.

Lady Macbethbecomes

dead.

Lady Macbethharms herself.

Lady Macbethharms

Macbeth.


Macbethbecomesunhappy.

Lady Macbethangers

Macbeth.

Macduff killsMacbeth.

Macbethbecomes

dead.

Macduffharms

Macbeth.

Macduffharms Lady

Macbeth.

Macduffharms

Macbeth.

Elaboration graph

StorySummaryResultsSourcesInspectorElaboration graphExpertsStart viewerControlsViews|||

Figure 1: Genesis produces elaboration graphs, as shown for a summary of Macbeth. Common sense rules connect explicitand inferred elements of the story. (This figure is included at high resolution in the electronic version of this document.)

Genesis uses Boris Katz’s START (1997) system to translate Genesis English into an inner language of relationsand events. Genesis then uses common sense to build an elaboration graph as shown in figure 1. Elements inyellow are established by inference rules as indicated by black connecting lines. The story itself supplies theelements in white, orange, and blue.

Explanation rules tie elements in orange to other elements. In reading a story, we humans seek explanations,and if none is offered, we assume connections that may hold, but not with sufficient regularity to be added by

2

inference rules. In Macbeth, the story itself supplies no explicit reason why Macbeth murders Duncan and noinference rule supplies a reason, so an explanation rule connects the murder to Macbeth’s wanting to be king,Macbeth’s being Duncan’s successor, and Duncan’s being king.

Leads-to expressions connect elements in blue to other elements. These are supplied by expressions in thestory, such as Macbeth’s murdering Duncan leads to Macduff’s fleeing to England. Such expressions indicatewhen two elements are known to be connected but the exact causal path is not known, or at least not supplied.

Genesis reflects on its reading, searching for conceptsOnce Genesis builds the elaboration graph, Genesis uses ordinary search to find instances of concept patterns.In figure 2, Genesis notes a revenge pattern because Macbeth’s harming Macduff leads to Macduff’s harmingMacbeth. In figure 3, Genesis notes a Pyrrhic victory pattern because Macbeth’s actions at first make him happy,but then lead to his own harm.

07:51:26 EDT 13-Apr-2014


Macbeth/revenge



Total elements: 81



Discoveries: 9

Concepts: 14

Inferences: 64

Rules: 39

Analysis

100%100%

SuicidePyrrhic victoryPyrrhic victoryMistake beca...Mistake beca...Mistake beca...Answered pra...SuccessRevenge


wife.

Macbeth is Lady

Macbeth'shusband.

Macbeth is LadyMacbeth's relation.


friend.



relation.

Macbeth is Lady

Macbeth's friend.


friend.


relation.

Macbeth is Lady

Macbeth's relation.


wife.

Macduff is Lady

Macduff'shusband.



friend.

Macduff is Lady

Macduff's friend.


relation.

Macduff is Lady

Macduff's friend.


friend.


relation.

Macduff is Lady

Macduff's relation.

Macduff isCawdor's

enemy.

Duncan isCawdor's

enemy.

Macduff isDuncan's

friend.

Duncan isMacduff's

friend.

MacbethdefeatsCawdor.

Duncanbecomes

happy.

DuncanrewardsMacbeth.

Lady Macbeth

persuadesMacbeth to want

to become king.

Macbeth wants tobecome king.

Duncanis a king.

Macbeth isDuncan'ssuccessor.


Duncanbecomes

dead.

Macbethbecomes

king.

Lady Macbethbecomes

queen.


Macbethharms

Duncan.

Macbethharms

Macduff.

Macbethharms

Duncan.

Macbethharms Lady

Macduff.

Macbethharms

Macduff.


Macbethangers Lady

Macduff.


Macbethangers

Macduff.

Macduffflees to

England.

Lady Macbethbecomes

distraught.

Macbethmurders Lady

Macduff.

Lady Macduffbecomes dead.

Macbethharms Lady

Macduff.

Macbethharms

Macduff.

Macbethharms

Duncan.

Macbethharms

Macduff.

Macbethharms Lady

Macduff.


Macbethangers

Macduff.

LadyMacbeth

kills herself.

Lady Macbethbecomes dead.


Lady Macbethharms

Macbeth.



Lady Macbethangers

Macbeth.


Macbethbecomes

dead.

Macduffharms

Macbeth.

Macduffharms Lady

Macbeth.

Macduffharms

Macbeth.

Elaboration graph


Macbethharms

Macduff.

Macbethangers

Macduff.


Macduffharms

Macbeth.

Inspector


Figure 2: Genesis finds concept patterns by searching the elaboration graph. Here, Genesis shows revenge elements in greenin the Elaboration graph panel provides a close-up view in the Inspector panel.

Once Genesis builds the elaboration graph, Genesis uses ordinary search to find instances of concept patterns.In figure 2, Genesis notes a revenge pattern because Macbeth’s harming Macduff leads to Macduff’s harmingMacbeth. In figure 3, Genesis notes a Pyrrhic victory pattern because Macbeth’s actions at first make him happy,but then lead to his own harm.

Our first work on concept patterns appeared in the MEng thesis of David Nackoul (2010).

3

http://groups.csail.mit.edu/genesis/papers/Nackoul 2010.pdf

07:43:58 EDT 13-Apr-2014


Macbeth/revenge



Total elements: 81



Discoveries: 9

Concepts: 14

Inferences: 64

Rules: 39

Analysis

100%100%

SuicidePyrrhic victoryPyrrhic victoryMistake because har...Mistake because har...Mistake because unh...Answered prayerSuccessRevenge

Lady Macbeth isMacbeth's wife.

Macbeth is LadyMacbeth's husband.


Lady Macbeth isMacbeth's friend.


Lady Macbeth isMacbeth's relation.





Lady Macduff isMacduff's wife.

Macduff is LadyMacduff's husband.


Lady Macduff isMacduff's friend.


Lady Macduff isMacduff's relation.





Macduff isCawdor's

enemy.

Duncan isCawdor's

enemy.

Macduff isDuncan's

friend.

Duncan isMacduff's

friend.

Macbethdefeats

Cawdor.

Duncanbecomes

happy.

Duncanrewards

Macbeth.

Lady Macbeth persuades

Macbeth to want to become king.

Macbethwants to

become king.

Duncan isa king.

Macbeth is

Duncan'ssuccessor.

Macbethmurders

Duncan.

Duncanbecomes

dead.

Macbethbecomes

king.

Lady Macbethbecomes queen.

Macbethbecomes

happy.

Macbethharms

Duncan.

Macbethharms

Macduff.

Macbethharms

Duncan.

Macbethharms Lady

Macduff.

Macbethharms

Macduff.


Macbethangers Lady

Macduff.

Macduffbecomes

unhappy.

Macbethangers

Macduff.

Macduff flees toEngland.

Lady Macbethbecomes

distraught.Macbeth murders Lady Macduff.


Macbethharms Lady

Macduff.

Macbethharms

Macduff.

Macbethharms

Duncan.

Macbethharms

Macduff.

Macbethharms Lady

Macduff.

Macduffbecomes

unhappy.

Macbethangers

Macduff.




Lady Macbethharms Macbeth.


Macbethbecomes

unhappy.

Lady Macbethangers Macbeth.


Macbethbecomes

dead.

Macduffharms

Macbeth.

Macduffharms Lady

Macbeth.

Macduffharms

Macbeth.

Elaboration graph


Macbethwants to

become king.

Duncanis a king.

Macbeth isDuncan's

successor.


Macbethbecomes

king.


Macduffflees to

England.

Macbethmurders Lady

Macduff.

Macbethharms Lady

Macduff.


friend.

Macbethharms

Macduff.

Macbethangers

Macduff.


Macduffharms

Macbeth.

Inspector


Figure 3: Genesis extracts the pyrrhic victory elements from the full elaboration graph.

Genesis reads stories with controllable allegiances and cultural biasesGenesis’s interpretation depends on the common sense rules, concept patterns supplied, and biases of the reader.In figure 4, the 2007 cyber war between Estonia and Russia is viewed as misguided revenge buy a reader friendlyto Estonia; the same cyber war is viewed as teaching Estonia a lesson by a reader friendly to Russia.

Similarly, in figure 5, an Eastern reader of Macbeth is more likely than a Western reader to see Macduff’skilling of Macbeth situationally, as a consequence of the situation Macduff is in; a Western reader is more like tosee the same killing dispositionally, as a consequence of insanity.

The most ambitious examples of cultural influence appear in the MEng thesis of Wolfgang Victor Yarlott(2014), who demonstrated Genesis at work on selected folktales from Native American Crow culture.

Genesis models personality traitsGenesis notes what various sorts of people do, which enables Genesis to infer personality traits on the basis ofwhat people do, which enables Genesis to use personality traits to explain acts.

In figure 6, Genesis notes early in the Macbeth story that Macduff assaults someone, a characteristic of viciouspeople, leading Genesis to consider Macduff to be vicious. Then, thinking that Macduff is vicious, Genesis explainsMacduff’s killing of Macbeth as a consequence of anger and Macduff’s vicious nature.

Our first work on personality traits appeared in the MEng thesis of Susan Song (2012).

Genesis answers basic questions about why and whenGenesis answers questions on various levels. As shown in figure 7, Genesis answers questions about cyber war byreciting elaboration graph elements connected to the target event and by noting how target events are embeddedin concepts. Additionally, as shown in figure 8, Genesis answers questions using personality traits associated withthe target event.

Genesis notes concept onsets, anticipating troubleConcepts generally involve leads-to relations. Noting the first part of a leads-to relation provides early warning ofpossible evolutions. As shown in figure 9, the potential for revenge, misguided retaliation, and mistake are noted

4

http://groups.csail.mit.edu/genesis/papers/Yarlott 2014.pdf

http://groups.csail.mit.edu/genesis/papers/song 2012.pdf

07:54:08 EDT 13-Apr-2014


Estonia/lesson



Total elements: 36



Discoveries: 5

Concepts: 14

Inferences: 19

Rules: 33

Analysis

100%100%

Teaching a l...Mistake be...Answered p...SuccessRevenge

Estonia buildscomputernetworks.

Estonia believescomputer networks

are valuable.

Estonia ownscomputernetworks.

Estoniarelocates war

memorial.

Estonia insultsRussia.

Estonia harmsRussia.

Estonia angersRussia.

Russia ismy friend.

Estoniaharms me.

Russiabecomesunhappy.

Estonia doesn'trespect Russia.

Russia wants to harm Estonia.

Russia wants todamage computer

networks.

Russia wants toattack computer

networks.

Someone attackscomputer networks.

Someoneharms Estonia.

Russia attackscomputer networks.

Russia attacksEstonia.

Russia harmsEstonia.

Russia angersEstonia.

Russiabecomes

happy.

Estoniabecomesunhappy.


Estonia createscenter.

Estonia studiescomputer security.

I am Russia'sfriend.

Russia is a

character.

Estonia is a

character.

Russia is a

country.

Estonia isa country.

Computernetworks are

artifacts.

Someone attackscomputer networks

after Estonia'sharming Russia.

Computer networksinclude web sites'

jamming.

For sites to jam shows that

someone doesn't respect

Estonia.

Someone doesn'trespect Estonia.

States supportcenter.

Estonia believesstates support

center.

Estonia/revenge



Total elements: 36



Discoveries: 5

Concepts: 14

Inferences: 19

Rules: 33

Analysis

100%100%

Misguided r...Mistake be...Answered p...SuccessRevenge

Estonia buildscomputer networks.

Estonia believescomputer networks

are valuable.



memorial.






Russia wantsto harmEstonia.

Russia wants todamage computer

networks.


networks.


Someoneharms Estonia.

Russia attackscomputer networks.




Estonia is

my friend.

Russiaharms me.

Russiabecomes

happy.

Estoniabecomesunhappy.


Estonia createscenter.

Estonia studiescomputer security.

I am Estonia's friend.Russia is a

character.

Estonia is a

character.

Russia isa country.

Estonia is a

country.

Computernetworks are

artifacts.

Someone attackscomputer networks

after Estonia'sharming Russia.

Computer networks include

web sites' jamming.

For sites to jam shows that

someone doesn't respect

Estonia.

Someone doesn'trespect Estonia.

States supportcenter.

Estonia believesstates support

center.

Elaboration graph



EstoniaangersRussia.


Estonia believescomputer

networks arevaluable.

Russia wants todamage

computernetworks.


Russia attackscomputernetworks.


RussiaattacksEstonia.

Russiaharms

Estonia.

Russia ismy friend.






Russia wants todamage

computernetworks.




RussiaattacksEstonia.

Russiaharms

Estonia.

Estonia ismy friend.

Inspector


Figure 4: Genesis views the 2007 cyber war between Estonia and Russia from the perspective of a friend of Estonia on theleft and from the perspective of a friend of Russia on the right. One sees misguided revenge; the other, teaching a lesson.

07:55:57 EDT 13-Apr-2014


Macbeth/western



Total elements: 81



Discoveries: 4

Concepts: 14

Inferences: 57

Rules: 38

Analysis

100%100%

SuicideInsane violenceInsane violenceInsane violence





















Macbeth defeatsCawdor.

Duncanbecomes happy.

Duncan rewardsMacbeth.


Macbeth to want to become

king.

Macbeth wantsto become king.


Duncanbecomes dead.

Duncanis a king.


Macbeth

becomes king.


Macbethbecomes happy.

Macbeth harmsDuncan.

Duncan isMacduff's friend.

Macbeth harmsMacduff.

Macbeth harmsLady Macduff.



Macbeth angers Lady Macduff.


Macbeth angersMacduff.

Macbethisn't sane.

Macduff flees

to England.

Lady Macbethbecomesdistraught.

Macbethmurders Lady

Macduff.







Macbethisn't sane.








Lady Macbethisn't sane.

Macduff kills

Macbeth.

Macbethbecomes dead.

Macduff harmsMacbeth.

Macduff harmsLady Macbeth.


Macduffisn't sane.

Macbeth/eastern



Total elements: 79



Discoveries: 9

Concepts: 14

Inferences: 57

Rules: 38

Analysis

100%100%

SuicidePyrrhic ...Pyrrhic ...Mistake ...Mistake ...Mistake ...Answer...SuccessRevenge





















Duncan isCawdor'senemy.

Macduff isCawdor'senemy.

Duncan isMacduff's friend.

Macbeth defeatsCawdor.

Duncanbecomes happy.

Duncan rewardsMacbeth.


Macbeth to want to become

king.

Macbeth wantsto become king.

Duncanis a king.



Duncanbecomes dead.

Macbeth

becomes king.


Macbethbecomes happy.

Macbeth harmsDuncan.





Macbeth angers Lady Macduff.



Macduff flees

to England.

Lady Macbethbecomesdistraught.

Macbethmurders Lady

Macduff.














Macduff kills

Macbeth.

Macbethbecomes dead.


Macduff harmsLady Macbeth.


Elaboration graph


Macduffisn't sane.

Macduffkills

Macbeth.

Macbethharms

Macduff.

Macbethangers

Macduff.

Macduffkills

Macbeth.

Macduffharms

Macbeth.

Inspector


Figure 5: Genesis views the killing of Macbeth from Eastern and Western points of view. One the left, the Eastern view, thekilling is situational; on the right, the Western view, dispositional.

early. All three eventually ensue, as shown in figure 10.

5

08:00:14 EDT 13-Apr-2014


ambitious evil crazy greedy machiavellian vicious

Vicious person's characteristics



Total elements: 5



Discoveries: 0

Concepts: 1

Inferences: 0

Rules: 3

Analysis

Macbethangers

Macduff.

Macduff is

vicious.

Macduffwants to kill

Macbeth.

Macduffkills

Macbeth.

Mental Models


Predictions Concept analysisPersonality analysis

Macduff seems to be vicious because Macduff assaults someone.

Macduff kills Macbeth because Macduff is vicious.

Results


Figure 6: Genesis notes early in the Macbeth story that Macduff has done a vicious act, which leads Genesis to use rulesassociated with visciousness further along in understanding the story.

08:24:17 EDT 13-Apr-2014


Why did Russia attack Estonia's computer networks?

Predictions Concept analysis Answers Speech

On a commonsense levelIt looks like Dr. Jekyll thinks Russia attacks computer networks, probably because Russia wants to damage computer networks and Someone attacks computer networks.

On a concept levelIt looks like Dr. Jekyll thinks Russia attacks computer networks is part of acts of Revenge, Success, Answered prayer, Mistake because harmed, and Misguided retaliation.

Results


Figure 7: Genesis answers a question about the Russia-Estonia cyber war on several levels.

08:23:02 EDT 13-Apr-2014


Why did Macduff kill Macbeth?

Personality analysis Predictions Concept analysis Answers Speech

From a personality perspectiveIt looks like Dr. Jekyll thinks Macduff kills Macbeth because he is vicious.

On a commonsense levelIt looks like Dr. Jekyll thinks Macduff kills Macbeth, probably because Macduff wants to kill Macbeth and Macduff is vicious.

On a concept levelIt looks like Dr. Jekyll thinks Macduff kills Macbeth is part of acts of Revenge, Answered prayer, Mistake because harmed, Pyrrhic victory, and Tragic greed.

Results


Figure 8: Genesis answers a question about Macbeth on several levels including a personality-focused level.

Genesis calculates similarity using conceptsGenesis judges similarity in multiple ways. One way is by using word vectors; another is by using concept vectors.Using concept vectors enables Genesis to see similarities not evident in the words. Two stories may involve, forexample, revenge, even though neither uses the word. The comparisons shown in figure 11 are on pairs of shortdescriptions of conflicts.

The example appears in the MEng thesis of Cary Krakauer (2012).

Genesis models question-driven interpretationAfter reading a story, a question may stimulate further analysis and expose new conclusions. The example here isfrom an Eastern-Western story understanding experiment.

As shown in figure 12, a student murders a professor and another student. The Eastern reader has no opinionon why Lu killed Shan until asked if it was because America is individualistic. Then, as shown in figure 13, theEastern reader, on being asked a question, recalls that he thinks so, which leads to adding that recalled belief to the

6

http://groups.csail.mit.edu/genesis/papers/krakauer 2012.pdf

10:34:40 EDT 13-Apr-2014


Cyber war



Total elements: 15



Discoveries: 0

Concepts: 14

Inferences: 6

Rules: 33

Analysis

94%94%






memorial.

EstoniainsultsRussia.

Estoniaharms

Russia.



Elaboration graph


Misguided retaliation

Revenge

Mistake because harmed

1

1

1

Onsets

StorySummaryResultsSourcesInspectoElaboration graExpertsStart vieweControlsViews|||

Figure 9: Genesis notes the onset of three possible concepts midstream in Estonia-Russia cyber war.

10:37:58 EDT 13-Apr-2014


Cyber war



Total elements: 36



Discoveries: 5

Concepts: 14

Inferences: 19

Rules: 33

Analysis

100%100%

Misguided retaliationMistake because har...Answered prayerSuccessRevenge




Estonia owns

computer

networks.

Estonia

relocates war

memorial.




Russia

becomes

unhappy.


Russia wants

to harm

Estonia.

Russia wants to damage computer networks.


networks.

Someone attackscomputernetworks.

Someone

harms

Estonia.





Estonia ismy friend.

Russiaharms me.

Russia

becomes

happy.

Estonia

becomes

unhappy.


Estonia

creates center.Estonia studies

computer security.

Elaboration graph


Misguided retaliation

Revenge

Mistake because harmed

Answered prayer

Mistake because unhappy

Pyrrhic victory

Teaching a lesson

1

4

4

3

3

6

1

Onsets

StorySummaryResultsSourcesInspectoElaboration graExpertsStart vieweControlsViews|||

Figure 10: Genesis concludes that all three of the anticipated concepts eventually become realized.

13:57:45 EDT 13-Oct-2013


Concept Pattern Matchers SpecialConcept grids

Defined Grid Generated Grid Genterated Grid - VectorMatch Human Grid In-Order Grid Generated In-Order GridKeyword Grid

StdDev error: 5.73 1 2 3 4 5 6 7 8 9 10 11 12 13 14 151: American revolution2: Afghanistan-civil-war3: American civil war4: Nigerian civil war5: Cambodia-vietnam invasion6: China border war with india7: China border war with ussr8: Chad-libyan war9: China invasion of tibet10: Cuba bay of pigs invasion11: Czechoslovakia-soviet invasion12: Persian gulf war13: China war with vietnam14: Romania and ceausescu15: Congo civil conflict

Keyword Grid Generated Grid Genterated Grid - VectorMatch Human Grid In-Order Grid Generated In-Order GridDefined Grid

StdDev error: 5.54 1 2 3 4 5 6 7 8 9 10 11 12 13 14 151: American revolution2: Afghanistan-civil-war3: American civil war4: Nigerian civil war5: Cambodia-vietnam invasion6: China border war with india7: China border war with ussr8: Chad-libyan war9: China invasion of tibet10: Cuba bay of pigs invasion11: Czechoslovakia-soviet invasion12: Persian gulf war13: China war with vietnam14: Romania and ceausescu15: Congo civil conflict

Similarity panel

DictionarySimilarity panelStoryResultsSourcesElaboration graphExpertsStart viewerControlsViews|||

It looks like the Dr. Jeckl reader of Lu murder story/eastern, on reflection, believes America is individualistic which enables him to believe Lu kills shan because America is individualistic

It looks like the Mr. Hyde reader of Lu murder story/western does not believe America is individualistic and therefore cannot believe that Lu kills shan because America is individualistic

Causal view

DictionarySimilarity panelStoryResultsSourcesElaboration graphExpertsStart viewerControlsViews|||

Figure 11: Genesis performs concept-based similarity measurements. Concept-based measurements are shown above andword-based similarity measurements below. White means most similar.

story, when enables connection to the murder. The Western reader has no such belief, so fails to follow the sameline of reasoning.

The example appears in the MEng thesis of Hiba Awad (2013).

Genesis aligns similar stories for analogical reasoningGenesis aligns stories, in preparation for analogical reasoning, using the Needleman-Wunch algorithm borrowedfrom molecular biology. In figure 14, Genesis aligns the Tet Offensive from the Vietnam war with the Arab Israeli

7

http://groups.csail.mit.edu/genesis/papers/awad 2013.pdf

10:06:51 EDT 18-May-2014

AboutRecordReadDemonstrate

Lu murder story/western



Total elements: 63



Discoveries: 1

Concepts: 17

Inferences: 35

Rules: 30

Analysis

100%100%

Suicide

Lu fails

dissertation

defense.

Lu feelsdishonored.

Goertzangers lu.

Goertz is lu's

advisor.

Goertz fails tohelp lu.

Lu becomes

angry.

Lu isChinese.

Lu isn'tAmerican.

Lu goes to USA.

(rel do (ent

lu-76257) (ent

phd-76845))

Lu doesn't find job. Lu becomes lab assistant.

Lu feelsfrustrated.

Shan graduates with lu.

Shan is younger than lu.

Shan is successful than lu.

Lu enviesshan.

Shan receives

national award.

Shan feelshonored.

Lu doesn't receive national award.Lu contests

faculty decision.

Lu feelsvictimized.

Lu receives

national award.

Lu feelsvictimized.

Lu feelshonored.

Lu feelsvictimized.

Faculty rejects

appeal.

Lu feelsfrustrated.

Lu becomes

angry.

Lu shootsgoertz.

Lu killsgoertz.

Lu isviolent.

Lu harmsgoertz.

Lu isinsane.

Lu isinsane.

Lu isinsane.

Lu isAmerican.

Lu becomes

violent.

Lu shoots

associate

professor.

Lu kills associate professor.

Lu isviolent.

Lu harms

associate

professor.

Lu isinsane.

Lu shootsshan.

Lu killsshan.

Lu isviolent.

Lu harmsshan.

Lu isinsane.

Lu shootshim.

Lu killsitself.

Lu isviolent.

Lu harmsitself.

Lu isinsane.

Lu murder story/eastern



Total elements: 67



Discoveries: 5

Concepts: 15

Inferences: 52

Rules: 35

Analysis

100%100%

Murderous influenceMurderous influenceMurderous influenceMurderous influenceSuicide

Lu failsdissertation

defense.

Lu feelsdishonored.

Goertz

angers lu.

Goertz is

lu's advisor.

Goertz fails to help lu.

Lu becomesangry.

Lu isChinese.

Lu isn'tAmerican.

Lu goesto USA.

(rel do (entlu-76257) (ent

phd-76845))

Lu islonely.

Lu becomessuicidal.

Lu doesn't

find job.Lu becomeslab assistant.

Lu feelsfrustrated.

Lu becomessuicidal.

Shangraduates

with lu.

Shan is youngerthan lu.

Shan issuccessful

than lu.

Lu envies

shan.

Shan receivesnational award.

Shan feels

honored.

Lu doesn't receive nationalaward.

Lu contestsfaculty

decision.

Lu feelsvictimized.

Lu becomessuicidal.

Lu receivesnationalaward.

Lu feelsvictimized.

Lu feelshonored.

Lu becomessuicidal.

Lu feelsvictimized.

Faculty rejectsappeal.

Lu feelsfrustrated.

Lu becomesangry.

Lu shoots

goertz.

Lu killsgoertz.

Lu isviolent.

Lu harms

goertz.

Lu shootsassociateprofessor.

Lu killsassociateprofessor.

Lu isviolent.

Lu harmsassociateprofessor.

Lu shoots

shan.

Lu killsshan.

Lu isviolent.

Lu harms

shan.

Lu shoots

him.

Lu killsitself.

Lu isviolent.

Lu harms

itself.

America is

individualistic.

America is

corrupt.

Lu inhabitsAmerica.

Lu becomescorrupt.

Lu becomesmurderous.








Lu ownsgun.

Goertz is a

person.

Associateprofessor is a

person.

Shan is a

student.

Shan is a

person.

Lu is astudent.

Lu is aperson.

Elaboration graph


Figure 12: Genesis interprets the Shan murder. The basic interpretation does not connect the murder with America.

10:08:30 EDT 18-May-2014

AboutRecordReadDemonstrate

Did Lu kill Shan because America is individualistic.

America isindividualistic.

Americais corrupt.

Lu inhabitsAmerica.

Lu becomescorrupt.

Lu becomesangry.

Lu feelshonored.


Shan is astudent.

Lu killsshan.

Shan is aperson.

Inspector


It looks like the Dr. Jekyll reader of Lu murder story/eastern, on reflection, believes America is individualistic which enables him to believe Lu kills shan because America is individualistic

It looks like the Mr. Hyde reader of Lu murder story/western does not believe America is individualistic and therefore cannot believethat Lu kills shan because America is individualistic

Causal view


Figure 13: Genesis, stimulated by a question, connects the murder with America’s supposed individualistic nature.

war. Such alignment helps see how precedents apply to current events.

13:09:29 EDT 30-Mar-2014


Reflection Alignment Bindings Match Tree Control PanelStory Alignment

Story Element 0 Element 1 Element 2 Element 3 Element 4 Element 5 Element 6 Element 7 Element 8

Story B Score: 6.0 Israelis know that Egyptians are preparing to attack them.

Egyptians are preparing to attack Israelis.

Israelis defeat Egyptians. Israelis know to defeat Egyptians.

Israelis know that Egyptians know they defeat Egyptians.

Egyptians know that Israelis defeat them.

Egyptians don't attack Israelis. Israelis believe that Egyptians don't attack them.

Gapfilled, Egyptians attack Israelis.

Story A Score: 6.0 USA knows that Viet Cong is preparing to attack it.

Viet Cong is preparing to attack USA.

USA defeats Viet Cong. USA knows to defeat Viet Cong. Gapfilled, USA knows Viet Cong knows it defeats Viet Cong.

Gapfilled, Viet Cong knows USA defeats it.

Viet Cong doesn't attack USA. USA believes Viet Cong doesn'tattack it.

Viet Cong attacks USA.

Alignment Viewer


Figure 14: Genesis aligns elements in two wars enabling gaps on both sides to be filled.

The example appears in the MEng thesis of Matthew Fay (2012).

Genesis develops summariesBecause Genesis understands stories, Genesis can construct intelligent summaries, such as the one shown in fig-ure 15 for Macbeth, which represents considerable compression relative to the version of the story provided.

14:52:28 EDT 05-Jun-2014

AboutRecordReadDemonstrations

Random Unabridged Connected Concept centered Answered prayer Unresolved questions TableDominant concept centered

The story is about Pyrrhic victory.

Lady macduff is Macduff's wife. Macbeth wants to become king because Lady Macbeth persuades that Macbeth wants to become king. Macbeth murders Duncan, probably because Duncan is a king and Macbeth is Duncan's successor. Macduff flees to England. Macbeth murders lady macduff. Macduff kills Macbeth, probably because Macbeth angers Macduff.

Summary contains 13 of 81 elements in the story or 16.0%.Summary

RetellingSummaryResultsSourcesInspectorElaboration graphExpertsStart viewerControlsViews|||

Figure 15: Genesis composes summaries.

Genesis tells and persuades using a reader modelUsing a model of what a story reader knows, Genesis can tailor telling to cover gaps in the reader’s knowledge, bysimple spoon feeding, by more elaborate explanation, or by helpfully supplying principles.

8

http://groups.csail.mit.edu/genesis/papers/Fay 2012.pdf

In figure 16, Genesis supplies principles to a reader that knows very little in the beginning, but is taught that,for example, you become king if the present king dies and you are his successor.

12:50:59 EDT 01-Apr-2014


Predictions Concept analysisStory teller

Start story titled "Macbeth/Insanity". Macbeth, Macduff, Lady Macbeth, Lady Macduff, Cawdor, and Duncan are characters. Macbeth, Macduff, Lady Macbeth, Lady Macduff, Cawdor, and Duncan are persons. A king is a kind of noble. A thane is a kind of noble. England is a country. Dunsinane is a castle and Burnham Wood is a forest. Lady Macbeth is Macbeth's wife. Macbeth is Lady Macbeth's husband because Person xx is person yy's husband whenever Person yy is person xx's wife. Lady Macduff is Macduff's wife. Macbeth is Lady Macbeth's husband. Macduff is Lady Macduff's husband. Macbeth is a thane and Macduff is a thane. Lady Macbeth is evil and greedy. Duncan is the king, and Macbeth is Duncan's successor. Duncan is an enemy of Cawdor. Macduff is an enemy of Cawdor. Duncan is Macduff's friend. Macbeth defeated Cawdor. Duncan becomes happy because Macbeth defeated Cawdor. Macbeth talks with Witches who had visions. Duncan rewarded Macbeth because Duncan became happy. Macbeth wants to become king because Lady Macbeth persuaded Macbeth to want to become the king. Macbeth murders Duncan. Duncan becomes dead because Person yy becomes dead whenever Person xx kills person yy. Macbeth becomes king because Person ww becomes king whenever Person xx is a king, Person ww is person xx's successor, and Person xx becomes dead. Lady Macbeth becomes queen because Person zz becomes queen whenever Person xx becomes king and Person zz is person xx's wife. Macbeth becomes happy because Person yy becomes happy whenever Person yy becomes king and Person yy wants to become king. Macbeth harms Duncan because Person yy harms person ww whenever Person yy kills person ww. Macbeth harms Macduff because Person yy harms person ww whenever Person yy harms person xx and Person xx is person ww's friend. Macduff becomes unhappy because Person ww becomes unhappy whenever Person yy harms person ww. Macbeth angers Macduff because Person yy angers person ww whenever Person yy harms person ww. Mabeth becomes king. Malcolm and Donalbain flee. Macbeth's murdering Duncan leads to Macduff's fleeing to England. Macbeth murders Lady Macduff. Macbeth's murdering Duncan leads to Lady Macbeth's becoming distraught. Lady Macbeth kills herself. Lady Macbeth kills herself because Entity xx kills itself may be a consequence of Person xx becomes distraught. Witches predicted that Burnam Wood would go to Dunsinane. Burnham Wood goes to Dunsinane. Macduff's army attacks Macbeth's castle. Macduff kills Macbeth.

Story


Figure 16: Genesis uses a reader model to determine what and how much to say. Here, Genesis says a lot, because Genesis’smodel of the reader suggests that the reader does not know much.

Similarly, Genesis can tailor what is said to shape reader opinion. In figure 17, for example, some sentencesare emphasized, while others are deleted, so as to make the Woodcutter look good, and everyone else look bad, inGenesis’s version of Hansel and Gretel.

The teaching and persuasion examples appear in the MEng thesis of Sila Sayan (2014).

Genesis operates on all of Minsky’s six levelsIn The Emotion Machine (2006), Minsky describes six levels of thinking: instinctive reactions, learned reactions,deliberative thinking, reflective thinking, self-reflective thinking, and self-conscious reflection.

Here are some correspondences between Minsky’s levels and Genesis competences:

• Inference rules, the basic rules that produce the basic elaboration graph, are much like instinctive reactions andlearned reactions.

• Explanation rules do a kind of deliberative thinking driven by a desire to find ways to produce a more connectedelaboration graph.

• Concept patterns examine the elaboration graph and thus perform a kind of reflective thinking.

• Mental models offer some of the capabilities found in Minsky’s discussion of self-reflective thinking and self-conscious reflection.

Evidently, Genesis operates on all of Minsky’s levels, although not yet performing all the functions described inMinsky’s book.

Next stepsTuring concluded his Computing Machinery and Intelligence paper (1950) with: “We can only see a short distanceahead, but we can see plenty there that needs to be done.” Still true.

Work underwayGenesis is under development by students at various levels, from class projects to PhD theses. The following arerepresentative systems under development:

• A system that composes original stories from precedents.

9

http://groups.csail.mit.edu/genesis/papers/Sayan 2014.pdf

14:43:13 EDT 05-Jun-2014

AboutRecordReadDemonstrations

Make The_Woodcutter be likable.

Version 1 Version 2 Version 3

A story about likableThis is as story that demonstrates that the_woodcutter is likable. Humans are a character. The witch is a character. The wife's baby is a character. The woodcutter's first wife is a character. Gretel is a character. Hansel is a character. The wife is a character. The woodcutter is a character. Hansel and gretel is a character. Humans are a person. The witch is a person. The wife's baby is a person. The woodcutter's first wife is a person. Gretel is a person. Hansel is a person. The wife is a person. The woodcutter is a person. Hansel and gretel is a person. The woodcutter is the wife's husband. The woodcutter's first wife leaves the woodcutter because The woodcutter is poor. The woodcutter becomes unhappy. Hansel and gretel is the woodcutter's child. The woodcutter is hansel and gretel's parent. Hansel and gretel is the wife's stepchild. The wife is hansel and gretel's stepparent. Hansel is the woodcutter's child. Hansel is the wife's stepchild. Gretel is the woodcutter's child. Gretel is the wife's stepchild. The woodcutter is hansel's parent. The woodcutter is gretel's parent. The wife is hansel's stepparent. The wife is gretel's stepparent. The wife is the wife's baby's parent. The woodcutter is the wife's baby's parent. Koy is a place. The woodcutter lives in koy. The wife lives in koy. Hansel lives in koy. Gretel lives in koy. The woodcutter is hungry. The wife is poor. The wife is hungry. The woodcutter works for long hours.The woodcutter doesn't have enough food for whole family. The wife becomes pregnant. The wife needs enough food for the wife's baby. The woodcutter wants to give enough food to hansel and gretel. The wife worries because The wife doesn't have enough food for the wife's baby. The wife becomes afraid because The wife doesn't want to starve. The wife pressures the woodcutter to provide more food. The woodcutter becomes ashamed because The woodcutter is a bad provider. The woodcutter becomes afraid because The woodcutter doesn't want the wife to leave it. The wife doesn't want to share more food because The wife wants to give more food to the wife's baby. The wife persuades that the woodcutter abandons hansel and gretel in forest. Hansel learns about plan. In order to survive, hansel makes plan. Hansel marks route back to koy. In order to lead hansel and gretel into forest, the woodcutter lies. The woodcutter wants hansel and gretel to survive. The woodcutter helps hansel and gretel. Hansel remembers path back to koy. The woodcutter abandons hansel and gretel. Gretel becomes afraid because The woodcutter abandons gretel. Hansel reassures gretel. Hansel and gretel returns to koy. The wife discovers hansel and gretel in house. The woodcutter discovers hansel and gretel in house. The wife becomes shocked. The woodcutter becomes shocked. The woodcutter becomes relieved because Hansel and gretel is safe. The wife becomes relieved because Hansel and gretel is safe. The wife becomes angry because The wife shares more food with hansel and gretel. The wife doesn't want to harm hansel and gretel. The wife wants to ensure safety. The wife cries because The wife doesn't know solution to problem. The woodcutter doesn't suggest solutions. The wife feels lonely because The woodcutter doesn't help the wife. The wife reprimands the woodcutter because The wife becomes angry. The woodcutter doesn't want to harm hansel and gretel. The woodcutter doesn't want to disobey the wife because The woodcutter is afraid. The woodcutter cries because The woodcutter doesn't know solution to problem. The wife wants to get rid of hansel and gretel. The wife locks hansel and gretel in room. The wife starves hansel and gretel. The wife admits fault. The woodcutter becomes angry because The wife mistreats hansel and gretel. The woodcutter wants to help hansel and gretel. The woodcutter frees hansel and gretel. The wooodcutter plans to leave hansel and gretel in forest because The woodcutter believes that forest is safe. The woodcutter leads hansel and gretel to forest. The woodcutter tells truth to hansel and gretel about plan. The woodcutter abandons hansel and gretel in forest. Hansel and gretel becomes angry with the woodcutter. There is appear in forest. Hansel and gretel becomes afraid. Hansel and gretel becomes cold. Hansel cries. Gretel cries. Hansel helps gretel. Cottage is secluded because Humans exile the witch. The witch has different appearance. The witch has different language. The witch doesn't want to harm humans. The witch wants to help humans.The witch helps humans. Humans don't trust the witch because Humans are prejudiced. Humans attack the witch because Humans hate the witch.Humans harm the witch. The witch becomes afraid. The witch becomes unhappy. The witch becomes confused. The witch escapes into forest. The witch wants friends because The witch becomes lonely. In order to attract friends, the witch builds candy cottage. Humans found candy cottage. Humans steal from the witch. The witch becomes angry. The witch becomes cannibal. In order to survive, the witch needs to eat humans. Hansel and gretel is starving. Hansel and gretel finds cottage in forest. Hansel and gretel eats candy. The witch wants to eat hansel and gretel because The witch is hungry. The witch tricks hansel and gretel. The witch traps hansel in cage. The witch traps gretel in cage. Hansel and gretel begs the witch for freedom. The witch doesn't trust hansel and gretel because The witch doesn't trust humans. The witch believes that hansel and gretel is evil. The witch doesn't free hansel and gretel. The witch wants to cook hansel and gretel in oven. Gretel wants to murder the witch because Gretel wants to survive. Gretel makes plan. Gretel escapes from cage. Gretel murders the witch. Gretel burns the witch. The witch screams. Hansel and gretel escapes from cottage. Hansel and gretel finds the woodcutter in forest. The woodcutter becomes happy because Hansel and gretel is alive. Hansel and gretel returns home. The woodcutter returns home. The wife becomes remorseful because The wife harms hansel and gretel. The wife becomes happy because Hansel and gretel is alive.

Retelling

RetellingSummaryResultsSourcesInspectorElaboration graphExpertsStart viewerControlsViews|||

Figure 17: Genesis uses a reader model to determine what and how much to say so as to shape the reader’s opinion. Here,Genesis makes one character look good, and emphasizes that goodness, by making the other characters look bad.

• A system that mines literature for actions associated with personality traits.

• A system that tells stories with metaphorical reference to precedents.

• A system that uses story understanding apparatus to plan.

• A system that uses accumulated knowledge to disambiguate verbs.

The CBMM challengeThe central CBMM challenge problem is to understand pictures and video computationally, developmentally,neurobiologically, and socially. Story understanding and telling play a role, of course, because pictures and videostell stories. One interesting step was taken by Virginia Chiu in an undergraduate research project in 2012. Her focuswas on how people describe people. She noted, as expected, that people prefer features that distinguish individualsfrom other individuals in context, and she noted, as expected, that people prefer features that change slowly,such as physical description, to features that change rapidly, such as location. In a pilot experiment involving 41descriptions collected from four individuals, she found:

• 31 contained a clothing description, as in The man with sunglasses wearing a striped blue shirt.

• 27 contained a physical description, as in The Asian woman with her hair tied back.

• 16 contained a location description, as in The man on the right.

• 12 contained a manner/action description, as in The woman who walked past the door to the library.

Fortunately, from a story telling point of view, Genesis uses Boris Katz’s START (1997) to generate English, andSTART can generate richly descriptive sentences, including sentences with subordinate clauses.

10

ContributionsWhat benefits will follow from successful work on story understanding? At least these:

• For CBMM in particular, we will handle stories told in pictures and video.

• For science in general, we will have a better understanding of the key differentiator of our intelligence.

• For applications, our progress on the science side will surely constitute steps toward applications on higher levelthan we can hope for with today’s technology.

11

ReferencesHiba Awad. Culturally based story understanding. Master’s thesis, Electrical Engineering and Computer Science

Department, MIT, Cambridge, MA, 2013.

Matthew Paul Fay. Enabling imagination through story alignment. Master’s thesis, Electrical Engineering andComputer Science Department, MIT, Cambridge, MA, 2012.

Boris Katz. Annotating the World Wide Web using natural language. In Proceedings of the 5th RIAO Conferenceon Computer Assisted Information Searching on the Internet, pages 136–159, 1997.

Caryn Krakauer. Story retrieval and comparison using concept patterns. Master’s thesis, Electrical Engineeringand Computer Science Department, MIT, Cambridge, MA, 2012.

Marvin Minsky. Steps toward artificial intelligence. In E. A. Feigenbaum and J. Feldman, editors, Computers andThought. MIT Press, Cambridge, MA, 1961.

Marvin Minsky. The Emotion Machine. Simon and Schuster, New York, NY, 2006.

David Nackoul. Text to text: Plot unit searches generated from English. Master’s thesis, Electrical Engineeringand Computer Science Department, MIT, Cambridge, MA, 2010.

Sila Sayan. Audience aware computational discourse generation for instruction and persuasion. Master’s thesis,Electrical Engineering and Computer Science Department, MIT, Cambridge, MA, 2014.

Susan S. Song. Of intent and action: Implementing personality traits for storytelling through concept patterns.Master’s thesis, Electrical Engineering and Computer Science Department, MIT, Cambridge, MA, 2012.

Alan M. Turing. Computing machinery and intelligence. Mind, 59(236):433–460, 1950.

Patrick Henry Winston. The strong story hypothesis and the directed perception hypothesis. In Pat Langley, editor,Technical Report FS-11-01, Papers from the AAAI Fall Symposium, pages 345–352, Menlo Park, CA, 2011.AAAI Press.

Patrick Henry Winston. The next 50 years: a personal view. Biologically Inspired Cognitive Architectures, 1, 2012.

Patrick Henry Winston. The right way. Advances in Cognitive Systems, 1:23–36, 2012.

Wolfgang Victor Hayden Yarlott. Old man coyote stories: Cross-cultural story understanding in the genesis storyunderstanding system. Master’s thesis, Electrical Engineering and Computer Science Department, MIT, Cam-bridge, MA, 2014.

12

Documents

by - Machines€¦ · The Genesis Story Understanding and Story Telling System A 21st Century Step toward Artiﬁcial Intelligence by Patrick Henry Winston Abstract: Story understanding