167
Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly Labeled Image Collections Bolei Zhou , Vignesh Jagadeesh , Robinson Piramuthu MIT eBay Research Labs [email protected],[vjagadeesh, rpiramuthu]@ebay.com In this supplementary, we show the result of concept recognition on 500 random images from Pascal VOC 2007 dataset. See Section 6.1 of the main paper for details. Table 1: Concept recognition on 500 random images from Pascal VOC 2007. Results based on concepts learned from NUS-WIDE and SBU datasets are shown in separate columns. Index Image NUS-WIDE Concepts SBU Concepts 1 balloons,party,fun austria,great,world little,girl,child halloween,costume,chicago style,clothes,girl pants-red:AMOD girls-red:PREP IN dress-up:PRT boy-red:PREP IN red-black:CONJ AND ride-bike:DOBJ coat-red:AMOD outfit-a:DET dress-red:AMOD red-blue:CONJ AND dress-red:PREP IN skirt-the:DET hats-the:DET dress-shoes:CONJ AND red-gold:CONJ AND 2 vehicle,abandoned,rust train,engine,steam locomotive,bridge,track locomotive,explore,colorado auto,truck,canada car-abandoned:AMOD truck-field:PREP IN car-sitting:VMOD root-truck:ROOT car-old:AMOD root-van:ROOT truck-an:DET cars-old:AMOD trucks-the:DET truck-old:AMOD train-road:NN train-car:NN up-mountain:POBJ root-train:ROOT train-freight:NN Continued on next page 1

Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Embed Size (px)

Citation preview

Page 1: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Supplementary Material B - ConceptLearner: Discovering Visual Concepts fromWeakly Labeled Image Collections

Bolei Zhou†, Vignesh Jagadeesh‡, Robinson Piramuthu‡

†MIT ‡eBay Research [email protected],[vjagadeesh, rpiramuthu]@ebay.com

In this supplementary, we show the result of concept recognition on 500 random images from Pascal VOC 2007 dataset.See Section 6.1 of the main paper for details.

Table 1: Concept recognition on 500 random images from Pascal VOC2007. Results based on concepts learned from NUS-WIDE and SBUdatasets are shown in separate columns.

Index Image NUS-WIDE Concepts SBU Concepts1 balloons,party,fun

austria,great,worldlittle,girl,childhalloween,costume,chicagostyle,clothes,girl

pants-red:AMODgirls-red:PREP INdress-up:PRTboy-red:PREP INred-black:CONJ ANDride-bike:DOBJcoat-red:AMODoutfit-a:DETdress-red:AMODred-blue:CONJ ANDdress-red:PREP INskirt-the:DEThats-the:DETdress-shoes:CONJ ANDred-gold:CONJ AND

2 vehicle,abandoned,rusttrain,engine,steamlocomotive,bridge,tracklocomotive,explore,coloradoauto,truck,canada

car-abandoned:AMODtruck-field:PREP INcar-sitting:VMODroot-truck:ROOTcar-old:AMODroot-van:ROOTtruck-an:DETcars-old:AMODtrucks-the:DETtruck-old:AMODtrain-road:NNtrain-car:NNup-mountain:POBJroot-train:ROOTtrain-freight:NN

Continued on next page

1

Page 2: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

3 mural,building,citygraffiti,city,architecturefree,art,redofficers,cars,carhost,graffiti,hotel

art-wall:NNroot-art:ROOTdealership-car:NNroot-graffiti:ROOTbusiness-a:DETjob-a:DETmural-wall:NNvintage-signs:NNgraffiti-wall:PREP ONbuilding-ohio:PREP INwall-colorful:AMODsign-glass:NNwall-building:PREP INart-street:NNroot-panel:ROOT

4 backpack,camera,lenscables,building,appleflag,protest,politicspolice,politics,peacewindows,people,clouds

black-red:CONJ ANDcity-new:NNroot-section:ROOTdetail-window:PREP FROMdisplay-a:DETroot-figures:ROOTroot-bags:ROOTwindow-a:DETstore-clothing:NNglass-window:PREP INred-black:CONJ ANDstore-shoe:NNmarket-flea:NNcats-black:AMODman-little:AMOD

5 trip,summer,peopledesign,light,redmorning,people,coffeemicrophones,people,funwork,travel,asia

boy-chair:PREP INboy-sitting:DEPsit-chair:PREP INchair-girl:NNclassroom-a:DETboy-birthday:NNchair-boy:NNgirl-chair:PREP INboy-big:AMODsitting-seat:PREP INboy-sitting:VMODplaying-guitar:DOBJtable-kitchen:NNboy-mirror:PREP INshirt-an:DET

Continued on next page

2

Page 3: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

6 tanks,texas,statejeep,sky,bluebike,sky,waterwall,graffiti,artgun,rifles,soldiers

car-front:PREP INcars-old:AMODhorse-drawn:VMODtruck-big:AMODtruck-the:DETroot-trucks:ROOTtrucks-the:DETscene-typical:AMODpictures-the:DEThouse-car:CONJ ANDtrailer-a:DEThas-house:NSUBJbike-front:PREP INtrain-little:AMODtractor-a:DET

7 apple,office,macoffice,apple,macmac,office,photographymac,leopard,displaywork,office,apple

root-desk:ROOTdesk-office:PREP INcomputer-the:DEToffice-the:DETroot-computer:ROOTscreen-the:DETkeyboard-the:DETdesk-room:PREP INdesk-computer:NNdesk-new:AMODdesk-the:DETlaptop-the:DETmonitor-the:DETscreen-blue:AMODdesk-a:DET

8 cliff,coast,cloudharbor,sky,cloudstwilight,clouds,silhouettecloud,storm,sunstorm,landscape,tornado

clouds-dark:AMODroot-rainbow:ROOTclouds-black:AMODcloud-black:AMODrainbow-sky:PREP INroot-storm:ROOTsky-golden:AMODclouds-storm:NSUBJsky-lake:PREP OVERstorm-a:DETclouds-beach:PREP OVERsky-pink:AMODsetting-sun:NSUBJsunset-over:PRTsunset-the:DET

Continued on next page

3

Page 4: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

9 antique,car,truckvintage,car,classiccar,automobile,trucktruck,rusty,vintageladder,orange,cat

one-cars:PREP OFroot-car:ROOTtruck-ford:NNparked-car:NSUBJcar-classic:AMODshow-the:DETtruck-pickup:NNcar-vintage:AMODcar-street:PREP INroot-show:ROOTshow-car:NSUBJwindow-rear:AMODparked-truck:NSUBJcar-old:AMODshow-a:DET

10 hats,cute,handmadedecoration,home,roomdesigns,male,egyptdecember,christmas,greensmall,big,man

room-living:AMODchair-pink:AMODsitting-room:PREP INroom-the:DETbed-room:PREP INfireplace-the:DETroot-grace:ROOTgirl-chair:PREP INbedroom-the:DETcats-the:DETchair-house:PREP INroot-buddy:ROOTchair-room:PREP INbed-house:PREP INroot-guest:ROOT

11 formula,classic,sportracing,driver,unitedriot,protesters,photojournalismmontreal,people,protestbike,motorcycle,blue

root-show:ROOTmask-a:DETrace-a:DETseat-front:AMODseat-bike:NNmotorcycle-a:DETflag-american:AMODblack-orange:CONJ ANDteam-the:DETcrowd-the:DETschool-high:NNmachine-flying:AMODshow-a:DETcross-street:DOBJcolors-white:AMOD

Continued on next page

4

Page 5: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

12 fishing,fish,lakebirds,wings,whiteoutdoor,wildlife,animalrunning,dog,horsebeach,crab,nature

looking-food:PREP FORstanding-water:PREP INtable-bird:NNheron-blue:AMODbird-a:DETheron-a:DETcaught-bird:DOBJwalking-water:PREP INbird-water:NNheron-great:AMODroot-heron:ROOTmeal-a:DETfeet-the:DETbirds-little:AMODheron-blue:NN

13 runway,flight,aviationgrass,cow,fieldlanding,aviation,flyingarizona,vintage,urbansmoke,airplane,aircraft

field-soccer:NNfield-ball:NNmiddle-field:PREP OFfield-baseball:NNfield-center:NNhouse-field:NNfield-big:AMODflying-kite:DOBJfield-front:PREP INgreens-the:DETfield-cow:NNtrack-the:DETkite-a:DETfield-open:AMODfield-an:DET

14 horses,explore,animalhorse,argentina,fieldbench,people,sittinghorse,red,whitekuwait,war,iraq

horse-a:DEThorses-the:DETroot-horses:ROOTroot-horse:ROOThorse-the:DETriding-horse:DOBJstatue-massive:AMODbuilding-statue:DEProot-couple:ROOTpony-a:DETstatue-buddha:PREP OFforest-new:NNride-bike:NNstanding-tree:PREP UNDERfence-the:DET

Continued on next page

5

Page 6: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

15 protest,france,protesterspolice,car,carscars,people,policejune,world,franceroadblock,protest,london

ride-the:DETbuses-the:DETride-to:AUXcoach-the:DETtrucks-the:DETcross-bridge:DOBJbest-seats:DEPwaiting-line:PREP INbus-city:NNone-blue:AMODteam-the:DETcars-many:AMODtruck-pickup:NNbest-seat:DEPcar-street:NN

16 running,dog,horserabbit,sweet,petswedding,dress,portraitkitty,orange,catsbunny,white,pups

cat-cute:AMODcat-white:AMODcat-tree:PREP UNDERgrass-the:DETsitting-tree:PREP UNDERhouse-taken:VMODdog-cute:AMODlives-cat:NSUBJcat-garden:PREP INgardens-the:DETshade-the:DETcat-house:NNgarden-a:DETroot-bunny:ROOTenjoying-sun:DOBJ

17 bus,abandoned,cloudstruck,tanker,massachusettsvehicle,abandoned,rustfirefighter,truck,manhattanauto,truck,canada

buses-the:DETstation-bus:NNtruck-water:NNcolorful-very:ADVMODtrain-little:AMODtrain-road:NNcoach-a:DETservice-the:DETparked-truck:NSUBJparked-street:PREP INtruck-blue:AMODvan-the:DETbus-school:NNrear-the:DETcar-railroad:NN

Continued on next page

6

Page 7: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

18 car,automobile,truckrally,car,racingautomobile,truck,californiaautomobile,ontario,speedbug,car,automobile

window-rear:AMODroot-car:ROOTparked-car:NSUBJone-cars:PREP OFcar-street:PREP INparked-car:NSUBJPASStruck-ford:NNparked-street:PREP ONcar-rental:AMODparked-street:PREP INcar-road:PREP ONcars-trucks:CONJ ANDcar-lot:PREP INcar-old:AMODvan-white:AMOD

19 painting,artist,colorsindian,nature,underwatersilver,dog,dogsperfect,great,artvacation,fun,people

rice-brown:AMODplants-potted:AMODpeppers-red:AMODsauce-red:AMODleaf-banana:NNone-green:AMODpot-clay:NNonions-green:AMODplate-a:DETfish-white:AMODroot-lunch:ROOTbeans-green:AMODsauce-a:DETchicken-sauce:PREP INsauce-wine:NN

20 furniture,toys,houseshop,market,foodshops,fun,floridaguest,room,catcafe,bar,street

fish-market:DEProot-display:ROOTshop-shoe:NNtable-kitchen:PREP INtables-the:DETmarket-fish:NNdisplay-window:NNroot-market:ROOTtable-window:PREP BYin-market:POBJtable-house:PREP INmarket-biggest:AMODbox-glass:NNmarket-largest:AMODkitchen-house:PREP IN

Continued on next page

7

Page 8: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

21 pets,cat,catswolf,dogs,icefeline,kitten,animalsbears,minnesota,berlincats,kitten,pets

dog-box:PREP INbear-brown:AMODcat-window:PREP INcute-very:ADVMODcat-lives:RCMODdoggy-window:PREP INcub-bear:NNtaking-nap:DOBJlion-the:DETcat-house:NNcat-white:AMODroot-sleeps:ROOTdog-truck:PREP INcub-the:DETbears-the:DET

22 hill,architecture,citymexico,vintage,americahouses,water,rivergreece,church,squarevillage,france,europe

root-houses:ROOThill-the:DETside-hand:NNview-street:PREP OFstreet-house:PREP NEARview-street:PREP FROMroot-village:ROOThill-castle:NNone-house:NSUBJsurrounded-trees:AGENThill-steep:AMODlined-tree:NSUBJside-hill:NNtrees-green:AMODlooking-road:DOBJ

23 formula,classic,sportmotorcycle,texas,exploremotorcycle,netherlands,nederlandracing,driver,unitedclassic,automobile,red

show-car:NNshow-car:NSUBJroot-show:ROOTcar-classic:AMODbuilding-d70:PREP INmotorcycle-a:DETbuilding-britannic:AMODshow-a:DETshow-building:PREP ATroot-car:ROOTparked-street:PREP ONbike-road:NNcar-a:DETbasket-bike:NNhas-car:NSUBJ

Continued on next page

8

Page 9: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

24 men,male,sportscellphones,people,streetsidewalk,people,womanboys,girls,kidrefugees,africa,boy

root-students:ROOTroot-men:ROOTboy-sitting:VMODshirt-white:AMODroot-children:ROOTwomen-two:NUMboy-girl:CONJ ANDshirt-black:AMODboy-dog:CONJ ANDroot-brother:ROOTgirl-boy:CONJ ANDman-sitting:VMODhouse-river:NNshirt-blue:AMODme-shirt:PREP IN

25 washington,seattle,artbook,dog,funnymilitary,soldiers,warroom,people,adultsdowntown,people,street

table-room:PREP INlaptop-a:DETtable-pool:NNcenter-the:DETroot-pool:ROOTtable-bar:PREP INbox-green:AMODsit-chair:PREP INkeyboard-the:DETon-floor:POBJball-basket:NNchair-lounge:NNcabin-the:DETchair-office:PREP INseats-the:DET

26 car,automobile,truckvehicle,cars,speedautomobile,truck,californiaauto,truck,canadacars,racing,classic

root-car:ROOTspotted-car:NSUBJcar-old:AMODcar-blue:AMODparked-street:PREP INcar-new:AMODcar-toy:NNone-cars:PREP OFparked-car:NSUBJcar-abandoned:AMODcar-sitting:VMODcar-a:DETcar-street:PREP INcar-black:AMODcar-street:PREP ON

Continued on next page

9

Page 10: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

27 plants,trees,treegarden,trees,treesculpture,toy,handmadeflowers,white,roseplant,tree,trees

plant-pot:PREP INroot-plant:ROOTpot-a:DETtree-pot:PREP INroot-pots:ROOTtree-little:AMODplant-to:AUXplants-tomato:NNpot-big:AMODflowers-pot:PREP INplants-pots:PREP INroot-pot:ROOTpot-blue:AMODpots-flower:NNplants-potted:AMOD

28 greece,white,artwedding,dress,portraitfountain,people,kidsfaces,boy,documentaryburma,documentary,relief

dress-white:AMODstanding-girl:NNblack-white:CONJ ANDpicture-black:AMODfountains-water:NNblack-white:PREP INwoman-sitting:VMODfountain-water:NNphoto-white:AMODdress-wedding:NNgirl-flower:NNshot-white:AMODconverted-white:PREP TOroot-dress:ROOTphoto-black:AMOD

29 cats,kitten,petsfamily,love,redarmy,guns,weaponsmoose,dog,puppycubs,bears,cute

root-fits:ROOTroom-computer:NNtaking-nap:DOBJcat-bag:PREP INnap-a:DETroot-buddy:ROOTchair-computer:NNgetting-bath:DOBJlikes-sit:XCOMPcouch-room:PREP INbed-room:PREP INcat-kitchen:PREP INsitting-kitchen:PREP INseat-best:AMODseat-house:PREP IN

Continued on next page

10

Page 11: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

30 party,politics,americasquare,portrait,chinaclub,party,blackwashington,president,protestindividual,person,people

me-house:PREP INparty-house:NNgirls-standing:DEPeve-christmas:NNboy-birthday:NNgirls-all:PREDETat-bar:POBJbar-floor:NNline-bathroom:PREP FORscreen-laptop:AMODglass-wine:PREP OFriding-cars:PREP INgirl-train:PREP INpicture-me:PREP OFboy-mirror:PREP IN

31 racing,classic,carsrace,car,autocars,racing,classicclassic,racing,carsjeep,cars,automobile

plate-license:NNspotted-car:NSUBJtruck-ford:NNhood-the:DETroot-car:ROOTtruck-blue:AMODcar-little:AMODcars-many:AMODparked-street:PREP ONone-cars:PREP OFparked-street:PREP INtruck-red:AMODparked-car:NSUBJcar-field:PREP INcar-street:PREP IN

32 runway,flight,aviationaircraft,wings,wingairplane,clouds,skyunited,airplane,airportbritish,formula,car

plane-the:DETmay-collection:NNflying-order:DOBJmay-heritage:NNhighway-a:DETmuseum-vintage:AMODmuseum-airplane:NNroot-plane:ROOTscheme-white:AMODairplane-a:DETcar-white:AMODairplane-the:DETwhile-car:NNhighway-the:DETplane-a:DET

Continued on next page

11

Page 12: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

33 dogs,funny,cutepuppy,baby,animalssmall,animal,petplay,dog,dogssoft,animal,pet

cats-the:DETcat-bag:PREP INroot-puppy:ROOTboy-bed:PREP INroot-sleeps:ROOTanimals-stuffed:AMODpillow-the:DETroot-nap:ROOTcats-black:AMODpuppy-cute:AMODcute-being:COProot-cats:ROOTnap-a:DETbasket-laundry:NNpuppy-the:DET

34 driver,cars,autoracing,classic,carsengine,truck,autoautomobile,ontario,speedvehicle,cars,speed

car-red:AMODparked-car:NSUBJcars-two:NUMcar-street:PREP INroot-cars:ROOTspotted-car:NSUBJcar-pink:AMODcar-green:AMODroot-car:ROOTcar-blue:AMODcar-street:PREP ONtruck-red:AMODone-cars:PREP OFcar-parked:VMODcar-little:AMOD

35 interior,furniture,housedesign,interior,furniturehome,interior,designstudio,microphones,officemodern,interior,furniture

room-dining:NNtable-chairs:CONJ ANDdesk-a:DETroom-looking:VMODdining-room:DOBJroot-desk:ROOTlooking-room:PREP INTOstanding-kitchen:PREP INliving-room:DOBJroom-kitchen:CONJ ANDview-kitchen:PREP OFchairs-the:DETroot-room:ROOTsee-door:DOBJarea-kitchen:NN

Continued on next page

12

Page 13: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

36 clothes,style,redmonks,asia,orangemuseum,history,warpennsylvania,president,beardsguard,police,coast

dress-red:AMODcoat-red:AMODin-front:POBJred-black:CONJ ANDgirl-red:PREP INgirls-red:PREP INshirt-red:AMODpants-red:AMODskirt-the:DETstudents-the:DETroot-heather:ROOTlady-dress:PREP INgirl-coat:PREP INstanding-way:PREP INdress-traditional:AMOD

37 display,apple,machome,interior,designmac,leopard,displayapple,office,macantenna,car,reflection

tv-screen:NNtelevision-a:DETdesk-new:AMODroot-computer:ROOTlaptop-the:DETcomputer-the:DETdesk-computer:NNscreen-the:DETtelevision-the:DETscreen-tv:NNroot-tank:ROOTfireplace-the:DETcouch-room:PREP INtable-side:NNroot-screen:ROOT

38 shadow,street,peoplekids,people,waterroad,city,peoplefield,cow,parkdriver,cars,auto

highway-a:DETstation-gas:NNpark-car:NNtrucks-the:DETone-blue:AMODroad-busy:AMODcrossing-road:DOBJpark-car:DOBJcars-two:NUMcar-police:NNroot-trucks:ROOTpavement-the:DETroot-lot:ROOTride-bike:NSUBJcar-green:AMOD

Continued on next page

13

Page 14: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

39 car,racing,raceformula,historic,classicracing,classic,carsrace,car,formulaclassic,racing,cars

root-cars:ROOTtruck-red:AMODspotted-car:NSUBJtrucks-the:DETone-cars:PREP OFcar-red:AMODcar-yellow:AMODtruck-white:AMODcars-trucks:CONJ ANDroot-trucks:ROOTcars-many:AMODcar-one:NUMcars-two:NUMcar-field:PREP INparked-car:NSUBJ

40 wildlife,elephant,safaridogs,snow,beachplaying,animal,bearfly,blue,skyanimal,dog,wild

cow-the:DETroot-cow:ROOTcows-road:PREP INdog-car:PREP INcow-a:DETroot-dogs:ROOTpasture-the:DETstick-a:DEThorses-white:AMODpony-a:DETdog-truck:PREP INroot-sheep:ROOTwaiting-car:PREP INdogs-two:NUMview-rear:AMOD

41 sailboat,ship,bluesails,sunset,oceansail,ocean,sunsetwarehouse,window,doorgray,building,light

sailboat-a:DETsidewalk-a:DETsailboat-the:DETroot-sailboat:ROOTunder-bridge:POBJplant-abandoned:AMODlake-town:NNbridge-river:NNsail-boat:DOBJboats-sail:AMODpassing-bridge:PREP UNDERboat-bridge:PREP UNDERcolumn-the:DETbridge-water:PREP OVERback-building:PREP OF

Continued on next page

14

Page 15: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

42 pool,woman,swimmingwater,ocean,beachswimming,underwater,oceanboy,water,beachgirls,beach,fun

ball-beach:NNball-water:PREP INpool-the:DETpool-swimming:NNpark-water:NNboys-water:PREP INswimming-pool:PREP INplaying-ball:DOBJpool-swimming:AMODplays-boy:NSUBJboy-water:PREP INgirl-boat:PREP INplay-to:AUXplaying-water:PREP INswimming-water:PREP IN

43 design,interior,furnitureinterior,furniture,househome,interior,designbathroom,abandoned,interiormodern,interior,furniture

room-dining:NNbathroom-house:PREP INbathroom-new:AMODlamp-floor:NNroot-bathroom:ROOTroot-downstairs:ROOTbathroom-floor:NNkitchen-old:AMODdining-room:DOBJbathroom-guest:NNbathroom-the:DETroom-new:AMODcurtain-shower:NNroot-shower:ROOTleads-door:NSUBJ

44 houseboat,summer,windowsailing,california,skyadults,furniture,outdoorsboat,lake,bluebusiness,trip,river

roof-glass:NNbest-seat:DEPbuilding-glass:NNride-boat:NNbuilding-modern:AMODroot-safe:ROOTunion-lake:NNroof-station:PREP OFwindows-building:PREP OFboat-cruise:NNfloor-glass:NNhome-train:NNreflection-building:PREP INhead-street:PREP INdeck-observation:NN

Continued on next page

15

Page 16: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

45 grass,cow,fieldlawn,park,girlhorse,red,whiteracing,horse,sportrifles,uniform,world

field-ball:NNplant-tree:DOBJplate-home:NNball-basket:NNtrees-plant:NNball-the:DETcup-the:DETball-plastic:AMODgirl-dog:CONJ ANDshirt-gray:AMODapple-the:DETstanding-wall:PREP ONroot-students:ROOTstudent-a:DETgrass-lush:AMOD

46 birds,tree,colorfulbird,tree,hawkclose,insect,flywings,insect,macromacro,insect,butterfly

bird-tree:PREP INbird-blue:AMODbird-colorful:AMODbranch-tree:PREP OFroot-blackbird:ROOTroot-bird:ROOTfence-wire:NNjay-blue:AMODbird-cute:AMODbird-black:AMODspotted-bird:DOBJbuilding-nest:DOBJbirds-blue:AMODbranch-a:DETbranch-the:DET

47 child,boys,peoplekid,people,waterportrait,sky,childdeer,handmade,cutevillage,portrait,rural

playing-sand:PREP INroot-plays:ROOTboy-a:DETgirl-little:AMODroot-boy:ROOTsitting-sand:PREP INplaying-girl:NNsand-beach:PREP ATgirl-small:AMODplays-boy:NSUBJcastle-sand:NNplaying-boy:NNpit-the:DETplay-to:AUXboy-young:AMOD

Continued on next page

16

Page 17: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

48 motorcycle,motion,asiamotorcycle,texas,exploremotorcycle,netherlands,nederlandbike,motorcycle,racemotorcycle,road,sky

motorcycle-a:DETroot-show:ROOTshow-car:NNbike-road:NNowner-the:DETshow-car:NSUBJdog-basket:PREP INparked-street:PREP ONcar-classic:AMODbike-front:PREP INfair-street:NNbuilding-britannic:AMODbicycle-a:DETshow-a:DETtraffic-the:DET

49 trip,summer,peoplegun,guard,policeuniversity,girl,peopledesign,light,redpolice,politics,peace

van-60mm:NUMshirt-an:DETsign-to:AUXbottle-the:DETguy-shirt:PREP INparty-the:DEToffice-field:NNshirt-green:AMODboy-birthday:NNenjoying-glass:DOBJhad-girl:NSUBJperson-the:DEThats-the:DETroom-green:AMODcup-plastic:AMOD

50 sign,sky,roadleaves,water,macrocrystals,sewing,handmadevacation,fun,peoplefootball,stadium,sport

sign-park:PREP INsign-house:PREP NEARroot-shoe:ROOTroad-sign:DEPspotted-sign:DOBJroot-book:ROOTspotted-sign:NSUBJsign-warning:AMODwarning-sign:DOBJsign-road:PREP ONposted-sign:NSUBJblue-a:DETroot-plate:ROOTbutterfly-blue:AMODweek-last:AMOD

Continued on next page

17

Page 18: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

51 field,cow,parkaircraft,pilot,fighterpoliticians,bush,washingtontexas,war,fieldplane,fly,pilot

railroad-a:DETsign-town:PREP INsign-road:PREP ONsign-a:DETbox-newspaper:NNships-the:DETsign-the:DETsign-road:NNsign-yellow:AMODsign-an:DETlot-parking:NNairport-the:DETsigns-the:DETwarning-sign:DOBJjob-a:DET

52 cow,animals,nosenose,dog,cowgoat,portrait,zoosheep,animal,hornstusks,zoo,wildlife

sheep-a:DETroot-pig:ROOTold-months:NPADVMODdog-house:PREP INeating-grass:DOBJtaken-family:AGENTstick-the:DEThome-car:NNroot-sheep:ROOTcow-a:DETroot-goat:ROOTcub-bear:NNpark-wildlife:NNroot-buddy:ROOTgoat-the:DET

53 fence,grass,fieldfishing,nets,floodrailroad,ties,lightrailing,sea,wintersoccer,beach,sunset

fence-a:DETtracks-train:NNfence-wire:NNtracks-railroad:NNrailroad-a:DETwire-barbed:AMODfence-the:DETplaces-unconventionnal:AMODdreams-places:PREP OFbike-dreams:DEPbike-field:PREP INburn-which:NSUBJroot-fence:ROOTtrack-a:DETbusiness-a:DET

Continued on next page

18

Page 19: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

54 jeep,cars,automobilekuwait,car,carsautomobile,truck,californiaauto,truck,canadatruck,tanker,massachusetts

root-trucks:ROOTtruck-ford:NNtruck-pickup:NNtruck-field:PREP INcars-trucks:CONJ ANDroot-truck:ROOTparked-truck:NSUBJtruck-big:AMODcar-an:DETtruck-blue:AMODcars-many:AMODspotted-car:NSUBJcar-house:PREP OFsitting-field:PREP INcar-one:NUM

55 car,automobile,truckrally,car,racingbug,car,automobilevehicle,cars,speedauto,automobile,race

root-car:ROOTcar-street:PREP INparked-street:PREP ONwindow-rear:AMODone-cars:PREP OFcar-rusty:AMODparked-street:PREP INparked-car:NSUBJPASSshow-car:NSUBJcar-abandoned:AMODshow-building:PREP ATcars-two:NUMcar-old:AMODdoor-car:NNcar-street:PREP ON

56 bike,motorcycle,racemotorcycle,netherlands,nederlandbike,track,vintagemotorcycle,motion,asianederland,motorcycle,classic

bike-road:NNbike-front:PREP INbike-mountain:NNmotorcycle-a:DETbicycle-a:DETdog-basket:PREP INtruck-big:AMODride-bike:DOBJrace-a:DETride-to:AUXride-bike:NSUBJmachine-green:AMODpark-oak:NNshow-a:DETseat-bike:NN

Continued on next page

19

Page 20: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

57 downtown,building,bluebuildings,building,travelshops,urban,japanstone,architecture,oldtourist,temple,portugal

houses-building:NSUBJbuilding-built:VMODbuilding-houses:RCMODstreet-shopping:NNground-zero:NUMhad-building:NSUBJbuilding-square:PREP INbuilding-front:PREP INbuilding-government:NNbuilding-pink:AMODbuilding-every:DETbuilding-oldest:AMODbuildings-colorful:AMODbuilding-large:AMODhouse-building:DEP

58 cake,groom,partyfruit,water,closeupglass,red,colorballoons,party,funpeace,love,portrait

glass-a:DETroot-wine:ROOThouse-tea:NNvase-the:DETwine-red:AMODglass-water:NNglasses-wine:NNglass-wine:NNbeer-a:DETroot-tea:ROOTcream-ice:NNflower-glass:PREP INglass-the:DETroot-fruit:ROOTcake-velvet:NN

59 cat,eyes,kittypets,cats,catfeline,kitten,catskitten,fun,jumpkitty,eyes,feline

lives-cat:NSUBJloves-cat:NSUBJcat-cute:AMODwatching-birds:DOBJone-cats:PREP OFcat-house:PREP INloves-sit:XCOMPcat-orange:AMODlikes-sit:XCOMPborder-white:AMODroot-shelter:ROOTcute-a:DETchair-desk:NNcat-street:NNroot-jack:ROOT

Continued on next page

20

Page 21: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

60 london,sky,riverfacade,church,nightstreet,light,nightarchitecture,buildings,nightbuilding,church,europe

building-government:NNbuilding-building:NSUBJbuilding-brown:AMODbuilding-yellow:AMODbuilding-large:AMODbuilding-white:AMODbuilding-built:VMODbuilding-big:AMODbuilding-background:PREP INbuilding-front:PREP INlooking-building:DOBJspree-river:NNbuilding-beautiful:AMODseine-the:DETbuilding-middle:PREP IN

61 weapons,red,blackwings,bird,skywow,airplane,flyingsquare,portrait,chinamotorcycle,road,sky

root-race:ROOTline-the:DETrace-bike:NNdragon-a:DETtimes-a:DETride-bike:NSUBJwoman-young:NSUBJmotorcycle-a:DETguitar-a:DETroot-guitar:ROOTwaters-the:DETband-the:DETrace-a:DETroot-model:ROOTbody-the:DET

62 police,protesters,protestphotojournalism,color,olympusprotest,riot,protestersparade,seattle,officersofficers,motorcycle,people

motorcycle-a:DETcross-street:DOBJshow-tv:NNrace-a:DETstreet-busy:AMODcar-police:NNscheme-white:AMODsecurity-the:DETboys-blue:PREP INparade-the:DETroot-band:ROOTcrossing-street:DOBJscheme-black:AMODtrucks-the:DETtraffic-the:DET

Continued on next page

21

Page 22: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

63 individual,person,peoplechristmas,dog,familykiss,cute,weddingwolf,red,foxpair,animal,cat

root-daughter:ROOThouse-girls:PREP INgirl-red:PREP INhouse-chris:PREP INflower-hair:PREP INdress-red:AMODchris-girls:CONJ ANDboy-red:PREP INchris-house:PREP ATchris-uncle:NNchair-computer:NNred-black:CONJ ANDshirt-red:AMODline-bathroom:PREP FORhas-girl:NSUBJ

64 vehicle,cars,speedautomobile,ontario,speedcars,racing,classicspeed,racing,carauto,automobile,race

car-toy:NNcar-blue:AMODwarehouse-brick:NNspotted-car:NSUBJcar-rental:AMODcar-french:AMODcar-classic:AMODheld-warehouse:PREP INparked-car:NSUBJshow-car:NNwarehouse-red:AMODcar-field:PREP INheld-scenery:NSUBJparked-street:PREP INroot-car:ROOT

65 phone,red,nighttelephones,night,redtollbooth,scotland,streetapartments,pool,swimmingshop,sign,night

doors-blue:AMODstreet-little:AMODstreet-an:DETdoors-windows:CONJ ANDdoor-windows:CONJ ANDsign-white:AMODstreet-high:AMODwindows-wall:PREP INstreet-small:AMODmachine-vending:AMODquarter-french:AMODsign-blue:AMODbuilding-empty:AMODwindow-bar:PREP OFreads-sign:NSUBJ

Continued on next page

22

Page 23: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

66 tollbooth,car,lightsaviation,fighter,californiafun,party,happyparis,panorama,polarrain,umbrella,people

screen-blue:AMODdesk-a:DETroot-computer:ROOTroot-suite:ROOToffice-box:NNscreen-big:AMODbar-little:AMODshow-tv:NNbooth-the:DETtrain-the:DETscreen-the:DETtruck-the:DETmachine-the:DETcomputer-a:DETscreen-video:AMOD

67 truck,rusty,vintageautomobile,ontario,speedantique,car,truckcar,automobile,truckautomobile,truck,california

truck-red:AMODcar-classic:AMODcar-red:AMODtruck-ford:NNshow-car:NNparked-car:NSUBJtruck-old:AMODshow-car:NSUBJspotted-car:NSUBJcar-little:AMODone-cars:PREP OFhood-the:DETcar-old:AMODcars-the:DETcar-blue:AMOD

68 square,portrait,chinaweapons,red,blackface,red,japanphotographer,people,photographersadventure,photography,valleys

girl-car:PREP INriding-cars:PREP INcar-the:DETseat-car:PREP OFcute-boy:DOBJboy-car:PREP INriding-car:PREP INsitting-seat:PREP INseat-back:AMODboy-cute:AMODbest-seat:DEPseat-front:AMODfair-street:NNseats-car:NNlooking-cute:ACOMP

Continued on next page

23

Page 24: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

69 elephants,sunset,travelgrass,cow,fieldgolf,spain,flagmeadow,color,autumnlawn,park,girl

root-horses:ROOThorses-the:DETstanding-tree:PREP UNDERanimals-park:NNanimals-run:CONJ ANDsitting-tree:PREP UNDERhabitat-a:DETtrees-three:NUMcow-the:DEThorse-field:PREP INcow-a:DETroot-cow:ROOTrun-birds:NNroot-horse:ROOTcows-field:PREP IN

70 child,boys,peoplekids,boy,hopegolden,dog,yellowholiday,christmas,funchina,street,man

dress-orange:AMODgirls-two:NUMat-beach:POBJroot-kids:ROOTgirl-local:AMODhad-time:DOBJflower-hair:PREP INme-shirt:PREP INcanyon-red:AMODgirls-playing:DEPon-bridge:POBJgirl-sitting:VMODvillage-a:DETbridge-golden:AMODcanyon-rock:NN

71 police,car,carsbus,abandoned,cloudsauto,truck,canadaengine,truck,autofirefighter,truck,manhattan

buses-the:DETbus-tour:NNroot-van:ROOTvan-white:AMODcar-street:NNbus-city:NNcar-green:AMODhas-car:NSUBJstation-bus:NNvan-a:DETcars-many:AMODvan-the:DETtruck-front:PREP INsee-car:DOBJmiddle-street:PREP OF

Continued on next page

24

Page 25: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

72 sheep,animal,hornsgoat,mountain,wildlifesheep,alaska,mountaincaribou,animals,alaskarunning,dog,horse

horse-white:AMODgoat-mountain:NNroot-goat:ROOThorse-field:PREP INpony-a:DETroot-sheep:ROOTdog-white:AMODhorses-white:AMODcow-field:PREP INcow-a:DETcrossing-road:DOBJroot-cow:ROOTfamily-foster:AMODsheep-field:PREP INgoat-a:DET

73 bird,tree,hawkbrasil,colors,coloradult,bird,birdsamerican,animal,eaglewildlife,bird,birds

bird-sitting:VMODroot-parrot:ROOTsanctuary-bird:NNbird-male:AMODrica-costa:NNbranch-tree:NNspotted-tree:PREP INbirds-the:DETbird-beautiful:AMODsitting-bird:NSUBJbranch-a:DETsitting-fence:PREP ONpark-bird:NNexhibit-the:DETbird-large:AMOD

74 kids,art,babytoy,figures,greenkitchen,pink,toystoys,pink,yellowboston,dog,puppy

girl-big:AMODpaper-wrapping:NNcute-too:ADVMODgirl-birthday:NNgirl-pink:PREP INshirt-pink:AMODdress-up:PRTgirls-the:DETroot-clothes:ROOTturned-party:PREP WITHbottles-water:NNturned-girl:NSUBJsink-kitchen:NNbears-the:DETroot-nap:ROOT

Continued on next page

25

Page 26: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

75 deer,handmade,cutepaint,street,paintinglong,white,hairsmile,cute,artgarden,closeup,insect

pot-the:DETgreen-white:CONJ ANDpot-a:DETcute-so:ADVMODroot-green:ROOTpot-flower:NNroot-jade:ROOTplants-potted:AMODguy-little:AMODhouses-bird:NNpot-plant:NNroot-hangs:ROOTbackyard-the:DEThangs-out:PRTcake-cup:NN

76 vegetables,color,peoplecottage,garden,architecturepost,night,streetplants,trees,treehouse,window,door

house-town:PREP INboxes-flower:NNboxes-window:NNtree-new:AMODroot-front:ROOTstreet-side:NNhouse-cool:AMODpots-the:DEThouse-traditional:AMODhouse-a:DETbox-window:NNhouse-street:PREP INplants-pots:PREP INroot-shrine:ROOThouse-area:PREP IN

77 ceremony,dance,childportland,lights,microphoneshouse,home,interiorscience,art,deathlighting,music,festival

black-white:CONJ ANDfilm-white:AMODportrait-black:PREP INshot-white:PREP INin-white:POBJroot-photo:ROOTshot-black:PREP INfilm-black:AMODportrait-self:NNin-black:POBJversion-black:AMODblack-in:ADVMODmirror-bathroom:NSUBJblack-the:DEPphoto-white:AMOD

Continued on next page

26

Page 27: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

78 horses,explore,animalracing,horse,sporthorse,argentina,fieldrunning,dog,horseuniform,world,historic

taken-family:AGENThorse-white:AMODfamily-foster:AMODretriever-golden:AMODhorses-the:DETdog-service:NNroot-dogs:ROOTforest-new:NNwalking-dogs:DOBJpony-a:DETdog-white:AMODroot-horse:ROOThorse-black:AMODmarket-animal:NNhorses-white:AMOD

79 puppy,baby,animalsplay,dog,dogspups,yellow,petrunning,dog,horsealaska,sheep,wildlife

boy-dog:CONJ ANDbeach-dog:NNlion-mountain:NNlion-a:DETdogs-two:NUMdog-brown:AMODdogs-the:DETcub-a:DETroot-dogs:ROOTgoat-a:DETbeach-pebble:AMODcat-orange:AMODcat-street:NNpuppy-a:DETdog-cute:AMOD

80 mug,dog,petpaint,design,yellowtour,washington,peoplesmall,big,mancolourful,color,colours

cloth-table:NNcups-the:DETbowl-the:DETroot-cup:ROOTroot-tea:ROOTroot-bowls:ROOTrose-petals:DOBJroot-balls:ROOTcup-the:DETsale-market:PREP INgirl-birthday:NNroot-cups:ROOTcloth-a:DETballs-glass:NNbowl-big:AMOD

Continued on next page

27

Page 28: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

81 zoo,bird,giraffeamerican,animal,eagleadult,bird,birdsbirds,wings,whitefab,animal,animals

heron-a:DETbird-large:AMODheron-blue:AMODheron-great:AMODexhibit-the:DETbird-water:NNroot-heron:ROOTbird-the:DETone-birds:PREP OFpark-wildlife:NNduck-the:DETduck-black:AMODsitting-bird:NSUBJduck-white:AMODpigeon-a:DET

82 golf,spain,flagsheep,landscape,skycows,trees,grasslawn,clouds,landscapegrass,cow,field

fields-green:AMODgreen-so:ADVMODfield-cow:NNfield-soccer:NNgreen-grass:NSUBJlawn-the:DEThouse-field:NNfield-big:AMODhouse-background:PREP INfield-front:PREP INgreens-the:DETfield-football:NNfield-large:AMODgreen-very:ADVMODpark-golden:NN

83 flying,california,pilotmusic,art,redwindows,people,cloudsbazaar,iran,lightshopping,architecture,building

theatre-the:DETbuilding-background:PREP INfilm-black:AMODhouse-opera:NNbuilding-capital:NNfilm-white:AMODtaken-white:PREP INsquare-the:DETbridge-tower:NNfield-football:NNcourt-the:DETblack-white:CONJ ANDship-bottle:PREP INsky-black:AMODbridge-black:PREP IN

Continued on next page

28

Page 29: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

84 room,design,homekitchen,interior,designinterior,furniture,housedesign,interior,furnituredecoration,home,room

root-room:ROOTroom-dining:NNroom-living:AMODliving-room:DOBJroom-guest:NNdining-room:DOBJroom-the:DETroom-house:PREP INbedroom-house:PREP OFtable-chairs:CONJ ANDlooking-room:PREP INTOdoor-looking:VMODroom-great:AMODrooms-the:DETroom-living:NN

85 office,apple,maccoffee,man,applehome,interior,designapple,office,macdisplay,apple,mac

desk-office:PREP INroom-hotel:NNdesk-computer:NNbed-room:PREP INcomputer-the:DEToffice-new:AMODbedroom-house:PREP OFsit-to:AUXroom-living:NNbed-bedroom:PREP INdesk-room:PREP INhouse-parent:POSStable-window:PREP BYroot-desk:ROOToffice-home:NN

86 trees,leaves,autumntree,trunk,leavesforest,wood,lighttrunk,tree,greenwoods,leaves,path

grow-trees:NSUBJforest-rain:NNtrees-forest:PREP INforest-cloud:NNrainforest-the:DETforest-green:AMODin-forest:POBJtree-forest:PREP INcanopy-the:DETclimbing-tree:DOBJtrees-all:PREDETmountains-blue:AMODroot-forest:ROOTforest-a:DETwalking-forest:PREP IN

Continued on next page

29

Page 30: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

87 farm,animal,cowcow,animals,nosecows,scotland,hornsnature,wildlife,animaljune,animal,mammal

cow-a:DETfield-a:DETroot-cow:ROOTcow-field:PREP INroot-lions:ROOTgrass-green:AMODpig-a:DETroot-skull:ROOTsheep-a:DETlion-stone:NNeating-grass:DOBJstump-the:DETplaying-grass:PREP INgrass-field:PREP INstump-tree:NN

88 fence,red,colorpole,light,birdlines,wall,shadowwood,door,oldfloor,people,black

bird-window:PREP INmirror-bathroom:PREP INbox-bird:NNlamp-an:DETfence-a:DETpost-lamp:NNlamp-street:NNdoor-house:PREP INwire-a:DETdoor-a:DETfixture-light:AMODwires-the:DETorange-an:DETflying-bird:NSUBJparrot-a:DET

89 facade,church,nightpakistan,architecture,mosquetourism,europe,triptourist,temple,portugaldowntown,building,blue

building-built:VMODrow-houses:PREP OFbuilding-interesting:AMODhouse-court:NNbuilding-city:NNcool-building:DOBJbuilding-station:NNbuilding-town:PREP INbuilding-post:NNbuilding-area:PREP INmosque-the:DETbuilding-favorite:AMODbuilding-style:NNhad-building:NSUBJhouse-building:DEP

Continued on next page

30

Page 31: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

90 peace,love,portraithuman,school,photosmall,big,manmen,male,sportsgold,color,art

boy-sitting:VMODsitting-desk:PREP ATwoman-sitting:VMODseat-house:PREP INgirl-sitting:VMODwoman-an:DETgirl-boy:CONJ ANDroot-woman:ROOTreading-book:DOBJroot-student:ROOTcomputer-a:DETman-sitting:DEPphone-mobile:AMODwoman-young:NSUBJoutfit-a:DET

91 motorcycle,motion,asiabike,motorcycle,racemotorcycle,road,skyparade,school,oldpolice,car,cars

bike-front:PREP INmotorcycle-a:DETride-bike:DOBJrace-a:DETbicycle-a:DETshow-car:NNroot-show:ROOTscene-typical:AMODtrailer-the:DETmachine-green:AMODcap-the:DETman-an:DETpick-up:PRTtruck-big:AMODcar-green:AMOD

92 tracks,locomotive,stationlocomotive,bridge,trackrailway,bridge,steamrailroad,locomotive,steamtrain,sky,city

train-a:DETtracks-railroad:NNroot-train:ROOTyard-train:NNtracks-train:NNtrain-an:DETcar-box:NNcars-train:NNtracks-train:NSUBJmill-the:DETmill-paper:NNtrain-freight:NNfire-a:DETgoes-train:NSUBJtrain-old:AMOD

Continued on next page

31

Page 32: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

93 truck,tanker,massachusettsbus,abandoned,cloudsvehicle,abandoned,rustfirefighter,truck,manhattanauto,truck,canada

buses-the:DETtrain-road:NNtruck-fire:NNcar-street:NNroot-van:ROOTtrain-little:AMODtruck-water:NNstation-bus:NNsee-car:DOBJtruck-blue:AMODparked-car:NSUBJcars-two:NUMcar-one:NUMhouse-car:CONJ ANDroot-truck:ROOT

94 interior,furniture,housefurniture,architecture,interiordesign,interior,furniturechairs,interior,officehome,interior,design

room-house:PREP INbedroom-house:PREP OFliving-room:DOBJroot-room:ROOTtable-kitchen:PREP INroom-house:PREP OFtable-window:PREP BYroom-dining:NNroot-bedroom:ROOTone-rooms:PREP OFhouse-bedroom:AMODleads-door:NSUBJroom-great:AMODroom-new:AMODroot-guest:ROOT

95 running,dog,horsedog,white,exploregrass,cow,fieldrun,dog,fundeer,wildlife,forest

running-field:PREP INgrass-lush:AMODdog-field:PREP INdog-grass:PREP INeating-grass:DOBJlake-house:PREP BEHINDin-field:POBJplaying-grass:PREP INrunning-grass:PREP INin-grass:POBJeat-to:AUXgrass-the:DETspotted-field:PREP INhorse-white:AMODsitting-grass:PREP ON

Continued on next page

32

Page 33: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

96 dogs,funny,cutepet,dog,puppypuppy,baby,animalsbrown,animal,beardog,animals,explore

sleeping-basket:PREP INfair-state:NNpillow-a:DETdish-water:NNgirl-bed:PREP INsitting-basket:PREP INvisit-to:AUXpillow-the:DETroot-fat:ROOTold-weeks:NPADVMODroot-sleeps:ROOTpuppy-the:DEThouse-cat:NNtaking-nap:DOBJroot-puppy:ROOT

97 horses,portrait,animalleaf,autumn,bravohorse,red,whiteawesome,fun,floridabrown,animal,bear

chain-a:DETcat-orange:AMODhorse-a:DETarm-the:DEThangs-out:PRTmonkeys-the:DETroot-finds:ROOTmouse-a:DETbox-bird:NNlion-tree:PREP INspotted-garden:PREP INcreature-a:DETtaking-nap:DOBJclimbing-tree:DOBJlion-mountain:NN

98 bike,motorcycle,racemotorcycle,motion,asiamotorcycle,road,skysport,race,carbicycle,motion,girl

motorcycle-a:DETride-bike:DOBJowner-the:DETbike-front:PREP INcap-the:DETdog-basket:PREP INrace-a:DETbike-road:NNbicycle-a:DETgirl-sexy:AMODshow-car:NNseat-bike:NNride-to:AUXmachine-green:AMODfair-street:NN

Continued on next page

33

Page 34: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts

99 cow,rural,skycows,clouds,grassgrass,cow,fieldrun,dog,funmother,animal,cat

cow-a:DETcow-field:PREP INroot-cow:ROOThorse-black:AMODpasture-the:DETpasture-a:DETcow-the:DETeating-grass:DOBJstanding-field:PREP INroot-horses:ROOThorses-white:AMODroot-horse:ROOTrunning-field:PREP INroot-catch:ROOThorses-the:DET

100 apple,office,macmac,leopard,displayoffice,apple,macmac,office,photographydisplay,apple,mac

desk-office:PREP INcomputer-the:DETroot-desk:ROOTmonitor-the:DETlaptop-the:DETdesk-new:AMODkeyboard-the:DETdesk-room:PREP INscreen-the:DEToffice-the:DETdesk-computer:NNdesk-the:DETtv-screen:NNroot-monitor:ROOToffice-new:AMOD

101 dog,animals,exploredogs,funny,cutenose,dog,cowpets,pups,dogdog,white,explore

dog-black:AMODroot-puppy:ROOTboy-good:AMODpuppy-a:DETpuppy-cute:AMODdog-brown:AMODseat-back:AMODball-tennis:NNdog-house:PREP INroot-loves:ROOTpuppy-the:DETdog-box:PREP INdog-car:PREP INroot-charlie:ROOThouse-dog:NN

Continued on next page

34

Page 35: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts102 ocean,clouds,sunset

sunset,landscape,seaboat,sunset,sunsailboat,ocean,sunsetorange,sunset,sky

root-sunset:ROOTsunset-a:DETcoast-east:AMODtaken-beach:PREP FROMsunset-golden:AMODgulf-the:DETsun-setting:NNroot-sunrise:ROOTboat-ocean:PREP INsunset-the:DETsun-sky:PREP INhorizon-the:DETroot-sail:ROOTsets-sun:NSUBJtaken-beach:PREP ON

103 classic,automobile,redcar,automobile,truckauto,automobile,raceautomobile,transportation,vintagevintage,car,classic

root-show:ROOTcar-classic:AMODshow-car:NSUBJshow-car:NNone-cars:PREP OFparked-street:PREP ONcar-old:AMODcar-toy:NNtruck-red:AMODcars-two:NUMcar-red:AMODcar-vintage:AMODcar-street:PREP INbuilding-d70:PREP INparked-car:NSUBJ

104 airplane,clouds,skyairport,runway,skyaircraft,pilot,fighterpolaroid,marsh,landscapewings,bird,sky

airplane-a:DETcar-lot:PREP INlot-the:DETline-white:AMODtaken-pictures:NSUBJPASSroot-ice:ROOTgarage-parking:NNfrom-window:POBJlines-the:DETriver-frozen:AMODlot-parking:NNdriving-car:PREP INroot-lot:ROOTtaken-morning:PREP INwindow-plane:PREP OF

Continued on next page

35

Page 36: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts105 bus,abandoned,clouds

vehicle,abandoned,rustauto,truck,canadapolice,car,carsautomobile,truck,california

car-street:NNroot-van:ROOTvan-a:DETbuses-the:DETbus-city:NNparked-street:PREP INvan-the:DETcar-green:AMODtruck-blue:AMODsee-car:DOBJtruck-water:NNbus-tour:NNhas-car:NSUBJcar-street:PREP ONbus-school:NN

106 bird,tree,hawkadult,bird,birdshawk,red,georgiaanimal,bird,reptileamerican,animal,eagle

one-birds:PREP OFbird-little:AMODbird-sitting:VMODpigeon-a:DETsitting-fence:PREP ONbird-an:DEThawk-a:DETspotted-bird:DOBJbirds-many:AMODbird-small:AMODbird-male:AMODsparrow-house:NNsitting-bird:NSUBJfeeders-bird:NNsparrow-a:DET

107 apple,office,macoffice,apple,macmac,office,photographyhome,interior,designwork,office,apple

desk-room:PREP INdesk-computer:NNdesk-the:DETroot-desk:ROOTdesk-office:PREP INdesk-new:AMODdesk-a:DETdesk-office:NNlaptop-the:DETarea-bar:NNshelf-book:NNdesk-bedroom:PREP INcabinet-the:DETsink-kitchen:PREP INroot-computer:ROOT

Continued on next page

36

Page 37: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts108 run,dog,fun

foals,horse,maregrass,cow,fieldrunning,dog,horsepuppy,baby,animals

dog-black:AMODhorse-black:AMODgrass-lush:AMODplaying-field:PREP INball-tennis:NNwalking-field:PREP INrunning-grass:PREP INplaying-ball:DOBJsitting-grass:PREP ONcow-field:PREP INin-grass:POBJdog-grass:PREP INbird-black:AMODduck-black:AMODrunning-field:PREP IN

109 deer,wildlife,forestfawn,nature,whiteontario,fawn,animalwoods,deer,wildlifephotos,animal,images

cat-orange:AMODcat-street:NNcat-house:NNcat-box:PREP INdeer-a:DETporch-back:AMODroot-fox:ROOTfood-dog:NNkitty-box:PREP INone-cats:PREP OFcat-window:PREP INdish-water:NNwatching-birds:DOBJcat-cute:AMODroot-sleeps:ROOT

110 historical,war,germanydoor,windows,houseagent,night,streetcarpet,room,chairwarehouse,window,door

box-yellow:AMODsign-yellow:AMODhouse-blue:AMODcar-street:NNdog-window:PREP INroot-russia:ROOTsign-little:AMODhours-the:DETwarehouse-a:DETlive-people:NSUBJgoes-train:NSUBJroot-waits:ROOTcar-yellow:AMODsign-window:PREP INdepartment-the:DET

Continued on next page

37

Page 38: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts111 chairs,interior,office

design,interior,furnitureroom,window,abandonedinterior,furniture,houseabandoned,ruin,factory

dining-room:DOBJtable-window:PREP BYliving-room:DOBJroot-lounge:ROOTroom-sitting:AMODkitchen-house:PREP INroom-great:AMODroot-kitchen:ROOTwindow-bay:NNroom-house:PREP INsliding-doors:DOBJleads-door:NSUBJarea-bar:NNlounge-the:DETtables-chairs:CONJ AND

112 truck,sky,cloudsrain,night,reflectionsuburban,arizona,landscapehigh,texas,metronederland,architecture,city

looking-road:DOBJbuilding-walking:VMODtrees-palm:NNstreets-buildings:CONJ ANDbuilding-background:PREP INpictures-buildings:PREP OFpictures-streets:PREP OFview-office:PREP FROMstreets-beautiful:AMODtrees-flowers:CONJ ANDpictures-building:PREP OFpictures-pictures:NSUBJview-street:PREP OFbuilding-back:PREP INsee-distance:PREP IN

113 dogs,funny,cutedog,animals,explorepets,pups,dogcute,dog,puppypups,yellow,pet

root-puppy:ROOTpuppy-a:DETdogs-two:NUMroot-buddy:ROOTdog-lazy:AMODpuppy-cute:AMODdog-white:AMODboy-good:AMODroot-doggy:ROOTdog-bag:PREP INroot-black:ROOTblack-white:AMODroot-puppies:ROOTdog-box:PREP INanimals-stuffed:AMOD

Continued on next page

38

Page 39: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts114 car,automobile,truck

vintage,car,classicclassic,automobile,redauto,truck,canadaantique,car,truck

car-vintage:AMODcar-classic:AMODone-cars:PREP OFcar-old:AMODroot-car:ROOTcar-a:DETcar-an:DETcar-street:PREP INtruck-ford:NNbed-truck:PREP OFparked-street:PREP ONcar-little:AMODcar-rusty:AMODcars-old:AMODcar-abandoned:AMOD

115 family,love,redcheering,fun,nationalmoose,dog,puppyhalloween,costume,chicagopolice,politics,peace

animals-stuffed:AMODsitting-seat:PREP INboy-car:PREP INsitting-box:PREP INlooked-cute:ACOMPparty-the:DETsitting-basket:PREP INsitting-floor:PREP ONgirls-standing:DEPcats-black:AMODchair-boy:NNbook-new:AMODhas-girl:NSUBJline-bathroom:PREP FORgirls-house:PREP IN

116 cow,animals,nosefarm,animal,cowbrown,animal,bearanimals,africa,deerhorses,portrait,animal

head-a:DETcow-a:DETsheep-a:DETroot-cow:ROOTcow-field:PREP INroot-skull:ROOThangs-out:PRTcrack-a:DETroot-goat:ROOTbrown-white:CONJ ANDdog-brown:AMODhouse-rock:NNlake-park:NNgoat-a:DETmarket-market:APPOS

Continued on next page

39

Page 40: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts117 tanks,oil,sunset

holidays,sunset,skyoil,field,kuwaitstanding,people,menfilm,sky,urban

palm-trees:DOBJroot-palm:ROOTpalm-trees:DEPtrees-palm:NNlooking-street:DOBJmonument-a:DETmiddle-street:PREP OFdocks-the:DETlined-tree:NSUBJmonica-santa:NNpeople-walking:VMODstanding-the:DETlined-street:DOBJroad-beach:NNbuilding-distance:PREP IN

118 buddha,gold,statuemicrophones,lights,festivalwarehouse,girl,fashionpalm,florida,politicsbar,new,factory

lit-light:PREP BYlight-candle:NNhouse-street:NNstanding-girl:NNroot-band:ROOTmarket-christmas:NNrock-house:DOBJwindow-red:AMODtry-stage:DOBJbar-local:AMODsun-coming:VMODlights-street:NNgirl-jacket:PREP INlight-red:AMODlight-yellow:AMOD

119 burma,photojournalism,facesfish,food,aquariumchristmas,dog,familysocial,brazil,brasilbear,man,cute

eat-to:AUXcake-birthday:NNread-book:DOBJroot-breakfast:ROOTsit-chair:PREP INtable-dinner:NNbook-a:DETtable-room:PREP INboy-chair:PREP INroot-loves:ROOTboy-cute:AMODroot-reads:ROOTsitting-office:PREP INhouse-grandparents:POSSsitting-kitchen:PREP IN

Continued on next page

40

Page 41: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts120 bike,motorcycle,race

motorcycle,motion,asiamotorcycle,road,skybicycle,motion,girldriver,white,horse

bike-road:NNbike-front:PREP INrace-bike:NNdog-basket:PREP INrace-mountain:NNbike-mountain:NNbicycle-a:DETrace-a:DETride-to:AUXbiking-mountain:NNrace-the:DETtrip-bike:NNride-bike:NNride-bike:DOBJmachine-green:AMOD

121 post,germany,digitalladder,sky,watercommercials,space,redaviation,fighter,californiaabstract,bravo,white

root-airplane:ROOTmorning-foggy:AMODplane-sky:PREP INsky-grey:AMODplane-flying:DEPwall-bedroom:NNroot-plane:ROOTroot-lines:ROOTairplane-a:DETaeroplane-an:DETairplane-an:DETplane-a:DETwire-a:DETcrack-wall:PREP INtelephone-a:DET

122 railroad,locomotive,steamlocomotive,bridge,tracktrain,sky,citymilitary,tanks,armyrailway,bridge,steam

train-passenger:NNcars-the:DETmill-paper:NNbridge-white:PREP INfilm-white:AMODbuilding-bridge:DOBJtrain-freight:NNroot-train:ROOTpass-to:AUXbridge-black:PREP INyard-train:NNvan-door:DEPtrain-a:DETtrain-old:AMODroot-crosses:ROOT

Continued on next page

41

Page 42: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts123 adorable,rabbit,bunny

kitty,white,catsfunny,cute,catcat,eyes,kittysweet,pet,animal

in-bag:POBJcute-being:COPcat-white:AMODcat-bag:PREP INchair-computer:NNbrought-home:DOBJchair-office:NNloves-sitting:XCOMPcat-house:PREP INloves-sit:XCOMPchair-bag:NNtable-computer:NNchair-desk:NNroot-cats:ROOTroot-jack:ROOT

124 birds,tree,colorfulcolor,macro,flowerbird,tree,hawkleaves,water,macrogreen,flower,macro

root-finch:ROOTgreenhouse-the:DETbird-male:AMODflower-front:PREP INroot-parrot:ROOTfinch-house:NNbuds-flower:NNbird-singing:NNconservatory-the:DETbird-colorful:AMODgarden-house:PREP OFtree-green:AMODgardens-kew:NNroot-bud:ROOThas-flowers:DOBJ

125 uniform,world,historicmotorcycle,road,skypolice,protesters,protestofficers,motorcycle,peoplephotojournalism,color,olympus

motorcycle-a:DETshow-tv:NNgirl-dog:CONJ ANDroot-race:ROOTroot-bags:ROOTrace-a:DETtime-good:AMODevent-the:DETfather-son:CONJ ANDroad-white:AMODkid-shirt:PREP INrace-the:DETshot-street:NNhorse-black:AMODroot-fight:ROOT

Continued on next page

42

Page 43: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts126 police,car,cars

roadblock,water,treerally,car,racingdriver,cars,autosuburban,car,wild

parked-car:NSUBJlot-parking:NNparked-car:NSUBJPASSlot-the:DETcars-two:NUMcar-rental:AMODplate-license:NNvan-the:DETcars-trucks:CONJ ANDcars-many:AMODstreet-house:PREP IN FRONT OFcar-lot:PREP INcar-street:PREP INsee-car:DOBJcars-the:DET

127 motorcycle,road,skymotorcycle,motion,asiaformula,classic,sportsport,race,cartrack,formula,race

red-black:CONJ ANDmotorcycle-a:DETtruck-red:AMODbike-front:PREP INcar-rental:AMODshow-car:NNparked-street:PREP ONcar-pink:AMODcar-one:NUMride-bike:DOBJpick-up:PRTtruck-big:AMODfondant-white:AMODcars-two:NUMride-to:AUX

128 police,car,carsauto,truck,canadacar,automobile,truckjeep,sky,bluejeep,cars,automobile

car-old:AMODcars-trucks:CONJ ANDroot-car:ROOTcar-background:PREP INcar-front:PREP INparked-street:PREP INparked-street:PREP ONhouse-car:CONJ ANDtruck-the:DETcar-street:PREP ONroot-split:ROOTcar-the:DETcar-house:PREP OFcars-old:AMODspotted-car:NSUBJ

Continued on next page

43

Page 44: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts129 toys,action,funny

rock,music,concerttoy,action,funstadium,game,peopleamerica,politics,democrat

screen-green:AMODwall-red:AMODstudio-the:DETdoor-red:AMODband-the:DETroot-figures:ROOTdressed-black:PREP INroot-princess:ROOTyear-new:AMODseat-best:AMODroot-angels:ROOTroot-dude:ROOTstanding-wall:PREP IN FRONT OFdress-paper:NNpants-black:AMOD

130 cute,cats,catkitten,pets,babykitty,white,catspets,cats,catfeline,kitten,cats

cat-white:AMODroot-shelter:ROOTroot-kittens:ROOTcat-cute:AMODcat-white:PREP INhouse-friend:POSSlives-cat:NSUBJloves-sit:XCOMPloves-cat:NSUBJcat-street:NNtable-kitchen:NNwatching-birds:DOBJone-cats:PREP OFcat-house:NNmoment-a:DET

131 sport,race,carrace,car,autospeed,racing,carauto,automobile,raceautomobile,ontario,speed

show-car:NNshow-car:NSUBJcar-classic:AMODcar-new:AMODone-cars:PREP OFbuilding-d70:PREP INcar-yellow:AMODshow-building:PREP ATcar-red:AMODcar-parked:VMODroot-show:ROOTtruck-ford:NNcar-black:AMODcar-toy:NNbuilding-britannic:AMOD

Continued on next page

44

Page 45: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts132 boys,girls,kid

mural,blue,redjump,swim,boysmile,fun,waterpicture,portrait,people

house-beach:NNgirls-house:PREP INdress-blue:AMODroot-party:ROOTroot-kids:ROOTbed-boy:NNmen-the:DETbuilding-house:DOBJone-shirt:PREP INshirt-orange:AMODdress-the:DETchildren-the:DETshirt-blue:AMODnight-bed:PREP INpainting-wall:PREP ON

133 urban,abandoned,nightcar,road,lighttollbooth,illinois,chicagobridge,ship,carmorning,people,coffee

cars-the:DETstreet-front:PREP INferry-the:DETroad-busy:AMODtaken-window:PREP OUT OFcross-river:DOBJbuilding-’re:AUXboats-the:DETview-table:PREP FROMtrailer-a:DETtruck-front:PREP INfrom-window:POBJtruck-pickup:NNroot-cars:ROOTstation-bus:NN

134 bench,people,sittingisrael,art,colorlawn,park,girlcountryside,farm,fieldgreen,forest,trees

plants-tomato:NNbird-colorful:AMODplant-to:AUXroot-parrot:ROOTroot-garden:ROOTplant-flowers:DOBJbird-beautiful:AMODplant-tomato:NNtable-bird:NNtree-bottle:NNparrot-a:DETgarden-water:NNsystem-a:DETbed-yard:PREP INbird-red:AMOD

Continued on next page

45

Page 46: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts135 bike,motorcycle,race

motorcycle,netherlands,nederlandformula,classic,sportmotorcycle,motion,asiamotorcycle,texas,explore

bike-road:NNbike-front:PREP INmotorcycle-a:DETbicycle-a:DETdog-basket:PREP INbasket-bike:NNroot-show:ROOTbike-mountain:NNride-to:AUXride-bike:DOBJstreets-the:DETtraffic-the:DETbuilding-britannic:AMODcar-new:AMODshow-car:NSUBJ

136 cute,cats,catkitten,pets,babykitty,white,catspuppy,white,animalslovely,cute,cat

kitty-window:PREP INcat-white:PREP INsitting-sun:PREP INroot-sill:ROOTroot-loves:ROOTenjoying-sun:DOBJwindow-open:AMODcat-street:NNlives-cat:NSUBJcute-being:COPwindow-sunny:AMODcat-lives:RCMODlikes-sit:XCOMPcat-black:PREP INloves-cat:NSUBJ

137 male,men,boyhorse,red,whitedive,coral,scubaholland,dance,lightbasket,basketball,cheerleader

horse-a:DETboy-young:AMODroot-horse:ROOThorses-the:DETswim-the:DETswim-lake:PREP INchair-blue:AMODtemple-a:DETroot-workers:ROOThorse-the:DETmai-chiang:NNtri-sprint:NNcage-the:DETchair-beach:NNswim-bike:CONJ AND

Continued on next page

46

Page 47: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts138 stairs,railing,urban

steps,shadow,shadowsbalcony,apartments,shadowlondon,underground,architecturerailroad,ties,light

environment-the:DETroot-stairs:ROOTcrane-a:DETframe-door:NNside-back:AMODwalking-bridge:PREP OVERcorner-the:DETroot-staircase:ROOTconstruction-the:DETcrane-the:DETbuildings-new:AMODtracks-train:NNladder-the:DETside-building:PREP OFcars-two:NUM

139 floor,window,interiorinterior,furniture,housedesign,interior,furnituredecoration,home,roomguest,room,cat

dress-wedding:NNbed-queen:NNroot-guest:ROOTroom-living:NNhas-bedroom:NSUBJtowels-the:DETfloor-room:PREP INbedroom-house:PREP OFbed-bedroom:PREP INbedroom-front:AMODroot-floor:ROOTbedroom-spare:AMODbedroom-house:PREP INfloor-bedroom:PREP INroom-bed:NN

140 tent,yellow,colorfulfavorite,sky,cloudscanoe,reflection,treestruck,sky,cloudsraw,abstract,explore

tree-bare:AMODtree-bottle:NNsummer-the:DETblue-deep:AMODtree-large:AMODtree-road:PREP INtree-winter:PREP INtree-young:AMODpine-tree:DOBJshot-tree:PREP OFhas-tree:NSUBJroot-plant:ROOTtree-park:PREP INroot-summer:ROOTplanted-tree:DOBJ

Continued on next page

47

Page 48: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts141 sepia,building,france

truck,old,colorsepia,portrait,girlperspective,church,italygreat,french,historic

shot-white:PREP INblack-white:CONJ ANDimage-white:AMODroot-black:ROOTphotography-white:AMODconversion-white:AMODcar-old:AMODfilm-white:AMODroot-iron:ROOTshot-black:PREP INtaken-white:PREP INblack-white:PREP INconverted-white:PREP TOversion-white:AMODconverted-black:PREP TO

142 bird,tree,hawkbirds,tree,colorfulmaryland,animal,animalsbrasil,colors,colorsunlight,green,summer

bird-colorful:AMODbird-blue:AMODbird-male:AMODbird-sitting:VMODone-birds:PREP OFbird-an:DETfeathers-the:DETparrot-a:DETroot-blackbird:ROOTblue-green:CONJ ANDbird-beautiful:AMODfeeder-bird:NNroot-parrot:ROOTspotted-bird:DOBJseed-bird:NN

143 seascape,sunrise,coastaustralia,coast,oceansnow,tree,treessand,landscape,cloudsfrozen,sunset,lake

window-office:PREP INwindow-train:NNlevel-water:NNreflection-window:PREP INview-window:PREP FROMview-ocean:PREP OFbalcony-hotel:NNwindow-office:NNview-window:PREP OUTline-water:NNview-ocean:NNview-office:PREP FROMwindow-hotel:PREP OFview-room:PREP FROMbank-a:DET

Continued on next page

48

Page 49: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts144 kid,people,water

pair,animal,catboys,girls,kidbasket,basketball,cheerleaderfamily,people,old

family-the:DETroot-brother:ROOTbedroom-new:AMODlions-the:DETroot-doll:ROOTwoman-an:DETgirl-looking:VMODgirls-white:PREP INwoman-sitting:VMODpark-city:NNbedroom-house:PREP OFpainting-wall:PREP ONgirl-a:DETroot-mother:ROOTdress-white:AMOD

145 runway,flight,aviationunited,airplane,airportlanding,aviation,flyinginternational,aircraft,airplaneflying,jet,wings

airplane-a:DETplane-a:DETview-ship:PREP OFland-to:AUXchairs-beach:NNpasses-as:MARKview-beach:PREP FROMmachine-flying:AMODbeach-the:DETview-beach:PREP OFbeach-island:NNbeach-sandy:AMODhouse-light:AMODboat-white:AMODship-cruise:NSUBJ

146 doorway,girl,womansuburban,car,wildhelicopters,public,alaskawaiting,bench,chairmosques,asia,islam

root-pants:ROOTfront-door:PREP OFopen-door:DOBJdoor-open:AMODdoor-red:AMODroot-sock:ROOTopen-door:NSUBJclothes-the:DETdoor-the:DETfloor-a:DETdoor-floor:PREP INchair-orange:AMODcat-black:AMODstore-clothing:NNbag-little:AMOD

Continued on next page

49

Page 50: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts147 fan,portrait,dance

fantasy,costume,playsinging,concert,banddrum,festival,rockband,brooklyn,lights

dress-red:AMODpants-red:AMODdress-the:DETwoman-dress:PREP INdress-shoes:CONJ ANDstanding-girl:NNgirl-dress:PREP INgirl-red:PREP INoutfit-a:DETin-dress:POBJdress-pink:AMODgirls-red:PREP INgirl-the:DETshirt-red:AMODdance-the:DET

148 classroom,california,applework,office,applechairs,interior,officecafe,bar,streetmeeting,office,war

lab-computer:NNtables-chairs:CONJ ANDchairs-the:DETarea-bar:NNroot-tables:ROOTclassroom-the:DETroot-lounge:ROOTarea-floor:NNlab-the:DETin-room:POBJtables-the:DETkitchen-house:NNdesk-a:DETroom-green:AMODtable-window:PREP BY

149 interior,furniture,househome,interior,designroom,design,homestudio,microphones,officedesign,interior,furniture

root-room:ROOTroom-living:NNoffice-home:NNbedroom-house:PREP INroot-desk:ROOTroom-living:AMODcloset-the:DETdesk-bedroom:PREP INroom-computer:NNdesk-room:PREP INbedroom-house:PREP OFdesk-new:AMODliving-room:DOBJroom-house:PREP INdining-room:DOBJ

Continued on next page

50

Page 51: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts150 individual,person,people

blue,architecture,buildingstanding,people,womancubism,art,redportland,lights,microphones

screen-the:DETboat-glass:NNmirror-bathroom:NSUBJwall-water:NNrobot-window:PREP INwindow-noiselab:NNmirror-bathroom:PREP INsubway-the:DETscreen-laptop:AMODstanding-window:PREP INboy-window:PREP INportrait-self:NNwindow-door:NNmonitor-computer:NNback-van:PREP OF

151 phone,maps,cameratelephones,night,redmac,black,musiccellphones,library,signbathroom,water,blue

machine-vending:AMODroot-machine:ROOTmachine-old:AMODbox-newspaper:NNdoor-office:NNroot-computer:ROOTpanel-the:DETcabinet-a:DETsticker-a:DETbooth-the:DETmachine-an:DETbox-paper:NNmachine-a:DETcomputer-the:DETroot-box:ROOT

152 soldier,mountains,marinewar,ship,historytrack,locomotive,enginerailroad,locomotive,steammilitary,tanks,army

photo-white:AMODphoto-black:AMODshot-the:DETtaken-white:PREP INtaken-black:PREP INfilm-black:AMODtanks-water:NNfilm-white:AMODyard-train:NNblack-white:CONJ ANDmill-paper:NNin-black:POBJshot-white:AMODin-white:POBJblack-a:DET

Continued on next page

51

Page 52: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts153 cows,clouds,grass

cow,rural,skyhorses,explore,animalanimals,africa,deerhorse,sky,landscape

cow-a:DETroot-horses:ROOThorse-white:AMODhorses-white:AMODroot-cow:ROOThorses-the:DETcow-field:PREP INroot-dogs:ROOTroot-goat:ROOTroot-horse:ROOTroot-sheep:ROOTgoat-a:DEThorses-wild:AMODgroup-a:DETcows-field:PREP IN

154 book,dog,funnytoy,figures,greenrefugees,africa,boyfigures,new,phoneprayer,people,buddhism

table-train:NNsitting-box:PREP INwrapping-paper:DOBJplaying-box:PREP INpaper-wrapping:NNanimals-stuffed:AMODbox-the:DETchris-house:PREP ATchris-girls:CONJ ANDchair-boy:NNchair-girl:NNgirls-little:AMODroot-loves:ROOTbags-plastic:AMODgirl-big:AMOD

155 formula,classic,sportauto,truck,canadavehicle,vintage,automobilerace,car,autorally,car,racing

car-green:AMODroot-car:ROOTcar-red:AMODcar-blue:AMODcar-street:PREP ONcar-old:AMODcar-little:AMODroot-waits:ROOTcar-street:PREP INcar-cute:AMODriding-car:PREP INparked-street:PREP INcar-parked:VMODmachine-green:AMODcar-front:PREP IN

Continued on next page

52

Page 53: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts156 plants,trees,tree

moss,trees,treetropical,beautiful,animalstrail,forest,treesgarden,trees,tree

forest-monkey:NNplants-tomato:NNhouse-tree:NNtree-banyan:NNtree-fig:NNroots-tree:NNroot-plants:ROOTtree-huge:AMODtrees-banana:NNtree-banana:NNplants-trees:CONJ ANDroot-banana:ROOTtree-giant:AMODroot-forest:ROOTforest-bamboo:NN

157 yellow,color,colorswindows,people,cloudstoy,action,funnight,moon,skyrace,car,auto

car-yellow:AMODcenter-shopping:NNblue-the:DETsky-night:NNsign-neon:NNbuilding-sky:PREP INbackground-blue:AMODbuilding-sky:PREP AGAINSTblue-yellow:CONJ ANDsign-the:DETtower-prague:PREP INtake-shot:DOBJroot-clock:ROOTshot-building:PREP OFroot-night:ROOT

158 highway,night,traffictracks,light,cloudstraffic,highway,roadcars,night,lightmotion,tunnel,road

line-white:AMODbridge-highway:PREP OVERroot-highway:ROOTtaken-bridge:PREP FROMhighway-a:DETover-bridge:POBJlane-bike:NNhighway-the:DETseen-bridge:PREP FROMroad-ring:NNroad-long:AMODbridge-road:PREP OVERbridge-tracks:PREP OVERbridge-water:NNbridge-pedestrian:AMOD

Continued on next page

53

Page 54: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts159 tulip,color,orange

blooms,red,springmemorial,monument,statuelawn,park,girlgardens,trees,tree

flowers-bed:PREP INbeds-flower:NNflower-bed:DEPplant-to:AUXflowers-front:PREP INbed-front:PREP INpretty-flowers:DEPbed-yard:PREP INbed-flower:NNflowers-red:AMODboxes-flower:NNplant-flowers:DOBJbox-flower:NNflowers-pretty:AMODflowers-growing:VMOD

160 garden,trees,treeplants,trees,treevegetables,color,peoplestatue,italy,architectureshop,market,food

root-pots:ROOTpots-the:DETtree-pot:PREP INpots-flower:NNroot-pot:ROOTplants-tomato:NNpot-big:AMODplant-to:AUXplants-potted:AMODpot-the:DETmarket-fruit:NNplant-pot:PREP INpot-a:DETshop-flower:NNmarket-flower:NN

161 runway,flight,aviationtrack,formula,racelanding,aviation,flyingwashington,seattle,artbritish,formula,car

track-the:DETlot-the:DETtruck-big:AMODcar-blue:AMODroot-cars:ROOTgarage-parking:NNfield-center:NNtake-off:PRTlot-parking:NNtruck-white:AMODhighway-a:DETmuseum-vintage:AMODairplane-the:DETpoint-vantage:NNrace-the:DET

Continued on next page

54

Page 55: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts162 bench,people,sitting

grey,architecture,urbanstunning,fantastic,traveloutside,portrait,catbarn,abandoned,wood

window-bay:NNlook-window:DOBJroot-cats:ROOTcats-window:PREP INwindow-bedroom:NNtable-breakfast:NNkitty-window:PREP INenjoying-sun:DOBJsitting-window:PREP INseat-window:NNtv-screen:NNwindow-the:DETbedroom-guest:NNsitting-house:PREP IN FRONT OFwindow-bedroom:PREP IN

163 host,graffiti,hotelmural,building,cityladder,orange,catfree,art,redbleu,red,explore

cage-the:DEThorse-a:DETdog-box:PREP INshelter-animal:NNroot-workers:ROOTbusiness-a:DETwall-colorful:AMODwalking-street:PREP ONroot-horse:ROOTfood-dog:NNscene-typical:AMODroot-buy:ROOTroot-stand:ROOTtrain-station:DOBJgoat-a:DET

164 adult,blue,outdoorfauna,zoo,photonetherlands,light,danceamerican,animal,eaglelizard,snake,water

root-owl:ROOTguy-little:AMODbirds-baby:NNaquarium-the:DETcreature-a:DETturtles-the:DETrest-a:DETwhite-yellow:CONJ ANDhouse-tropical:AMODshell-a:DETroot-stuck:ROOTcap-a:DETroot-frog:ROOTtiger-the:DETtiger-white:AMOD

Continued on next page

55

Page 56: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts165 shops,urban,japan

manhattan,traffic,buildingssigns,asia,japanmall,shop,ontariotheater,neon,california

store-book:NNstreet-shopping:NNbuilding-colorful:AMODbuilding-market:NNsign-white:AMODbuilding-station:NNtrain-sky:NNtown-china:NNbuilding-brown:AMODstore-the:DETstore-grocery:NNstore-clothing:NNbuilding-interesting:AMODcorner-street:NNmarket-book:NN

166 france,panorama,polarcute,dog,puppycar,automobile,vehiclecat,kitten,kittyoregon,food,work

monkey-a:DETforest-monkey:NNmonkeys-the:DETcat-garden:PREP INmonkey-sitting:VMODcat-house:PREP INroot-monkey:ROOTcats-two:NUMsitting-window:PREP BYtree-lemon:AMODcat-pot:PREP INpark-bird:NNcat-black:AMODcats-black:AMODroot-pot:ROOT

167 food,cake,cheesejapan,food,cuterust,abstract,metalparty,fun,bluecoffee,red,mug

root-chocolate:ROOTroot-hand:ROOTbowl-wooden:AMODcake-chocolate:NNroot-pot:ROOTbowl-big:AMODplant-to:AUXroot-cups:ROOTdesign-a:DETcloth-table:NNshell-the:DETroot-basket:ROOTcake-cup:NNblue-brown:CONJ ANDganache-chocolate:NN

Continued on next page

56

Page 57: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts168 dog,animals,explore

dogs,funny,cutehorse,foals,animalsnose,dog,cowhorses,portrait,animal

dog-black:AMODdog-cute:AMODroot-puppy:ROOTseat-back:AMODroot-loves:ROOTboy-good:AMODpuppy-the:DEThorse-black:AMODeye-the:DETdog-street:NNdog-house:PREP INroot-buddy:ROOTdog-brown:AMODcow-a:DETface-the:DET

169 design,interior,furniturework,office,applehome,interior,designroom,design,homeinterior,furniture,house

table-window:PREP BYtable-kitchen:PREP INlounge-the:DETbedroom-house:PREP OFtable-side:NNroom-living:NNdesk-room:PREP INdesk-office:NNroom-hotel:NNtable-dinner:NNroom-the:DETroom-house:PREP INroot-room:ROOTroom-living:AMODdesk-office:PREP IN

170 bus,abandoned,cloudsroad,city,peoplemetro,texas,highhighway,police,tollboothconstruction,night,clouds

building-yellow:AMODbus-tour:NNbus-school:NNcar-yellow:AMODroot-center:ROOTtruck-yellow:AMODend-street:PREP OFcar-street:NNstreet-main:AMODroot-club:ROOTlooking-building:DOBJroot-train:ROOTstreet-city:NNin-front:POBJrow-houses:PREP OF

Continued on next page

57

Page 58: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts171 bike,motorcycle,race

bicycle,motion,girlmotorcycle,motion,asiamotorcycle,road,skyspeed,motion,bike

bike-road:NNbicycle-a:DETrace-bike:NNbike-front:PREP INrace-a:DETrace-mountain:NNbike-mountain:NNdog-basket:PREP INride-bike:DOBJride-bike:NSUBJride-to:AUXtour-bike:NNmotorcycle-a:DETrace-cup:NNrace-the:DET

172 airplane,pilot,fighterrunway,flight,aviationlanding,aviation,flyingcanada,aircraft,airplaneaircraft,pilot,fighter

museum-airplane:NNmay-collection:NNmuseum-vintage:AMODflying-order:DOBJmay-heritage:NNairplane-an:DETplane-the:DETposition-the:DETtail-the:DETflying-house:DOBJroot-plane:ROOTair-the:DETroot-sculpture:ROOTroot-airplane:ROOTmachine-flying:AMOD

173 wedding,dress,portraitfarm,animal,cowcows,scotland,hornsgroom,happy,beachgoat,cheese,cat

girl-flower:NNgirls-flower:NNgirl-wedding:PREP INdress-wedding:NNroot-mum:ROOThome-childhood:NNdresses-white:AMODdress-fancy:AMODstanding-’re:AUXdressed-white:PREP INdress-pretty:AMODceremony-the:DETroot-girls:ROOTroot-animals:ROOTdress-white:AMOD

Continued on next page

58

Page 59: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts174 ball,sport,soccer

running,cheering,citysoccer,beach,sunsetrun,dog,funscientists,science,art

playing-ball:DOBJplay-boys:NSUBJroot-children:ROOTroot-play:ROOTman-walking:VMODgame-a:DETball-the:DETgirl-dog:CONJ ANDball-basket:NNball-a:DEThorse-black:AMODroot-walks:ROOTroot-dude:ROOThorses-the:DETpants-the:DET

175 horse,foals,animalshorses,portrait,animalbride,beach,sunsetfoals,horse,smallbrasil,horses,horse

root-horse:ROOThorse-a:DEThorse-the:DEThorse-field:PREP INcow-a:DEThorses-the:DETriding-horse:DOBJroot-horses:ROOThorses-two:NUMhorse-black:AMODhorse-white:AMODpony-a:DETroot-sculpture:ROOTstanding-a:DEThave-house:DOBJ

176 pool,apartments,architectureindia,culture,peoplemosque,iran,prayermuseum,history,warchina,city,red

root-pool:ROOTtub-hot:AMODtable-chairs:CONJ ANDpool-the:DETpool-swimming:AMODbag-green:AMODtable-house:PREP INmiddle-night:PREP OFgreen-a:DETboy-boat:PREP INwater-green:AMODplays-boy:NSUBJone-blue:AMODroot-tables:ROOTtable-water:NN

Continued on next page

59

Page 60: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts177 running,dog,horse

brazil,horses,horserun,dog,funpuppy,baby,animalsbrasil,horses,horse

ball-tennis:NNplay-to:AUXroot-dogs:ROOTroot-animals:ROOTroot-play:ROOTplaying-ball:DOBJhaving-ball:DOBJdog-brown:AMODdream-a:DETfield-green:PREP OFrunning-grass:PREP INcute-dog:DOBJdog-street:NNgo-water:PREP INcow-the:DET

178 horses,explore,animalgrass,cow,fieldcow,rural,skyfoals,horse,mareafrican,elephant,baby

horse-a:DEThorse-black:AMODcow-field:PREP INroot-cow:ROOThorse-white:AMODpasture-the:DETroot-horses:ROOThorses-the:DETcow-the:DETroot-horse:ROOThorse-field:PREP INhorses-field:PREP INpony-a:DEThorses-white:AMODcows-field:PREP IN

179 men,male,sportsroom,people,adultsself,red,bathroomuniversity,sports,sportgirl,blue,girls

in-office:POBJrunning-house:PREP AROUNDhouse-lake:NNclassroom-a:DETfloor-kitchen:NNbook-a:DETin-room:POBJgame-a:DETboys-kitchen:PREP INroom-new:AMODplaying-ball:DOBJfloor-room:PREP INsitting-office:PREP INbed-boy:NNfloor-house:PREP IN

Continued on next page

60

Page 61: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts180 aquarium,animal,animals

flash,macro,greenbird,sky,blueflora,closeup,macroblooms,red,spring

tank-fish:NNmorning-every:DETtime-all:PREDETroot-poppy:ROOTneighbor-a:DETcute-how:ADVMODfriend-a:DETmouse-a:DETpink-a:DETfish-aquarium:PREP INtank-the:DETsitting-pot:PREP INspotted-garden:PREP INfeeder-the:DETeye-the:DET

181 dog,white,explorepuppy,baby,animalspet,dog,puppypups,baby,petdogs,funny,cute

dog-black:AMODroot-puppy:ROOTball-tennis:NNhorse-black:AMODdogs-the:DETpuppy-cute:AMODroot-catch:ROOTone-dogs:PREP OFbowl-water:NNdog-snow:PREP INdog-street:NNpuppy-the:DETroll-to:AUXboy-good:AMODroot-pepper:ROOT

182 car,automobile,truckracing,classic,carsrace,car,autoauto,automobile,racespeed,racing,car

one-cars:PREP OFshow-the:DETparked-street:PREP ONshow-car:NSUBJroot-show:ROOTshow-building:PREP ATroot-car:ROOTcar-blue:AMODcar-police:NNparked-street:PREP INbuilding-britannic:AMODcar-street:PREP INcar-a:DETbuilding-d70:PREP INshow-car:NN

Continued on next page

61

Page 62: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts183 stream,trees,sky

woods,leaves,pathtrail,forest,treeswoods,landscape,skyrailway,bridge,steam

bridge-little:AMODup-mountain:POBJtrack-the:DETrailway-the:DETside-mountain:PREP OFforest-rain:NNbridge-canyon:PREP OVERroad-mountains:PREP INfalls-tree:NSUBJbridge-creek:PREP OVERbridge-forest:PREP INroot-crosses:ROOTroot-suspension:ROOTroad-mountain:NNforest-mountain:NN

184 bike,motorcycle,racebicycle,motion,girlmotorcycle,road,skysquare,portrait,chinadriver,white,horse

seat-bike:NNbike-mountain:NNbike-road:NNrace-bike:NNdog-basket:PREP INrace-mountain:NNbike-front:PREP INride-bike:DOBJbasket-bike:NNride-bike:NSUBJmotorcycle-a:DETbicycle-a:DETrace-the:DETrace-cup:NNwheel-the:DET

185 navy,ship,watermilitary,tanks,armyship,harbour,cruisepacific,waves,natureships,port,boat

ship-the:DETroot-ship:ROOTship-cruise:NNship-cargo:NNship-a:DETbay-the:DETroot-ships:ROOTboat-ocean:PREP INships-cruise:NNboat-white:AMODship-background:PREP INview-ship:PREP OFmiddle-ocean:PREP OFships-the:DETship-cruise:NSUBJ

Continued on next page

62

Page 63: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts186 room,design,home

interior,furniture,housedesign,interior,furnituremodern,interior,furniturehome,interior,design

room-kitchen:CONJ ANDbedroom-the:DETchair-lounge:NNbed-room:PREP INroom-living:NNroot-room:ROOTdesk-room:PREP INroom-guest:NNroom-living:AMODtable-room:NNroot-downstairs:ROOTtable-side:NNbedroom-house:PREP OFlounge-the:DETbedroom-house:PREP IN

187 hospital,people,californiaphotos,art,photographsitting,clothing,girltrip,summer,peoplestairs,white,red

root-boy:ROOTchair-bag:NNgirl-baby:NNboy-blue:PREP INroot-pants:ROOTroot-nap:ROOThospital-the:DETbanks-outer:NNbag-sleeping:AMODtowel-beach:NNboy-bed:PREP INtowel-the:DETgirl-sitting:DEPgirl-boat:PREP INgirl-box:PREP IN

188 studio,microphones,officeinterior,furniture,housedecoration,home,roomhome,interior,designdesign,interior,furniture

room-house:PREP INliving-room:DOBJbedroom-new:AMODroot-guest:ROOTroom-living:AMODbedroom-house:PREP OFhouse-bedroom:AMODstanding-door:PREP INfireplace-the:DETstanding-doorway:PREP INroot-lounge:ROOTsee-door:DOBJstanding-way:PREP INroot-downstairs:ROOTroot-bedroom:ROOT

Continued on next page

63

Page 64: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts189 great,nature,wings

white,animal,animalsislands,booby,birdnature,bird,birdssave,water,macro

bird-white:AMODheron-the:DETegret-great:AMODflower-field:PREP INroot-white:ROOTflowers-white:AMODroot-gull:ROOTflower-white:AMODgardens-royal:NNkind-what:DETpost-a:DETroot-seagull:ROOTtit-blue:AMODbird-beautiful:AMODheron-a:DET

190 bicycle,track,artbike,track,vintagebicycle,motion,girlformula,classic,sportmotorcycle,road,sky

bike-road:NNbike-front:PREP INbicycle-a:DETdreams-places:PREP OFplaces-unconventionnal:AMODbike-mountain:NNmotorcycle-a:DETbike-field:PREP INbike-dreams:DEPbasket-bike:NNleaning-wall:PREP AGAINSTwheel-a:DETseat-bike:NNride-to:AUXwhite-black:CONJ AND

191 cat,kitten,kittyadorable,funny,naturesweet,pet,animallovely,cute,catrabbit,sweet,pets

cat-orange:AMODcat-cute:AMODcat-window:PREP INwindow-open:AMODlikes-sit:XCOMPcat-house:PREP INlives-cat:NSUBJone-cats:PREP OFcat-box:PREP INkitty-window:PREP INcat-lives:RCMODroot-kittens:ROOTcats-the:DETcats-two:NUMcat-street:NN

Continued on next page

64

Page 65: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts192 sign,sky,road

tollbooth,scotland,streetsign,funny,signsindustry,ship,waterbrick,wall,window

sign-side:PREP ONpainted-side:PREP ONroot-sign:ROOTsign-an:DETsign-house:PREP NEARsign-a:DETone-signs:PREP OFsign-town:PREP INsign-warning:AMODsign-wall:PREP ONsign-house:NNsign-old:AMODspotted-sign:DOBJsign-the:DETpainted-sign:DOBJ

193 pets,cat,catskitty,orange,catshorses,portrait,animalillustration,commercials,redcute,dog,puppy

one-cats:PREP OFlives-cat:NSUBJdog-black:AMODcat-lives:RCMODcat-black:AMODroot-met:ROOTtree-cat:NNhouse-cat:NNroot-catch:ROOTcats-the:DETcat-street:NNroot-goat:ROOTroot-shadow:ROOTcat-house:PREP INnotice-n’t:NEG

194 motorcycle,road,skyindia,culture,peoplegirls,boys,asiatoronto,protest,portraitpolice,politics,peace

dress-traditional:AMODmask-a:DETmotorcycle-a:DETroot-guitar:ROOTroad-white:AMODguitar-a:DETshoe-a:DETroot-bags:ROOTroad-pole:NNman-hat:PREP INshoe-the:DETred-black:CONJ ANDelephant-the:DETplaying-guitar:DOBJoutfit-a:DET

Continued on next page

65

Page 66: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts195 metro,texas,high

tollbooth,illinois,chicagohigh,texas,metrosigns,australia,nswsuburban,arizona,landscape

view-street:PREP OFsign-yellow:AMODstreet-house:PREP NEARroot-corner:ROOTbuilding-background:PREP INstreet-city:PREP INsee-sign:DOBJroot-county:ROOThouse-middle:PREP INlooking-road:DOBJbuilding-green:AMODside-street:PREP OFtruck-front:PREP INdirection-the:DETjam-traffic:NN

196 tree,trunk,leavesnsw,animal,flowerleaves,fall,treesquirrel,california,funnyasia,thailand,diving

monkey-tree:PREP INspotted-tree:PREP INclimbing-tree:DOBJsitting-tree:PREP INtree-house:PREP ATin-tree:POBJroot-monkey:ROOTbird-tree:PREP INsleeping-tree:PREP INup-tree:PREP INbird-yellow:AMODnest-tree:PREP INspotted-bird:DOBJhigh-tree:PREP INroot-monkeys:ROOT

197 apple,office,macmac,leopard,displayoffice,apple,macmac,office,photographydisplay,apple,mac

desk-new:AMODcomputer-the:DETroot-desk:ROOTdesk-computer:NNcomputer-a:DETdesk-office:PREP INscreen-blue:AMODdesk-room:PREP INroot-computer:ROOTdesk-office:NNlaptop-the:DETscreen-big:AMODdesk-a:DETmonitor-the:DETtv-screen:NN

Continued on next page

66

Page 67: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts198 kitten,fun,jump

eyes,cat,felinecat,eyes,kittyfeline,kitten,catsadorable,funny,nature

one-cats:PREP OFcat-cute:AMODloves-sit:XCOMPlives-cat:NSUBJwatching-birds:DOBJcat-street:NNtaking-nap:DOBJkitty-box:PREP INlikes-sit:XCOMPcat-fat:AMODbox-cardboard:NNsleeping-box:PREP INhit-car:AGENTcat-lives:RCMODloves-cat:NSUBJ

199 cat,kitten,kittyzoo,lion,mammalontario,fawn,animalfox,wild,animalwoods,deer,wildlife

cat-orange:AMODlion-mountain:NNroot-cub:ROOTcat-house:NNroot-fox:ROOThome-new:AMODcub-lion:NNcat-cute:AMODcat-street:NNeating-grass:DOBJone-cats:PREP OFtiger-a:DETlion-a:DETroot-ginger:ROOTanimals-the:DET

200 sheep,animal,hornsgoat,mountain,wildlifewild,deer,africahorns,sheep,landscapecow,rural,sky

root-sheep:ROOThorse-white:AMODgoat-a:DETcow-field:PREP INroot-goat:ROOTgoat-mountain:NNroot-cow:ROOThorse-field:PREP INroot-horse:ROOTpony-a:DETcow-a:DETsheep-the:DETsheep-field:PREP INhighlands-the:DETforest-new:NN

Continued on next page

67

Page 68: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts201 vegetables,color,people

shop,market,foodgarden,trees,treecopyright,fun,prettyindia,culture,people

market-local:AMODmarket-a:DETmarket-an:DETmarket-wholesale:AMODroot-market:ROOTroot-vendor:ROOTmarket-street:NNmarket-there:ADVMODmarket-open:AMODat-market:POBJroot-produce:ROOTstall-market:PREP INsale-market:PREP ATroot-food:ROOTpig-the:DET

202 kitchen,interior,designroom,design,homehome,interior,designdesign,interior,furniturepottery,home,retro

cabinet-kitchen:PREP INroot-cabinet:ROOTdoors-cabinet:NNroom-living:AMODlooking-room:PREP INTOshelf-kitchen:PREP INdesk-bedroom:PREP INroot-cabinets:ROOTcabinets-the:DETroom-family:NNsee-door:DOBJdining-room:DOBJwall-one:NUMstyle-the:DETroom-house:PREP IN

203 red,black,girlconstruction,boston,mansouth,people,eastraft,fun,seaprotest,france,protesters

trees-plant:NNboys-tree:PREP INup-mountain:POBJroot-pants:ROOTplant-tree:DOBJboy-tree:PREP INgirl-tree:PREP INnursery-tree:NNperson-the:DETrafting-white:AMODwater-white:NNfence-backyard:PREP INgarden-the:DETforest-green:AMODshirt-orange:AMOD

Continued on next page

68

Page 69: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts204 jeep,sky,blue

kuwait,car,carsroadblock,water,treetrip,summer,peoplepolice,car,cars

root-trucks:ROOTroot-truck:ROOTtruck-the:DETstuck-sand:PREP INcar-field:PREP INtruck-white:AMODcars-trucks:CONJ ANDroot-car:ROOTroot-van:ROOTcar-white:AMODcar-rental:AMODlot-parking:NNtruck-a:DETaccident-car:NNtrucks-the:DET

205 warehouse,girl,fashionhouse,home,interiorcoffee,man,applemuseum,history,warbus,people,england

film-white:AMODphone-a:DETroot-guitar:ROOTplaying-guitar:DOBJguitar-the:DETroot-man:ROOTguitar-a:DETme-mirror:PREP INfilm-black:AMODmirrors-the:DETcoat-the:DETblack-white:DEPwindow-store:NNlight-candle:NNroot-machine:ROOT

206 horse,argentina,fieldseaside,england,summermural,building,citytexas,war,fieldhelicopters,canada,toronto

horses-the:DETmachine-an:DETcow-the:DETroad-back:AMODhorse-the:DETpasture-a:DETroot-graffiti:ROOTbus-school:NNstanding-a:DEThorse-white:AMODhorse-a:DETroot-wheel:ROOTroot-sculpture:ROOTpark-car:NNside-the:DET

Continued on next page

69

Page 70: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts207 protesters,london,politics

downtown,people,streetprison,orange,womandriver,portrait,peopleholiday,christmas,fun

hat-black:AMODman-hat:PREP INroot-man:ROOTgirl-mirror:PREP INguitar-the:DETgirl-train:PREP INvan-60mm:NUMdressed-black:PREP INmask-a:DETface-to:AUXroot-guy:ROOTshirt-red:AMODshirt-black:AMODgirl-black:AMODgirl-red:PREP IN

208 boats,sunset,sunboat,sunset,sunbarge,sunset,skysea,boat,shipsailboat,reflection,clouds

boats-fishing:NNsky-water:CONJ ANDboats-small:AMODsunset-a:DETroot-harbor:ROOTlake-house:PREP BYroot-sunset:ROOThouse-boat:NNtaken-beach:PREP FROMsun-setting:NNboat-lake:PREP INfishing-boats:DOBJboats-wooden:AMODboat-lake:PREP ONroot-sailboat:ROOT

209 station,subway,metrotrain,tracks,lightbus,light,lightslocomotive,bridge,tracknight,street,traffic

train-a:DETstation-street:NNpasses-train:NSUBJstation-railway:NNtrain-car:NNroot-station:ROOTwaiting-train:PREP FORcar-train:NNstation-the:DETtrain-an:DETtrain-line:NNstation-central:NNroot-train:ROOTcrosses-train:NSUBJmetro-the:DET

Continued on next page

70

Page 71: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts210 auto,automobile,race

automobile,ontario,speedsport,race,carvehicle,cars,speedspeed,racing,car

parked-street:PREP ONspotted-car:NSUBJparked-car:NSUBJparked-street:PREP INcar-classic:AMODcar-street:PREP INone-cars:PREP OFcar-green:AMODwarehouse-brick:NNshow-car:NNroot-car:ROOTcar-toy:NNcar-vintage:AMODcar-street:PREP ONcar-new:AMOD

211 roadblock,water,treeshade,leaves,treesjune,world,francesmall,sky,watercow,dog,japan

crossing-road:DOBJroot-wash:ROOTroot-cow:ROOTkingdom-animal:NNroot-person:ROOTmai-chiang:NNshade-tree:PREP OFelephant-an:DETcow-the:DETstatue-massive:AMODlocals-the:DETcow-a:DETwalking-street:DOBJroot-walks:ROOTroad-the:DET

212 puppy,baby,animalsbunny,white,pupsrabbit,sweet,petsdogs,white,cutepups,yellow,pet

root-doggy:ROOTdog-house:PREP INcute-being:COPdog-cute:AMODroot-sleeps:ROOTbrought-home:DOBJbathtub-the:DETpuppy-cute:AMODput-box:PREP INroot-loves:ROOTdoggy-window:PREP INshelter-animal:NNrunning-house:PREP AROUNDroot-puppy:ROOTroot-buddy:ROOT

Continued on next page

71

Page 72: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts213 station,subway,metro

railing,night,sunsetcars,night,lightrail,station,nightlong,car,road

train-an:DETunder-bridge:POBJroot-train:ROOTtrain-the:DETbridge-brooklyn:NNpasses-train:NSUBJcross-bridge:NSUBJhome-train:NNtrain-a:DETbridge-road:NNtrain-passenger:NNgoes-bridge:NSUBJbridge-bridge:CONJ ANDtrain-line:NNstation-a:DET

214 forest,water,streamamerica,animal,naturesand,nature,desertmotorcycle,road,skynorth,green,england

bike-front:PREP INroot-statue:ROOTon-road:POBJmotorcycle-a:DETseat-bike:NNsculpture-a:DETpark-ocean:NNbody-the:DETbicycle-a:DETblue-a:DETride-bike:DOBJpark-oak:NNtrip-bike:NNtake-photo:DOBJshade-tree:PREP OF

215 president,america,partydemocrat,election,floridamorning,people,coffeecenter,beach,politicssmall,big,man

shirt-white:AMODme-shirt:PREP INboys-kitchen:PREP INsitting-desk:PREP ATroot-kate:ROOTin-shirt:POBJme-house:PREP INperson-one:NUMat-bar:POBJglass-wine:PREP OFwearing-shirt:DOBJgirls-kitchen:PREP INsign-to:AUXshirt-blue:AMODshirt-dress:NN

Continued on next page

72

Page 73: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts216 cats,kitten,pets

cat,kitten,kittysoft,animal,petadorable,rabbit,bunnyfeline,kitten,animals

root-cats:ROOTcats-two:NUMcat-kitchen:PREP INcat-white:AMODcat-cute:AMODsleeping-sun:PREP INnap-a:DETloves-cat:NSUBJcat-white:PREP INcat-black:AMODcats-the:DETcat-lives:RCMODpillow-the:DETcat-street:NNroot-black:ROOT

217 concert,cheering,metalladder,orange,catscientists,science,arttour,live,musicshopping,night,street

stage-the:DETroot-band:ROOTdisplay-the:DETwoman-the:DETscreen-tv:NNboys-girls:CONJ ANDshow-the:DETdisplay-window:NSUBJpeople-the:DETdance-the:DETroot-challenge:ROOTparade-the:DETseat-best:AMODfloor-dance:NNroot-game:ROOT

218 adorable,rabbit,bunnycat,kitten,kittykitty,white,catskitten,white,animalscats,kitten,pets

taking-nap:DOBJroot-sleeps:ROOTcat-fat:AMODcat-lives:RCMODcat-white:AMODsleeping-window:PREP INroot-buddy:ROOTcat-house:PREP INdesk-computer:NNroot-doggy:ROOTnap-a:DETlives-cat:NSUBJcat-cute:AMODloves-cat:NSUBJold-months:NPADVMOD

Continued on next page

73

Page 74: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts219 hawk,zoo,closeup

bird,eagle,zooamerican,animal,eagleadult,bird,birdshead,cat,zoo

guy-little:AMODbird-sitting:VMODone-birds:PREP OFsitting-fence:PREP ONspotted-bird:DOBJsparrow-a:DETpark-wildlife:NNbird-beautiful:AMODflew-bird:NSUBJfeeders-bird:NNbird-large:AMODfeathers-the:DEThead-a:DETbird-the:DEThawk-a:DET

220 mosque,pakistan,spainhistory,city,heritagedoor,architecture,stoneislam,arch,culturetourist,temple,portugal

door-main:AMODcolumns-the:DETroot-entrance:ROOThouse-court:NNcity-old:NNdoor-building:PREP OFmarble-white:AMODdoor-entrance:NNbuilding-random:AMODwindow-door:PREP ABOVEbuilding-area:PREP INbuilding-library:NNroot-door:ROOTsign-door:PREP OVERbuilt-church:NSUBJPASS

221 couple,street,kisssitting,street,manwaiting,train,cityguard,car,naturesilhouette,shadow,reflection

waiting-train:PREP FORstanding-man:NNroot-man:ROOTstatue-the:DETgirl-coat:PREP INwoman-walking:VMODstanding-front:PREP INroot-idea:ROOTroot-workers:ROOTshot-candid:AMODroot-father:ROOTstanding-way:PREP INcenter-convention:NNsitting-bench:PREP ONairport-the:DET

Continued on next page

74

Page 75: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts222 bus,abandoned,clouds

auto,truck,canadavehicle,abandoned,rustdriver,cars,autoautomobile,truck,california

van-a:DETtruck-fire:NNbus-school:NNcar-street:NNbuses-the:DETroot-travel:ROOTstation-bus:NNtrain-road:NNtruck-red:AMODtruck-blue:AMODcar-sitting:VMODmuseum-railroad:NNroot-van:ROOTtruck-a:DETcar-little:AMOD

223 run,dog,funrunning,dog,horsefoals,horse,marehorses,explore,animalshooting,rifles,war

horse-black:AMODgirl-dog:CONJ ANDdog-black:AMODball-tennis:NNroot-dogs:ROOTstanding-field:PREP INrunning-field:PREP INhorse-a:DETcow-a:DETboy-dog:CONJ ANDwalking-field:PREP INhorses-the:DETwalking-dogs:DOBJfield-the:DEThorse-the:DET

224 scenery,animals,animalcanyon,waterfall,riverstream,light,nightperfect,great,artwaterfall,fall,park

bridge-rock:NNrock-river:PREP INpools-the:DETstanding-rock:PREP ONruns-water:NSUBJfeature-water:NNmiddle-river:PREP OFstream-mountain:NNrocks-river:PREP INbath-bird:NNwater-cold:AMODfountain-a:DETpool-water:PREP OFbridge-natural:AMODdrink-a:DET

Continued on next page

75

Page 76: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts225 vehicle,abandoned,rust

truck,tanker,massachusettsbus,abandoned,cloudsrust,truck,carautomobile,truck,california

truck-old:AMODroot-truck:ROOTcar-old:AMODcar-an:DETtruck-an:DETtruck-water:NNroot-van:ROOTcar-abandoned:AMODcars-old:AMODparked-truck:NSUBJcar-sitting:VMODroot-stuck:ROOTcar-front:PREP INroot-trucks:ROOTtruck-field:PREP IN

226 small,animal,petcat,kitten,kittyrabbit,sweet,petspets,cat,catsadorable,funny,nature

cat-box:PREP INbox-a:DETbox-shoe:NNcat-black:AMODsitting-box:PREP INcats-black:AMODroot-finds:ROOTbasket-laundry:NNcat-bag:PREP INlikes-sit:XCOMPsleeping-box:PREP INput-box:PREP INbox-cat:NNlives-cat:NSUBJcat-lives:RCMOD

227 racing,classic,carsrace,car,autocar,automobile,truckautomobile,truck,californiavintage,car,classic

truck-ford:NNplate-license:NNone-cars:PREP OFroot-car:ROOTspotted-car:NSUBJtruck-pickup:NNtruck-blue:AMODhood-the:DETcars-many:AMODparked-car:NSUBJcar-street:PREP INcar-a:DETcar-field:PREP INparked-street:PREP INshow-a:DET

Continued on next page

76

Page 77: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts228 abandoned,house,rural

farm,barn,abandonedold,sky,cloudscabin,old,abandonedfence,winter,snow

abandoned-house:DOBJbarn-old:AMODhouse-forest:PREP INhouse-an:DETtracks-railroad:NNroad-county:PREP INhouse-old:AMODroad-country:NNhouse-hill:PREP INhouse-stone:NNhouse-a:DEThouse-hill:PREP ONhouse-pump:NNhouse-road:PREP ONcovered-house:NSUBJ

229 auto,automobile,racerace,car,autocar,automobile,truckautomobile,ontario,speedclassic,automobile,red

root-show:ROOTshow-car:NSUBJcar-classic:AMODbuilding-d70:PREP INparked-street:PREP ONshow-car:NNshow-building:PREP ATbuilding-britannic:AMODone-cars:PREP OFcar-the:DETshow-a:DETwarehouse-brick:NNroot-car:ROOTparked-street:PREP INcar-a:DET

230 band,portrait,livebike,motorcycle,bluemicrophones,studio,californiaties,glasses,banddemocrat,washington,florida

reading-book:DOBJguitar-a:DETbasket-bike:NNroot-guitar:ROOTsleeping-man:NNbooks-the:DETvendor-street:NNguitar-the:DETseat-driver:POSSmachine-flying:AMODseat-front:AMODcomputer-the:DETbus-city:NNseat-bike:NNcars-the:DET

Continued on next page

77

Page 78: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts231 dogs,funny,cute

rabbit,sweet,petsfunny,cute,naturecute,dog,puppydog,animals,explore

root-cats:ROOTroot-sleeps:ROOTchair-computer:NNdesk-computer:NNchair-office:PREP INcat-fat:AMODpuppy-cute:AMODdog-house:PREP INroom-family:NNchair-lounge:NNbedroom-the:DETat-home:DEProot-puppy:ROOTdog-brown:AMODfireplace-the:DET

232 racing,cars,classicrace,car,autocar,racing,raceformula,historic,classicracing,classic,cars

truck-red:AMODshow-car:NNcar-red:AMODspotted-car:NSUBJwarehouse-brick:NNroot-cars:ROOTparked-car:NSUBJdog-truck:PREP INcar-toy:NNcar-yellow:AMODcar-french:AMODwarehouse-red:AMODtruck-pickup:NNheld-warehouse:PREP INshow-a:DET

233 cables,building,applerainy,umbrella,peoplesmall,big,manadventure,river,tripengine,art,nature

plant-window:PREP INsill-window:NNsill-the:DETflowers-window:PREP INglass-window:PREP INwindow-kitchen:NNplant-potted:AMODfriend-a:DETroot-plant:ROOTin-window:POBJwindow-front:AMODcity-new:NNvase-a:DETtree-little:AMODpot-flower:NN

Continued on next page

78

Page 79: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts234 bike,motorcycle,race

motorcycle,motion,asiamotorcycle,road,skyparade,school,oldroadblock,protest,london

motorcycle-a:DETride-bike:DOBJride-to:AUXbike-front:PREP INbicycle-a:DETkid-shirt:PREP INstreet-busy:AMODroot-ride:ROOTpeople-many:AMODrace-a:DETman-an:DETroad-busy:AMODride-bike:NSUBJguy-the:DETtour-bike:NN

235 car,automobile,truckrace,car,autoauto,automobile,racedriver,cars,autoracing,driver,united

plate-license:NNpark-car:NNcar-police:NNparked-car:NSUBJcar-white:AMODlot-parking:NNwindow-rear:AMODhas-car:NSUBJsee-car:DOBJroot-car:ROOTparked-car:NSUBJPASScar-a:DETcar-new:AMODspotted-car:NSUBJcar-parked:VMOD

236 hawk,red,georgiareptile,tortoise,wildlifebird,tree,hawkamerican,animal,eaglehead,macro,wow

sanctuary-bird:NNfeathers-the:DETone-birds:PREP OFsitting-fence:PREP ONbirds-baby:NNcage-bird:NNbird-an:DETsitting-bird:NSUBJbird-sitting:VMODcaught-bird:DOBJbird-large:AMODroot-adult:ROOThawk-a:DETwoodpecker-a:DEThead-a:DET

Continued on next page

79

Page 80: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts237 eye,cat,reflection

bird,tree,hawkhead,cat,zooadult,blue,outdoorbird,sky,blue

birds-the:DETbird-the:DETbird-window:PREP INblack-red:CONJ ANDtook-photos:DOBJroot-eye:ROOTsitting-fence:PREP ONflorida-orlando:NNone-birds:PREP OFroot-study:ROOTroot-poppy:ROOTmask-a:DETsize-large:AMODroot-loves:ROOTroot-parrot:ROOT

238 kitty,orange,catscats,kitten,petsplay,dog,dogsrodent,nature,squirrelfeline,kitten,animals

puppy-the:DETroot-puppy:ROOTroot-dogs:ROOTdogs-two:NUMhouse-dog:NNroot-sleeps:ROOTpuppy-a:DETdog-box:PREP INcats-the:DETdog-street:NNdog-house:PREP INroot-buddy:ROOTbag-sleeping:AMODpillow-the:DETpuppy-cute:AMOD

239 plants,trees,treevegetables,macro,plantsflowers,white,rosecraft,handmade,dresslong,white,hair

root-plants:ROOTplant-pot:PREP INroot-plant:ROOTbox-window:NNplants-tomato:NNplant-tomato:NNplants-potted:AMODpot-a:DETplants-pots:PREP INtree-pot:PREP INpot-plant:NNpot-flower:NNplants-the:DETplant-house:PREP INsill-window:NN

Continued on next page

80

Page 81: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts240 baby,nature,wildlife

colorado,vacation,aircraftpacific,bay,islandgreece,white,artvalley,water,river

cat-black:AMODseed-bird:NNcats-black:AMODpuddle-a:DETlion-mountain:NNhole-a:DETcat-garden:PREP INfarm-tuscumbia:PREP INchickens-the:DETshadow-the:DETtrip-field:NNformation-a:DETroot-stones:ROOTsitting-garden:PREP INroot-shadow:ROOT

241 united,politics,democratindividual,person,peopletraditional,asian,beautyfaces,portrait,womantent,magic,war

boy-hat:PREP INman-hat:PREP INhat-black:AMODgirls-hats:PREP INhat-straw:NNdress-traditional:AMODshirt-hat:CONJ ANDcute-hat:PREP INportrait-man:PREP OFroot-holds:ROOTroot-boy:ROOTgirl-young:AMODhat-cowboy:NNgirl-local:AMODroot-mark:ROOT

242 chairs,interior,officechairs,beach,skyfloor,window,interiorvintage,sky,explorebarn,abandoned,wood

chair-lounge:NNchairs-the:DETtable-chairs:CONJ ANDmove-to:AUXroom-family:NNroot-guest:ROOTroot-chairs:ROOTboat-house:NNroom-house:PREP INsliding-doors:DOBJchair-beach:NNbarn-the:DETroot-balcony:ROOTtables-chairs:CONJ ANDsliding-door:DOBJ

Continued on next page

81

Page 82: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts243 judge,cat,little

country,handmade,craftsscotland,architecture,festivalindividual,person,peoplenatural,trees,tree

me-house:PREP INcute-hat:PREP INme-dress:PREP INparty-house:NNshirt-a:DETbanks-outer:NNpicture-me:PREP OFchair-green:AMODhat-monkey:NNsitting-floor:PREP ONgirl-birthday:NNboy-hat:PREP INboy-birthday:NNme-shirt:PREP INhat-paper:NN

244 tent,magic,warfisheye,portrait,closeuppolice,politics,peacefriend,dog,faceofficers,ceremony,seattle

trailer-the:DETdog-bag:PREP INbasket-bike:NNmachine-green:AMODparade-the:DETgirl-old:AMODdog-basket:PREP INseat-bike:NNroot-coach:ROOTmask-a:DETbasket-a:DETthink-looks:CCOMPgo-home:DOBJroot-carry:ROOTwait-n’t:NEG

245 house,architecture,historichouses,building,historicabandoned,house,ruralmaryland,architecture,buildingsillinois,chicago,architecture

house-oldest:AMODbuilt-house:NSUBJhouse-black:AMODdown-street:POBJbuilding-little:AMODwindow-top:AMODshot-house:PREP OFcute-house:DOBJstanding-still:ADVMODhouse-town:PREP INbuilding-small:AMODhouse-an:DEThouse-street:PREP ACROSShouse-beach:PREP BYlooks-house:NSUBJ

Continued on next page

82

Page 83: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts246 dogs,funny,cute

bathroom,portrait,selfdeer,handmade,cutedog,animals,explorefawn,dog,puppy

table-kitchen:NNchair-pink:AMODroot-nap:ROOTroot-grace:ROOTcute-dress:PREP INrunning-house:PREP AROUNDgirl-little:AMODdress-pink:AMODskirt-the:DETroot-finds:ROOTdress-the:DETgirls-the:DETpink-pretty:ADVMODchair-room:PREP INin-dress:POBJ

247 baby,beautiful,girlsfamily,girls,beautyparty,politics,americasmile,asia,boyfunny,cute,cat

cute-hat:PREP INboy-mirror:PREP INboy-birthday:NNhat-cute:AMODplaying-house:PREP INtrip-field:NNlooked-cute:ACOMPgirls-little:AMODchair-girl:NNgirl-sweet:AMODkids-the:DETgirl-big:AMODboy-hat:PREP INgirl-chair:PREP INboy-big:AMOD

248 apple,mac,blackmac,black,musicphone,maps,cameramaps,phone,designfunny,sign,japan

root-computer:ROOTroot-machine:ROOTcomputer-the:DETscreen-the:DETcomputer-a:DETroot-screen:ROOTmachine-a:DETmachine-old:AMODbook-library:PREP INbox-newspaper:NNkeyboard-the:DETbook-an:DETposted-sign:NSUBJmachine-the:DETbox-little:AMOD

Continued on next page

83

Page 84: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts249 track,formula,race

driver,cars,autoformula,historic,classicjeep,sky,bluemotorcycle,road,sky

car-blue:AMODroot-car:ROOTroot-truck:ROOTparked-car:NSUBJlot-parking:NNroot-trucks:ROOTroot-cars:ROOTcars-two:NUMtruck-white:AMODcar-field:PREP INcar-yellow:AMODtruck-big:AMODcar-black:AMODcar-white:AMODhighway-the:DET

250 bike,motorcycle,racebicycle,motion,girlmotorcycle,motion,asiabicycle,china,colormotorcycle,road,sky

bike-front:PREP INride-bike:NSUBJroot-ride:ROOTbicycle-a:DETbike-road:NNbike-mountain:NNdog-basket:PREP INride-to:AUXrace-bike:NNtour-bike:NNrace-a:DETride-bike:DOBJman-an:DETrace-mountain:NNmotorcycle-a:DET

251 home,interior,designroom,design,homeinterior,furniture,housekitchen,interior,designoffice,apple,mac

shelf-book:NNdesk-bedroom:PREP INoffice-home:NNdesk-the:DETroom-living:NNroot-desk:ROOTdesk-room:PREP INkitchen-the:DETroom-computer:NNliving-room:DOBJshelves-the:DETdoor-looking:VMODlooking-room:PREP INTOroom-new:AMODfireplace-the:DET

Continued on next page

84

Page 85: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts252 car,automobile,truck

silver,car,streetautomobile,ontario,speeddriver,cars,autoautomobile,transportation,vintage

parked-car:NSUBJcar-street:PREP INparked-street:PREP INcar-green:AMODcar-classic:AMODcar-blue:AMODcar-new:AMODcar-rental:AMODparked-street:PREP ONcars-two:NUMroot-car:ROOTspotted-car:NSUBJcar-little:AMODcar-sitting:VMODcar-road:PREP ON

253 room,design,homecottage,vintage,pinkguest,room,catcat,kitten,kittytortoise,cat,dog

table-room:NNtable-side:NNtable-house:PREP INroom-front:AMODtable-room:PREP INcat-kitchen:PREP INfloor-room:PREP INchair-room:PREP INbedroom-house:PREP OFchair-orange:AMODfloor-kitchen:PREP INroom-great:AMODmiddle-floor:PREP OFsitting-room:PREP INroot-downstairs:ROOT

254 bike,motorcycle,racemotorcycle,road,skyrace,bike,politicsroad,city,peopledesert,portrait,california

race-bike:NNrace-mountain:NNbike-mountain:NNrace-the:DETrace-cup:NNroot-race:ROOTmotorcycle-a:DETrace-a:DETroot-ride:ROOTride-bike:NSUBJtour-bike:NNman-an:DETbike-road:NNbike-front:PREP INshow-tv:NN

Continued on next page

85

Page 86: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts255 sheep,dog,white

dog,beach,waterriver,raft,summerwave,surf,actionhouseboat,india,nature

horse-white:AMODwashing-river:PREP INswimming-river:PREP INbath-river:PREP INstanding-river:PREP INriver-a:DETtrying-catch:XCOMProot-swans:ROOTfish-river:PREP INriver-running:VMODwashing-clothes:DOBJmiddle-river:PREP OFriding-horse:DOBJriver-house:PREP NEARman-dog:CONJ AND

256 self,red,bathroomhospital,people,californiacats,kitten,petsroom,people,adultsstate,party,president

bed-bedroom:PREP INbed-room:PREP INbed-size:NNbed-queen:NNbed-boy:NNroot-guest:ROOTfloor-room:PREP INnight-bed:PREP INbed-house:PREP INbedroom-spare:AMODbox-big:AMODsit-chair:PREP INtable-train:NNbedroom-main:AMODroot-downstairs:ROOT

257 sports,male,mengirls,asian,basketballcheerleader,university,collegeuniversity,sports,sportfootball,fan,berlin

girl-sexy:AMODtrail-river:NNseat-bike:NNtri-swim:PREP WITHtrail-nlr:NNbike-trail:PREP ONlake-ski:AMODtri-sprint:NNswim-run:CONJ ANDswim-lake:PREP INrace-a:DETswim-the:DETswim-bike:CONJ ANDgirl-boy:CONJ ANDroot-show:ROOT

Continued on next page

86

Page 87: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts258 adult,bird,birds

bird,flight,waterbird,tree,hawkfemale,animal,petlakes,birds,animals

swan-black:AMODduck-white:AMODroot-blackbird:ROOTpigeon-a:DETduck-the:DETpond-a:DETduck-black:AMODbird-male:AMODbird-water:NNduck-water:PREP INbird-black:AMODduck-male:AMODduck-wood:NNroot-goose:ROOTduck-little:AMOD

259 shops,fun,floridachairs,interior,officebuilding,window,abandonedmall,shop,ontariolighting,architecture,interior

lounge-the:DETlamps-the:DETroot-bar:ROOTperson-the:DETbox-glass:NNtables-chairs:CONJ ANDstation-main:AMODbar-a:DETdisplay-window:NSUBJmachine-flying:AMODbar-an:DETshopping-window:NNshop-gift:NNwindow-office:PREP OFpainting-wall:PREP ON

260 racing,classic,carsrace,car,autokuwait,car,carscar,automobile,truckspeed,racing,car

car-one:NUMone-cars:PREP OFparked-street:PREP ONcar-blue:AMODroot-show:ROOTtruck-blue:AMODtruck-big:AMODcars-two:NUMspotted-car:NSUBJshow-car:NSUBJcar-classic:AMODcar-police:NNshow-car:NNroot-car:ROOTtrucks-the:DET

Continued on next page

87

Page 88: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts261 grass,cow,field

animals,africa,deersheep,animal,hornsrun,grass,petwild,deer,africa

root-sheep:ROOTsheep-field:PREP INcow-the:DETsheep-the:DETgrazing-field:PREP INroot-cow:ROOThorse-field:PREP INhorses-field:PREP INcow-field:PREP INdog-field:PREP INroot-horses:ROOTcows-field:PREP INcow-a:DETbuffalo-water:NNgrass-lush:AMOD

262 hill,italy,italiagolf,spain,flagsheep,landscape,skycountryside,clouds,greenfield,clouds,blue

field-cow:NNfield-green:AMODmiddle-field:PREP OFhill-a:DEThill-tree:NNstanding-field:PREP INfield-open:AMODfield-grass:NNfield-big:AMODhouse-field:PREP INfield-an:DETfield-soccer:NNhill-green:AMODfield-corn:NNpasture-cow:NN

263 toy,figures,greenkids,art,babyglasses,book,whitespace,white,artcoffee,red,mug

root-bowls:ROOTpots-the:DETcontainer-the:DETbowl-dog:NNbowl-the:DETsurrounded-flowers:AGENTmug-the:DETpot-big:AMODbucket-the:DETroot-pots:ROOTpot-clay:NNbottle-old:AMODin-box:POBJsale-market:PREP INroot-oil:ROOT

Continued on next page

88

Page 89: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts264 sailboat,ship,blue

sail,race,sailboatboat,sail,sailingsailing,california,skysails,sailboat,sail

boat-sail:AMODsail-the:DETsail-boat:DOBJroot-sail:ROOTroot-ship:ROOTbridge-golden:AMODboat-water:PREP INlake-clear:NNroot-safe:ROOTroot-sailboat:ROOTsailboat-a:DETbridge-fog:PREP INboats-sail:AMODharbor-the:DETraces-sail:AMOD

265 design,interior,furnitureinterior,furniture,housefurniture,architecture,interiorkitchen,interior,designcottage,vintage,pink

root-room:ROOTlooking-room:PREP INTOliving-room:DOBJroom-main:AMODbedroom-house:PREP OFleads-door:NSUBJroom-the:DETtable-window:PREP BYroom-house:PREP INroom-great:AMODarea-bar:NNspace-the:DETlab-the:DETkitchen-house:NNkitchen-house:PREP IN

266 train,tracks,lightlocomotive,bridge,tracktracks,locomotive,stationrail,engine,steamrailroad,clouds,bridge

train-the:DETroot-train:ROOTtrain-a:DETtrain-car:NNtrain-an:DETtracks-railroad:NNcar-street:NNplatform-the:DETrailway-the:DETtrain-line:NNyard-train:NNtracks-train:NSUBJgoes-train:NSUBJroot-waits:ROOTpasses-train:NSUBJ

Continued on next page

89

Page 90: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts267 horse,red,white

running,sport,athletesports,football,gameplaying,beach,waterracing,horse,sport

swim-the:DETbike-trail:PREP ONswim-bike:CONJ ANDtri-sprint:NNtri-swim:PREP WITHtrail-nlr:NNteam-the:DETswim-lake:PREP INswim-run:CONJ ANDlake-ski:AMODtrail-river:NNhorses-the:DETroot-friends:ROOTgame-a:DEThorse-a:DET

268 dogs,funny,cutehospital,people,californiapet,dog,puppyarmy,guns,weaponspicture,portrait,people

root-night:ROOTbanks-outer:NNchair-blue:AMODbag-sleeping:AMODbed-boy:NNgirl-chair:PREP INchair-girl:NNbed-girl:NNroot-charlie:ROOTplay-to:AUXboy-big:AMODseat-house:PREP INboy-bed:PREP INroot-kids:ROOTnight-bed:PREP IN

269 race,car,autospeed,racing,cardriver,cars,autovehicle,cars,speedpolice,car,cars

car-green:AMODcar-blue:AMODcar-little:AMODspotted-car:NSUBJcar-police:NNcar-the:DETparked-car:NSUBJplate-license:NNcar-white:AMODcars-many:AMODparked-car:NSUBJPASStruck-the:DETcar-rental:AMODcar-yellow:AMODcars-two:NUM

Continued on next page

90

Page 91: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts270 mac,black,music

design,interior,furnitureapple,mac,blackretro,modern,furniturebathroom,abandoned,interior

cabinet-medicine:NNroot-cabinet:ROOTtile-the:DETroot-counter:ROOToven-microwave:NNcabinet-the:DETroot-corner:ROOTsink-kitchen:PREP INroot-kitchen:ROOTplatform-the:DETboard-the:DETtelevision-a:DETcabinet-a:DETtable-side:NNcabinet-kitchen:PREP IN

271 houseboat,india,natureboat,river,boatsvancouver,night,reflectionship,sunset,cloudsships,port,boat

house-boat:NNboats-house:NNboats-small:AMODlake-park:PREP INhouse-lake:PREP BYmiddle-river:PREP OFhouse-lake:PREP ONlooking-river:DOBJhouse-lake:PREP INboat-cruise:NNone-boats:PREP OFon-river:POBJeye-london:NNboats-the:DETroot-harbor:ROOT

272 book,dog,funnyweapons,art,signchair,room,officelamp,wall,windowhome,interior,design

table-side:NNtable-room:PREP INbottle-empty:AMODroot-bottles:ROOTcontainer-the:DETroom-sitting:AMODstay-to:AUXshelf-book:NNbottle-an:DETdesk-bedroom:PREP INscreen-the:DETbottle-wine:NNdesk-room:PREP INbook-new:AMODbar-little:AMOD

Continued on next page

91

Page 92: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts273 airplane,pilot,fighter

football,fan,berlinwings,bird,skyholland,dance,lightaction,sports,game

girl-yellow:PREP INroot-race:ROOTblack-yellow:CONJ ANDshirt-yellow:AMODball-the:DETplaying-guitar:DOBJfather-son:CONJ ANDroot-play:ROOTseat-bike:NNroot-woman:ROOTbaskets-ewe:NNteam-the:DETyellow-blue:CONJ ANDparade-the:DEThaving-ball:DOBJ

274 formula,historic,classiccar,racing,racerace,car,autorace,car,formularacing,cars,classic

car-red:AMODtruck-red:AMODroot-cars:ROOTcar-yellow:AMODcars-two:NUMspotted-car:NSUBJshow-car:NNshow-a:DETsee-car:DOBJhas-car:NSUBJcar-rental:AMODcar-toy:NNcar-green:AMODlot-parking:NNcar-police:NN

275 horses,portrait,animalbrown,animal,bearmanhattan,people,manbest,photo,lovepeace,love,portrait

root-horses:ROOTroot-horse:ROOThorse-the:DETroot-cow:ROOTcow-a:DEThorses-wild:AMODhorse-a:DETpony-a:DETcow-field:PREP INhorse-field:PREP INhorses-two:NUMhorse-black:AMODpasture-a:DEThorses-the:DETroot-ginger:ROOT

Continued on next page

92

Page 93: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts276 hangar,aviation,aircraft

museum,history,wardeath,people,iraqfurniture,chairs,retrochair,furniture,blue

table-chairs:CONJ ANDtable-house:PREP INbench-a:DETtable-pool:NNroot-vintage:ROOTtable-bar:PREP INchairs-two:NUMtable-side:NNroot-frame:ROOTroot-custom:ROOTship-bottle:PREP INone-cars:PREP OFarea-office:NNchair-house:PREP INseats-the:DET

277 boat,lake,bluerunway,flight,aviationhelicopters,canada,torontounited,airplane,airportair,airport,aircraft

root-boats:ROOTbow-the:DETone-boats:PREP OFmachine-flying:AMODputting-water:PREP INsail-to:AUXmay-collection:NNcatch-fish:DOBJboats-small:AMODflying-order:DOBJboats-many:AMODfisherman-a:DETboat-white:AMODboats-the:DETboat-bay:PREP IN

278 bike,motorcycle,racemotorcycle,motion,asiamotorcycle,road,skysquare,portrait,chinapolice,protesters,protest

ride-bike:DOBJbike-front:PREP INred-black:CONJ ANDgirl-boy:CONJ ANDmotorcycle-a:DETbicycle-a:DETman-an:DETrace-a:DETsuit-a:DETshoes-white:AMODcross-street:DOBJwoman-walking:VMODman-walking:VMODgirl-pretty:AMODpants-red:AMOD

Continued on next page

93

Page 94: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts279 protest,france,protesters

friend,girl,happyreligion,people,portraitbush,photojournalism,protestscotland,architecture,festival

in-shirt:POBJme-front:PREP INhouses-green:AMODgirl-jacket:PREP INin-front:POBJroot-rob:ROOTroot-mark:ROOTroot-ben:ROOTroot-standing:ROOTboy-white:AMODhat-black:AMODdress-green:AMODroot-family:ROOThats-the:DETme-house:PREP IN

280 locomotive,bridge,trackengine,rail,locomotiverailroad,locomotive,steamtrain,engine,steamtrack,locomotive,engine

root-train:ROOTtrain-a:DETrailway-the:DETtrain-an:DETtrain-freight:NNline-train:NNtrain-old:AMODtrain-steam:NNcar-abandoned:AMODtrain-the:DETyard-train:NNtrain-car:NNbus-school:NNstation-railway:NNcar-one:NUM

281 airport,airplanes,wingjet,airplanes,wingwings,airplane,airplanesairplane,wings,wingtransportation,fly,engine

plane-the:DETmuseum-airplane:NNmay-heritage:NNflying-order:DOBJmay-collection:NNmuseum-vintage:AMODmachine-flying:AMODairport-the:DETputting-water:PREP INpark-car:DOBJships-the:DETrain-the:DETbridge-pedestrian:AMODroot-lot:ROOTroot-sail:ROOT

Continued on next page

94

Page 95: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts282 horse,red,white

horses,portrait,animalhorse,foals,animalsrace,bike,politicshorse,argentina,field

horse-the:DEThorse-a:DETriding-horse:DOBJhorses-the:DETroot-horse:ROOTride-a:DETgame-a:DETpony-a:DETbest-seat:DEPman-sitting:DEPstanding-around:PRTmai-chiang:NNhorse-black:AMODsecurity-the:DETman-old:AMOD

283 truck,sky,cloudsroadblock,truck,belgiumroad,city,peoplemotorcycle,road,skytollbooth,illinois,chicago

root-roads:ROOTroad-the:DETroads-mountain:NNmountain-background:PREP INpass-the:DETroad-mountains:PREP INroads-the:DETwalking-road:DOBJon-road:POBJhill-steep:AMODtour-bike:NNride-bike:NSUBJmountains-background:PREP INroot-highway:ROOTwalking-hill:DOBJ

284 food,cheese,restaurantwedding,cake,flowersrestaurant,food,japanesevegetables,japanese,japanjapanese,food,rice

sauce-a:DETroot-lunch:ROOTroot-dinner:ROOTbeans-green:AMODleaf-banana:NNrice-brown:AMODroot-rice:ROOTchicken-sauce:PREP INsauce-wine:NNjuice-orange:AMODsauce-white:AMODroot-chocolate:ROOTbowl-big:AMODroot-breakfast:ROOTonions-green:AMOD

Continued on next page

95

Page 96: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts285 chairs,interior,office

chair,room,officewall,graffiti,artparis,panorama,polarlife,city,street

root-chairs:ROOTmodel-the:DETchair-black:AMODtable-window:PREP BYtables-chairs:CONJ ANDchairs-the:DETroot-balcony:ROOTroom-house:PREP INfloor-fourth:AMODroot-lounge:ROOTside-either:DETtables-the:DETroom-green:AMODroot-room:ROOTread-book:DOBJ

286 interior,furniture,housemodern,interior,furniturechair,room,officechairs,interior,officedesign,interior,furniture

living-room:DOBJroot-room:ROOTroom-living:AMODroom-kitchen:CONJ ANDdining-room:DOBJroom-living:NNlounge-the:DETroot-lounge:ROOTfireplace-the:DETroom-looking:VMODtv-screen:NNroom-floor:NNbedroom-house:PREP OFhas-bedroom:NSUBJroom-house:PREP IN

287 air,fly,aircraftairforce,sky,airplanefighter,jet,planehelicopter,sunset,skypilot,landing,airplane

flying-house:PREP OVERplane-flying:VMODplane-sky:PREP INflying-house:DOBJplane-flying:DEProot-flies:ROOTroot-airplane:ROOTbird-sky:PREP INplane-small:AMODroot-plane:ROOTkite-a:DETairplane-an:DETroot-kite:ROOTairplane-flying:DEPbird-flight:PREP IN

Continued on next page

96

Page 97: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts288 park,animal,wildlife

mother,animal,catantlers,wild,elkcaribou,animals,alaskawild,deer,africa

eating-grass:DOBJroot-lion:ROOTroot-elk:ROOTrun-birds:NNanimals-run:CONJ ANDanimals-park:NNlion-tree:PREP INroad-park:PREP INgoat-a:DETroot-horse:ROOTanimals-bayou:AMODanimals-habitat:PREP INhorse-field:PREP INanimals-freely:CONJ ORhorse-a:DET

289 cats,kitten,petscat,kitten,kittykitty,white,catspair,animal,catadorable,rabbit,bunny

cat-cute:AMODcats-the:DETcat-white:AMODcat-house:NNroot-cats:ROOTin-room:POBJcat-fat:AMODhangs-out:PRTloves-sitting:XCOMPdogs-the:DETloves-sit:XCOMPkitty-window:PREP INfireplace-the:DETcat-lives:RCMODdogs-cats:CONJ AND

290 interior,furniture,housechairs,interior,officemodern,interior,furniturensw,coast,signsroom,window,abandoned

room-house:PREP INliving-room:DOBJroot-lounge:ROOTarea-bar:NNroom-sitting:AMODroom-family:NNsliding-doors:DOBJbedroom-house:PREP OFroot-room:ROOTbed-house:PREP INroot-guest:ROOTdining-room:DOBJroom-living:AMODarea-office:NNtables-the:DET

Continued on next page

97

Page 98: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts291 nose,dog,cow

pets,cat,catsbeards,male,manplay,dog,dogsrun,grass,pet

watching-birds:DOBJtime-every:DETlooking-window:DOBJsill-window:NNmonkey-a:DETwindow-the:DETposition-a:DETtake-picture:DOBJcats-black:AMODcub-bear:NNcute-very:ADVMODflorida-orlando:NNnap-a:DETmonkeys-the:DETsitting-window:PREP BY

292 president,photo,arttrip,summer,peoplegun,rifles,soldierslocomotive,bridge,trackuniform,world,historic

bed-truck:PREP OFtruck-the:DETyard-train:NNaccident-car:NNsidewalk-house:PREP IN FRONT OFroot-works:ROOTcars-trucks:CONJ ANDsystem-a:DETaccident-a:DETfire-a:DETroot-truck:ROOTdeck-the:DETshow-flower:NNphotos-taken:VMODplant-flowers:DOBJ

293 guns,history,vintageeyes,white,nosemuseum,history,warwow,light,peopleweapons,soldiers,soldier

car-white:AMODhouse-car:CONJ ANDmiddle-street:PREP OFscheme-white:AMODparked-street:PREP ONroot-coach:ROOTroot-van:ROOTcar-street:PREP INput-water:PREP INcar-house:PREP OFcourthouse-county:NNcar-front:PREP INtuna-market:PREP ATcar-parked:VMODpeople-standing:VMOD

Continued on next page

98

Page 99: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts294 chair,room,office

chairs,interior,officetelephones,office,roommelbourne,street,alleymodern,interior,furniture

desk-a:DETkitchen-house:PREP INtable-chairs:CONJ ANDtables-chairs:CONJ ANDshopping-window:NNroot-chairs:ROOTmove-to:AUXchairs-the:DETchair-desk:NNoffice-home:NNmachine-sewing:AMODlab-computer:NNstove-kitchen:PREP INroom-the:DETroot-desk:ROOT

295 apple,office,macoffice,apple,macmac,office,photographystudio,microphones,officecoffee,man,apple

root-desk:ROOTdesk-office:PREP INdesk-the:DETcomputer-the:DETdesk-computer:NNdesk-bedroom:PREP INdesk-room:PREP INoffice-home:NNlaptop-the:DETdesk-office:NNdesk-new:AMODdesk-a:DEToffice-the:DETmonitor-the:DETkeyboard-the:DET

296 auto,truck,canadapolice,car,carsbus,people,englandparade,school,oldsubway,people,graffiti

truck-front:PREP INhouse-car:CONJ ANDstreet-city:PREP INcar-street:PREP INparked-car:NSUBJcar-parked:VMODvan-white:AMODsee-car:DOBJcars-the:DETcar-one:NUMbus-city:NNtraffic-the:DETtruck-white:AMODcar-front:PREP INfront-car:PREP OF

Continued on next page

99

Page 100: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts297 car,automobile,truck

parade,school,oldautomobile,ontario,speedmall,car,autoengine,truck,auto

car-pink:AMODcar-red:AMODcar-street:PREP INone-cars:PREP OFcar-little:AMODred-black:CONJ ANDcar-street:PREP ONspotted-car:NSUBJcar-cute:AMODcar-vintage:AMODshow-the:DEThood-the:DETyear-new:AMODroot-car:ROOTcar-background:PREP IN

298 pottery,handmade,texturevegetables,macro,plantsfrench,bravo,womanleaf,autumn,bravofruit,blue,nature

root-pot:ROOTpot-plant:NNroot-pots:ROOTplant-pot:PREP INpot-flower:NNtable-side:NNpot-the:DETpot-big:AMODpots-plant:NNglass-shot:NNcup-paper:NNcat-pot:PREP INroot-cup:ROOTpot-a:DETplant-a:DET

299 demonstration,bush,peacephotojournalism,politics,iraqbush,photojournalism,protestmarch,protest,politicsdocumentary,monks,thailand

film-white:AMODroot-band:ROOTroot-men:ROOTblack-white:AMODhouse-street:NNblack-in:ADVMODband-rock:NNguitar-the:DETphoto-black:AMODblack-white:DEPin-black:POBJpeople-sitting:VMODfilm-black:AMODcrowd-the:DEThill-beacon:NN

Continued on next page

100

Page 101: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts300 office,apple,mac

home,interior,designmac,office,photographyapple,office,macroom,design,home

root-desk:ROOToffice-home:NNdesk-room:PREP INcomputer-the:DETdesk-bedroom:PREP INdesk-computer:NNshelf-book:NNroom-computer:NNdesk-office:PREP INstyle-door:NNdesk-the:DETroot-computer:ROOTdesk-new:AMODarea-bar:NNwall-one:NUM

301 austin,motorcycle,policetexas,war,fieldjune,world,franceparade,school,oldtruck,tanker,massachusetts

root-truck:ROOTroot-guy:ROOTtruck-red:AMODtruck-the:DETtruck-old:AMODbed-truck:PREP OFguy-the:DETpeople-sitting:VMODtruck-a:DETpants-the:DETtruck-pickup:NNtruck-blue:AMODroot-team:ROOTroot-scene:ROOTcars-the:DET

302 nose,dog,cowdog,white,explorefunny,cute,naturepuppy,baby,animalsdogs,white,cute

root-buddy:ROOTroot-doggy:ROOTroot-puppy:ROOTroot-daisy:ROOTpuppy-the:DETpuppy-cute:AMODroot-dogs:ROOTretriever-golden:AMODbeach-beach:PREP INaugust-2006:NUMpuppy-a:DETcute-dog:DOBJdog-box:PREP INdog-car:PREP INroot-damage:ROOT

Continued on next page

101

Page 102: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts303 underground,people,street

bus,abandoned,cloudssubway,people,graffitishopping,night,streeturban,abandoned,night

street-town:PREP INstreet-city:PREP INcar-street:NNbuses-the:DETtrain-line:NNstreet-little:AMODstreet-typical:AMODtruck-front:PREP INhouses-colorful:AMODstreet-side:NNcoach-a:DETstreet-narrow:AMODtrain-little:AMODtruck-water:NNstation-bus:NN

304 sheep,alaska,mountaingoat,mountain,wildlifesheep,animal,hornscaribou,animals,alaskawild,deer,africa

horse-white:AMODgoat-mountain:NNroot-goat:ROOTroot-sheep:ROOTgoat-a:DETsheep-a:DETdog-white:AMODsheep-field:PREP INcow-field:PREP INegret-great:AMODfield-farm:NNspotted-field:PREP INfarm-a:DETbirds-white:AMODbird-white:AMOD

305 car,automobile,truckvehicle,cars,speedautomobile,ontario,speedcamera,lens,cityauto,automobile,race

one-cars:PREP OFparked-street:PREP ONcar-classic:AMODcar-street:PREP INparked-car:NSUBJparked-street:PREP INplate-the:DETwindow-rear:AMODcar-street:PREP ONcars-two:NUMhood-the:DETplate-license:NNcars-old:AMODcar-green:AMODshow-car:NSUBJ

Continued on next page

102

Page 103: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts306 dog,white,explore

toy,craft,cuterabbit,sweet,petsplaying,animal,bearpair,animal,cat

family-foster:AMODtaken-family:AGENTdog-service:NNretriever-golden:AMODelephant-a:DETone-animals:PREP OFroot-dogs:ROOTbear-polar:AMODcute-dog:DOBJdog-house:PREP INold-months:NPADVMODanimal-towel:NNroot-puppy:ROOTroot-elephant:ROOTpuppy-the:DET

307 phone,woman,smileriot,protesters,photojournalismdead,human,lifegun,guard,policewest,america,party

dog-bag:PREP INgirl-hot:AMODroot-show:ROOThorse-wooden:AMODgirl-sexy:AMODdressed-black:PREP INgirl-black:AMODmask-a:DETband-the:DETarm-the:DETguitar-the:DETposition-the:DETroot-puppies:ROOTstanding-around:PRTmirrors-the:DET

308 shopping,bazaar,japanshop,market,foodstore,food,colorfood,great,frenchsewing,room,studio

stall-market:NNtaken-market:PREP ATmarket-outdoor:AMODdisplay-window:PREP INmarket-pike:NNin-market:POBJstore-the:DETfish-market:PREP INdisplay-the:DETroot-fresh:ROOTsale-market:PREP ATdisplay-a:DETmarket-japan:PREP INtaken-market:PREP INmarket-food:NN

Continued on next page

103

Page 104: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts309 design,interior,furniture

room,design,homehome,interior,designcarpet,room,chairstudio,microphones,office

bedroom-house:PREP INroot-bedroom:ROOTbed-bedroom:PREP INcolor-wall:NNbedroom-house:PREP OFliving-room:DOBJroot-downstairs:ROOTroom-living:AMODbedroom-a:DETbedroom-master:NNroot-room:ROOTbedroom-main:AMODdesk-room:PREP INbedroom-the:DETroot-guest:ROOT

310 water,ocean,beachfly,bird,skybirds,wings,whitebooby,kauai,hawaiimovement,water,action

bird-little:AMODbirds-little:AMODduck-a:DETlooking-food:PREP FORroot-birds:ROOTbird-water:PREP INbird-a:DETroot-duck:ROOTbirds-the:DETcaught-bird:DOBJroot-ducks:ROOTroot-bird:ROOTbirds-black:AMODducks-the:DETmale-adult:AMOD

311 youth,fun,photographysand,waves,bluewow,airplane,flyingsunny,sea,sandphotography,wildlife,animal

beach-black:AMODbeach-sand:NNroot-bench:ROOTsand-black:AMODbeach-front:PREP INstanding-tree:PREP UNDERroad-house:PREP OFblack-beach:DEPbeach-hawaii:PREP INroad-front:PREP INpath-a:DETbirds-white:AMODbeach-park:PREP INroot-beach:ROOTroot-black:ROOT

Continued on next page

104

Page 105: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts312 dogs,funny,cute

puppy,baby,animalsbig,animal,wildlifepet,dog,puppyfamily,people,old

bath-river:PREP INboy-dog:CONJ ANDdog-brown:AMODbuffalo-water:NNpit-the:DETplaying-river:PREP INroot-dogs:ROOTplaying-sand:PREP INgo-water:PREP INroot-play:ROOTdogs-the:DETwashing-clothes:DOBJball-tennis:NNplay-water:PREP INplay-to:AUX

313 locomotive,bridge,tracktrain,sky,cityrailway,bridge,steamrailroad,locomotive,steamtracks,locomotive,station

train-an:DETtrain-freight:NNtrain-passenger:NNtrain-a:DETtrain-the:DETyard-train:NNroot-train:ROOTtracks-train:NSUBJpasses-train:NSUBJcars-train:NNpoles-telephone:NNtrain-car:NNcrosses-train:NSUBJtrains-the:DETtrain-road:NN

314 interior,furniture,househome,interior,designdesign,interior,furnitureroom,design,homekitchen,interior,design

root-room:ROOTroom-the:DETroom-living:AMODliving-room:DOBJroom-house:PREP INroom-family:NNroom-new:AMODlooking-room:PREP INTOdining-room:DOBJroom-great:AMODroom-house:PREP OFleads-door:NSUBJtable-kitchen:PREP INroom-guest:NNbedroom-house:PREP OF

Continued on next page

105

Page 106: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts315 cats,kitten,pets

dogs,funny,cutekitty,orange,catspets,cat,catsdoorway,girl,woman

tree-cat:NNroot-buddy:ROOTdog-house:PREP INpuppy-the:DETchair-computer:NNrunning-house:PREP AROUNDshelter-animal:NNdogs-the:DETpuppy-cute:AMODhouse-cat:NNposition-a:DETpuppy-a:DETcats-the:DETroot-dogs:ROOThome-new:AMOD

316 football,white,cheerleadersports,football,gamesport,athlete,runningstadium,game,peoplecheering,girls,basketball

play-boys:NSUBJball-the:DETgame-a:DETplaying-ball:DOBJroot-play:ROOTball-beach:NNplate-home:NNball-basket:NNball-a:DETroot-game:ROOTshirt-black:AMODevent-the:DETpants-red:AMODgame-the:DETfield-ball:NN

317 truck,tanker,massachusettsbus,abandoned,cloudsvehicle,abandoned,rustphilippines,church,landscapeauto,truck,canada

buses-the:DETbus-tour:NNtruck-a:DETroot-trucks:ROOTtrailer-a:DETwindow-bus:PREP OFtruck-fire:NNtrain-little:AMODroot-truck:ROOTroot-van:ROOTlondon-east:NNbuilding-style:NNhouse-front:PREP INred-white:CONJ ANDhas-car:NSUBJ

Continued on next page

106

Page 107: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts318 aircraft,flight,aviation

jet,sky,flightairplane,flight,skybest,aircraft,planeairforce,flight,airplane

machine-flying:AMODairplane-a:DETblue-red:CONJ ANDroot-plane:ROOTred-white:AMODview-side:NNbackground-white:AMODred-white:CONJ ANDfox-the:DETroot-sock:ROOTglass-white:AMODbackground-a:DETflying-house:PREP OVERpaper-a:DETdisplay-window:NN

319 uniform,world,historiccow,rural,skynorth,green,englandhorses,explore,animalparade,school,old

cow-a:DETroot-horse:ROOTsecurity-the:DEThorse-black:AMODriding-horse:DOBJcrossing-road:DOBJmarket-animal:NNpony-a:DEThorses-the:DETcostume-a:DETclass-the:DETvisit-to:AUXjacket-black:AMODteam-the:DETstanding-me:NSUBJ

320 wolf,red,foxfactory,new,yorkcourt,sport,tennisdoorway,girl,womanactor,white,males

bar-a:DETfireplace-the:DETroom-green:AMODme-house:PREP INbasement-the:DETstanding-in:PRTbar-an:DETstanding-front:PREP INstanding-door:PREP INscreen-green:AMODkitchen-house:PREP OFoffice-box:NNfloor-dance:NNvideo-the:DETkitchen-house:PREP AT

Continued on next page

107

Page 108: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts321 bicycle,track,art

bike,track,vintagemuseum,history,warframe,art,vintagebicycle,motion,girl

bike-front:PREP INbicycle-a:DETbike-mountain:NNbike-road:NNdreams-places:PREP OFleaning-wall:PREP AGAINSTplaces-unconventionnal:AMODbike-dreams:DEPbike-field:PREP INworks-the:DETwheel-a:DETbars-the:DETmotorcycle-a:DETroot-decoration:ROOTdoor-white:AMOD

322 roadblock,water,treeshooting,rifles,warrefugees,girl,boyboys,people,menroadblock,protest,london

walking-hill:DOBJwalking-dogs:DOBJboy-dog:CONJ ANDgoat-the:DETplant-to:AUXplant-tree:DOBJride-bike:NSUBJhike-the:DETdogs-the:DETwalking-road:DOBJup-mountain:POBJhill-big:AMODman-walking:DEProot-play:ROOThill-small:AMOD

323 bike,motorcycle,racemotorcycle,motion,asiamotorcycle,road,skybicycle,motion,girlofficers,motorcycle,people

motorcycle-a:DETroot-ride:ROOTbike-front:PREP INbike-road:NNride-bike:DOBJtour-bike:NNbicycle-a:DETman-old:AMODride-bike:NSUBJride-bike:NNcap-the:DETdog-basket:PREP INtrip-bike:NNmachine-green:AMODguy-a:DET

Continued on next page

108

Page 109: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts324 buddhist,monks,burma

buddhism,monks,peoplehome,portrait,blueburma,photojournalism,facesthailand,monks,burma

shirt-pink:AMODgirl-bar:PREP INgirls-pink:PREP INme-house:PREP INglass-wine:PREP OFme-dress:PREP INgirls-cute:AMODgirl-cute:AMODgirl-wedding:PREP INgirl-birthday:NNbar-top:AMODenjoying-glass:DOBJgirls-flower:NNshirt-an:DETgirls-red:PREP IN

325 air,fly,aircraftflag,white,stripesairforce,sky,airplanefly,bird,skyfighter,jet,plane

flying-house:PREP OVERbird-flight:PREP INkite-a:DETbird-flying:VMODroot-angels:ROOTplane-sky:PREP INroot-flies:ROOTplane-flying:DEProot-kite:ROOTflying-beach:PREP OVERplane-a:DETroot-flag:ROOTblue-clear:AMODsky-blue:AMODflag-a:DET

326 pet,dog,rabbitfeline,kitten,animalscat,kitten,kittycats,kitten,petspets,cat,cats

cat-window:PREP INroot-watches:ROOTwatching-birds:DOBJwindow-open:AMODsitting-window:PREP INroot-lucky:ROOTbottle-water:NNkitty-window:PREP INbirds-the:DETcamera-new:AMODcute-being:COPcat-white:AMODcat-lives:RCMODone-cats:PREP OFdog-window:PREP IN

Continued on next page

109

Page 110: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts327 party,politics,water

groom,sunset,womanoutside,girl,funaustralia,melbourne,citybrighton,beards,graffiti

one-shirt:PREP INgirls-the:DETgirls-flower:NNroot-girls:ROOTshirt-white:AMODroot-ladies:ROOTroot-family:ROOTpants-the:DETfloor-dance:NNfamily-the:DETfence-white:AMODgirl-flower:NNceremony-the:DETwoman-shirt:PREP INclass-the:DET

328 waterways,marsh,landscapebridges,trees,naturehouseboat,india,naturecanal,nature,treesrailway,bridge,steam

house-river:PREP BYmill-the:DETroot-flood:ROOTtrain-a:DETroot-train:ROOTroot-land:ROOTlaunch-the:DEThouse-boat:NNlot-water:PREP OFroot-houses:ROOTbridge-covered:AMODriver-the:DETmill-paper:NNhouse-lake:PREP BYroad-rural:AMOD

329 home,interior,designstudio,microphones,officeparty,politics,waterwork,office,applepenguin,toy,white

sign-table:PREP INgirls-kitchen:PREP INgirl-birthday:NNgirls-the:DETkitchen-house:PREP ATreception-the:DETroot-party:ROOTclassroom-the:DETvase-the:DETtable-computer:NNkitchen-house:NNtable-window:PREP BYgirls-house:PREP INkitchen-the:DETbags-the:DET

Continued on next page

110

Page 111: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts330 locomotive,bridge,track

track,locomotive,enginerailroad,locomotive,steamtrain,engine,steamrail,engine,steam

train-a:DETtrain-car:NNcrosses-train:NSUBJcar-abandoned:AMODroot-waits:ROOTcar-street:NNtrain-old:AMODroot-passes:ROOTtrain-line:NNplatform-the:DETtrain-an:DETwaterfront-the:DETyard-train:NNcrosses-bridge:DOBJcar-railroad:NN

331 warehouse,old,skyglass,sky,cityskyscraper,blue,windowsconstruction,architecture,chicagobank,skyscraper,architecture

office-building:VMODbuilding-construction:PREP UNDERlooks-building:NSUBJrapids-grand:NNoffice-building:DEPbuildings-new:AMODbuilding-station:PREP NEARbuilding-cool:AMODbuilding-district:PREP INbuilding-london:PREP INtower-office:NNbuilding-one:NUMbuilding-large:AMODroot-bank:ROOTbuilding-modern:AMOD

332 driver,portrait,peoplekid,brasil,hoperefugees,portrait,africasmile,asia,boyrally,election,democrat

hospital-the:DETroot-holds:ROOTman-shirt:PREP INboy-chair:PREP INsleeping-seat:PREP INgirl-a:DETgirl-local:AMODboy-young:AMODbaby-a:DETboy-sitting:DEPseat-car:NNasleep-seat:PREP INbaby-the:DETgirl-market:PREP INsmile-a:DET

Continued on next page

111

Page 112: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts333 locomotive,bridge,track

railway,bridge,steamvehicle,abandoned,rusttrack,locomotive,engineengine,rail,locomotive

root-truck:ROOTcar-an:DETcar-old:AMODcar-abandoned:AMODroot-trucks:ROOTcars-the:DETpasses-train:NSUBJroot-cars:ROOTcrosses-train:NSUBJtrain-freight:NNcars-many:AMODroot-passes:ROOTroot-train:ROOTcars-old:AMODtruck-a:DET

334 bike,motorcycle,racemotorcycle,motion,asiaholiday,christmas,funpolice,car,carsmotorcycle,road,sky

bike-road:NNride-bike:NSUBJbike-mountain:NNbicycle-a:DETdog-basket:PREP INbike-front:PREP INon-road:POBJbottles-water:PREP OFbasket-bike:NNlane-bike:NNride-bike:NNmachine-green:AMODmotorcycle-a:DETtimes-a:DETrace-a:DET

335 officers,cars,cardesert,portrait,californiacolour,people,artroad,forest,europetrip,summer,people

stuck-sand:PREP INcar-one:NUMroot-cars:ROOTcar-black:AMODroot-children:ROOTstreet-front:PREP INroot-take:ROOTcar-green:AMODroad-busy:AMODtrucks-the:DETcar-yellow:AMODcars-two:NUMroot-stuck:ROOTcar-white:AMODspotted-car:NSUBJ

Continued on next page

112

Page 113: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts336 magic,green,dead

artist,street,blackrose,colors,blueman,city,streetprison,orange,woman

root-shrine:ROOTstanding-me:NSUBJman-sitting:DEPwomen-two:NUMsidewalk-house:PREP IN FRONT OFshrine-the:DETman-sitting:VMODstanding-front:PREP INroot-poses:ROOTwoman-an:DETstanding-girl:NNsitting-house:PREP IN FRONT OFscene-street:NNplays-girl:NSUBJsidewalk-the:DET

337 girl,blue,girlsshoes,dress,styleasian,girls,beautifulclothes,style,redimages,action,sports

dress-pink:AMODgirl-street:PREP INgirls-pink:PREP INgirls-two:NUMdress-the:DETin-dress:POBJgirl-walking:DEPgirl-dress:PREP INdressed-clothes:PREP INwoman-shirt:PREP INgirl-pink:PREP INgirl-walking:VMODwoman-dress:PREP INlady-dress:PREP INgirl-the:DET

338 monks,asia,orangeindia,culture,peopleburma,documentary,reliefrefugees,girl,boythailand,monks,burma

root-women:ROOTgroup-a:DETnursery-tree:NNroot-men:ROOTcarry-to:AUXpeople-standing:VMODroot-group:ROOTwoman-a:DETtrees-plant:NNroot-children:ROOTboy-young:AMODvillage-a:DETgirls-young:AMODdress-the:DETbags-plastic:AMOD

Continued on next page

113

Page 114: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts339 horses,explore,animal

horse,red,whitedust,horse,africashooting,rifles,warfrench,war,rifles

horse-white:AMODroot-horse:ROOThorse-the:DETpony-a:DETboy-dog:CONJ ANDriding-horse:DOBJbath-river:PREP INwalking-road:DOBJwalking-dogs:DOBJpark-mountain:NNwashing-river:PREP INgirl-dog:CONJ ANDwalking-forest:PREP INroot-man:ROOTcrossing-road:DOBJ

340 funny,cute,naturehorses,portrait,animalfarm,animal,cowpets,cat,catspuppy,baby,animals

dogs-the:DETroot-horse:ROOTroot-dogs:ROOThorse-a:DETbuilding-students:PREP BYhorse-the:DETwatching-birds:DOBJsit-to:AUXsite-building:PREPC OUTSIDEhorses-the:DETcats-black:AMODcow-the:DETdog-house:PREP INstudents-the:DETfence-the:DET

341 toy,figures,greenfamily,girls,beautymale,men,boymother,portrait,womanoffice,people,men

chair-girl:NNgirl-big:AMODboy-big:AMODgirl-chair:PREP INboy-sitting:DEPbed-boy:NNbed-girl:NNsitting-kitchen:PREP INchair-boy:NNplay-to:AUXtaking-bath:DOBJboy-chair:PREP INroot-loves:ROOTroot-grace:ROOTbath-a:DET

Continued on next page

114

Page 115: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts342 dog,white,explore

winter,canada,landscapeplay,dog,dogspups,baby,petrabbit,sweet,pets

snow-the:DETdogs-the:DETdogs-two:NUMrunning-snow:PREP INwalking-snow:PREP INone-dogs:PREP OFcat-street:NNdog-snow:PREP INpuppy-a:DETroot-doggy:ROOTstuff-white:AMODroot-lucky:ROOTold-weeks:NPADVMODhouse-dog:NNboy-dog:CONJ AND

343 prison,orange,womanorange,light,colorsbus,people,englandpresident,photo,artjeep,girl,army

bus-school:NNorange-the:DETstanding-me:NSUBJhouse-yellow:AMODtruck-yellow:AMODhouse-orange:AMODbox-phone:NNstanding-front:PREP INbox-yellow:AMODshops-the:DETcar-train:NNbuilding-yellow:AMODorange-white:CONJ ANDin-front:POBJtrain-the:DET

344 motorcycle,road,skybike,motorcycle,raceafrica,desert,sandshooting,rifles,warboy,water,beach

bike-mountain:NNbiking-mountain:NNrace-bike:NNride-bike:NSUBJrace-mountain:NNtour-bike:NNride-mountain:NNride-bike:NNroad-dirt:NNtrip-bike:NNwalking-hill:DOBJwalking-road:DOBJup-mountain:POBJrace-a:DETtrails-the:DET

Continued on next page

115

Page 116: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts345 locomotive,steam,night

road,city,peopleplaza,united,cloudsparis,panorama,polarnight,moon,sky

black-white:CONJ ANDsign-bar:NNshot-black:PREP INshot-white:PREP INman-black:PREP INsign-the:DETblack-the:DETfilm-white:AMODpotter-harry:NNroot-sign:ROOTfilm-black:AMODtower-prague:PREP INshot-white:AMODthink-looks:CCOMPband-rock:NN

346 clothes,woman,beautymicrophones,people,funfoals,music,livemicrophones,studio,californiaelection,photo,london

boys-kitchen:PREP INmachine-flying:AMODroom-computer:NNlaptop-the:DETin-office:POBJcomputer-the:DETbuilding-students:PREP BYoffice-home:NNcomputer-a:DETroot-nap:ROOTback-van:PREP OFkitchen-house:PREP ATdesk-a:DETvideo-a:DETmonitor-computer:NN

347 reefs,surf,beachnavy,ship,waterpacific,waves,naturemassachusetts,buildings,constructionsurf,california,hawaii

middle-ocean:PREP OFboat-ocean:PREP INboat-bay:PREP INbay-the:DETboat-water:PREP INroot-sailboat:ROOTview-boat:PREP FROMship-background:PREP INboat-sea:PREP INsailboat-the:DETrock-water:PREP INocean-a:DETocean-the:DETcoast-island:PREP OFboat-harbor:PREP IN

Continued on next page

116

Page 117: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts348 roadblock,water,tree

shooting,rifles,warcolorado,vacation,aircraftview,window,citypennsylvania,president,beards

students-the:DEThorses-the:DETshirt-blue:AMODbuilding-students:PREP BYguide-tour:NNpasture-a:DETmountain-ridge:PREP INmountain-loft:NNup-mountain:POBJsite-building:PREPC OUTSIDEroot-ride:ROOTpasture-cow:NNplant-to:AUXtrip-bike:NNhorse-the:DET

349 dog,animals,exploredriver,portrait,peoplesigma,portrait,peopletoronto,protest,portraitpeace,love,portrait

seat-back:AMODhome-car:NNriding-cars:PREP INcar-home:PREP ONmirror-portrait:NSUBJsitting-seat:PREP INcar-way:PREP ONhome-way:NNtaken-mirror:PREP INseat-car:PREP OFsitting-car:PREP INmirror-the:DETsitting-window:PREP BYgirl-mirror:PREP INboys-car:PREP IN

350 bird,sky,bluedead,animal,macropond,bird,animalbird,flight,waterwildlife,bird,birds

pond-the:DETfish-pond:PREP INduck-the:DETheron-the:DETpond-a:DETwater-black:AMODbird-water:PREP INfoot-a:DETwater-dark:AMODlake-park:PREP ATduck-a:DETduck-white:AMODduck-black:AMODfish-lake:PREP INroot-duck:ROOT

Continued on next page

117

Page 118: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts351 apple,office,mac

mac,leopard,displayapple,mac,blackmac,black,musicwork,office,apple

computer-the:DETkeyboard-the:DETlaptop-the:DETroot-desk:ROOTdesk-office:PREP INscreen-the:DETroot-computer:ROOTcomputer-a:DETmonitor-the:DETdesk-computer:NNdesk-room:PREP INlaptop-a:DETdesk-new:AMODoffice-the:DETdesk-the:DET

352 hospital,people,californialove,baby,cutemother,portrait,womanbaby,beautiful,girlskiss,cute,wedding

root-nap:ROOTboy-bed:PREP INchair-bag:NNbed-boy:NNhospital-the:DETsleeping-seat:PREP INseat-car:NNgirl-bed:PREP INbed-house:PREP INgirl-baby:NNasleep-seat:PREP INsleeping-car:PREP INin-seat:POBJhome-ride:NNroot-charlie:ROOT

353 action,girl,motionbay,pacific,eastsports,water,beachpool,woman,swimmingsmile,fun,water

riding-horse:DOBJpool-swimming:AMODwoman-sitting:VMODgirl-boat:PREP INgirl-bikini:PREP INgirl-water:PREP INwoman-young:NSUBJsitting-bridge:PREP ONboy-boat:PREP INelephant-the:DETsitting-tree:PREP ONboy-dog:CONJ ANDroot-figure:ROOTwoman-an:DETgirls-boat:PREP IN

Continued on next page

118

Page 119: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts354 dance,netherlands,holland

rock,music,concertathlete,water,surftour,live,musiclights,street,people

guy-the:DETroot-band:ROOTshirt-green:AMODgirl-green:PREP INfloor-dance:NNroot-shoot:ROOTband-rock:NNstage-the:DETstanding-around:PRTevent-the:DETroot-guy:ROOTgirl-bar:PREP INgirl-pretty:AMODplay-the:DETshoes-white:AMOD

355 cats,kitten,petscat,eyes,kittycat,kitten,kittypet,cat,felinefeline,kitten,cats

cat-cute:AMODsleeping-box:PREP INloves-cat:NSUBJcat-fat:AMODcomputer-the:DETcat-gray:AMODbag-laptop:AMODcat-house:PREP INdrawer-desk:NNbox-new:AMODkitty-box:PREP INlikes-sit:XCOMPsitting-sun:PREP INcase-a:DETdrawer-a:DET

356 child,social,portraitbaby,beautiful,girlsgirl,eyes,facekid,hope,socialgirls,child,beauty

bed-girl:NNhat-cute:AMODblue-pink:CONJ ANDgirl-baby:NNclothes-the:DETpink-pretty:ADVMODgreen-pink:CONJ ANDribbon-pink:AMODcute-hat:PREP INroot-baby:ROOTgirl-big:AMODpink-orange:CONJ ANDsmile-a:DETparty-birthday:NNpink-blue:CONJ AND

Continued on next page

119

Page 120: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts357 roof,window,red

florida,fun,boatspattern,wall,urbanmosque,iran,prayertoronto,architecture,blue

roof-house:PREP OFbuilt-house:NSUBJPASStree-house:PREP OFroof-building:PREP OFhouse-a:DEThouse-street:PREP ONtree-building:PREP INtree-front:PREP INroof-glass:NNfence-the:DEThouse-guest:NNfence-iron:NNtree-beautiful:AMODhouse-in:PREPtrees-bloom:PREP IN

358 crowd,girl,portraitcenter,beach,politicsbeards,world,pennsylvaniapresident,america,partyenvironment,rally,democrat

shirt-pink:AMODguy-the:DETshirt-blue:AMODshirt-red:AMODman-shirt:PREP INme-shirt:PREP INwearing-shirt:DOBJshirt-orange:AMODone-shirt:PREP INat-bar:POBJguy-hat:PREP INhats-the:DETshirt-the:DETgirl-bar:PREP INroot-ladies:ROOT

359 driver,cars,autocar,automobile,vehiclescientists,science,artdisplay,apple,mactollbooth,scotland,street

truck-a:DETshow-car:NNroot-travel:ROOTback-truck:PREP OFwindow-rear:AMODtruck-blue:AMODshow-a:DETbed-truck:PREP OFlot-parking:NNshow-car:NSUBJmuseum-railroad:NNroot-coach:ROOTcar-sitting:VMODseats-the:DETfront-car:PREP OF

Continued on next page

120

Page 121: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts360 airplane,pilot,fighter

transportation,fly,enginerunway,flight,aviationairplane,wings,winglanding,aviation,flying

museum-airplane:NNmay-heritage:NNmuseum-vintage:AMODmay-collection:NNflying-order:DOBJairport-the:DETplane-the:DETtruck-the:DETroot-sticker:ROOTcar-lot:PREP INvan-a:DETscheme-white:AMODcar-white:AMODtrip-road:NNwash-car:NN

361 bike,motorcycle,racebicycle,motion,girlmotorcycle,road,skybicycle,sky,sunsetroad,forest,europe

root-ride:ROOTstart-the:DETride-bike:NNtour-bike:NNbike-front:PREP INrace-bike:NNrace-a:DETride-to:AUXride-bike:NSUBJbike-mountain:NNshirt-yellow:AMODbicycle-a:DETtrailer-a:DETdog-basket:PREP INrace-the:DET

362 texture,portrait,girloutdoor,people,portraithigh,school,clubmorning,people,coffeesquare,portrait,china

standing-wall:PREP ONroot-father:ROOTroot-brother:ROOTroot-rolls:ROOTroot-shoot:ROOTsitting-wall:PREP ONfeet-bare:AMODman-sitting:DEPstanding-wall:PREP IN FRONT OFboy-white:AMODbuilding-fence:DOBJman-young:AMODstanding-in:PRTstanding-’re:AUXthrowing-rocks:DOBJ

Continued on next page

121

Page 122: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts363 bunny,pink,toy

wedding,cake,flowerskitchen,pink,toysgroom,flowers,cakecottage,vintage,pink

flowers-fresh:AMODcake-fruit:NNdecorated-flowers:PREP WITHcake-pink:AMODfondant-white:AMODcake-vanilla:NNcake-birthday:NNcake-box:PREP INpot-tea:NNcake-white:AMODroot-roses:ROOTroot-tea:ROOTshelf-kitchen:PREP INroot-gift:ROOTsign-table:PREP IN

364 horses,explore,animalhorse,red,whitehorse,argentina,fieldfoals,horse,maretexas,war,field

horses-the:DEThorse-a:DEThorse-the:DETroot-horses:ROOTroot-horse:ROOThorse-black:AMODgirls-the:DETcow-a:DETriding-horse:DOBJhorse-field:PREP INcow-the:DETgrass-lush:AMODfield-baseball:NNsecurity-the:DETplant-tree:DOBJ

365 sand,nature,desertshore,rocks,bluewild,bird,birdstortoise,park,seaseascape,coast,rocks

root-turtle:ROOTguy-little:AMODbird-dead:AMODfish-dead:AMODpigeon-a:DETroot-snake:ROOTroot-rests:ROOTturtle-a:DETroot-turtles:ROOTspotted-bird:DOBJroot-salmon:ROOTpark-golden:NNduck-a:DETroot-frog:ROOTbarbara-santa:NN

Continued on next page

122

Page 123: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts366 design,interior,furniture

doorway,red,abandonedchair,room,officemodern,interior,furniturefloor,window,interior

doors-glass:NNdoor-cat:NNdoor-front:AMODdoor-house:PREP OFlooking-door:DOBJroot-cabinet:ROOTdoor-kitchen:NNmicrowave-the:DETlooking-room:PREP INTOstanding-door:PREP INdoorway-the:DETwindow-bedroom:PREP INcabinet-the:DETheater-water:NNdoor-room:PREP IN

367 democrat,beach,electioncafe,bar,streetclassroom,california,appleunderground,people,streetsubway,people,graffiti

classroom-the:DETone-shirt:PREP INlab-computer:NNwaiting-line:PREP INdoor-dag:DEPlobby-the:DETseats-the:DETmarket-largest:AMODshirt-brown:AMODgame-the:DETarea-floor:NNshirt-the:DETcar-dining:NNtrain-sky:NNstanding-around:PRT

368 signs,asia,japanrunning,cheering,cityroad,city,peoplesubway,people,graffitiroadblock,protest,london

cross-street:DOBJstreet-busy:AMODmarket-house:PREP NEARstreet-typical:AMODshops-the:DETstreet-market:NNstreet-shopping:NNwalking-street:PREP ONstreet-city:PREP INparade-the:DETstreet-house:PREP NEARmotorcycle-a:DETman-an:DETstreet-the:DETpeople-many:AMOD

Continued on next page

123

Page 124: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts369 cake,groom,party

design,light,redmeeting,office,warbook,dog,funnychild,boys,people

cake-birthday:NNroot-brother:ROOTcandles-the:DETgirl-birthday:NNparty-birthday:NNsitting-desk:PREP ATceremony-the:DETcandle-the:DETparty-the:DETreception-the:DETgirl-pink:AMODchris-girls:CONJ ANDcup-tea:PREP OFchris-uncle:NNgirls-kitchen:PREP IN

370 sails,sunset,oceansailboat,ship,bluewonderful,water,seasailing,sunset,sailboatocean,sand,beach

sail-the:DETroot-sail:ROOTboat-background:PREP INboat-sail:AMODboats-sail:AMODsailboat-the:DETship-background:PREP INtour-boat:NNtaxi-water:NNsail-to:AUXboat-water:PREP INboat-harbor:PREP INride-boat:NNbeach-house:PREP NEARboats-two:NUM

371 waves,surf,waveboy,water,beachwater,ocean,beachcliff,rock,sandbeauty,asia,japan

catch-fish:DOBJstanding-rock:PREP ONplaying-boy:NNboy-water:PREP INwater-cold:AMODman-dog:CONJ ANDwaves-the:DETwater-beach:PREP ATplaying-water:PREP INsuperior-lake:NNrocks-water:PREP INwashing-river:PREP INswimming-water:PREP INenjoying-water:DOBJcatch-to:AUX

Continued on next page

124

Page 125: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts372 dogs,funny,cute

pups,baby,petsoft,animal,petpets,cat,catspuppy,baby,animals

sleeping-car:PREP INroot-cats:ROOTtaking-nap:DOBJplaying-basket:PREP INnap-a:DETsleeping-box:PREP INbag-laptop:AMODsleeping-sun:PREP INbox-shoe:NNseat-back:AMODroot-puppies:ROOTroot-puppy:ROOTseat-passenger:NNgirl-bed:PREP INdesk-computer:NN

373 home,portrait,bluecounty,beach,floridacenter,beach,politicstoronto,protest,portraitdesign,light,red

shirt-white:AMODwearing-shirt:DOBJgirls-all:PREDETme-shirt:PREP INgirls-standing:DEPdress-fancy:AMODshirt-new:AMODshirt-a:DETme-house:PREP INroot-birthday:ROOTgirl-birthday:NNsitting-desk:PREP ATgirl-wedding:PREP INat-bar:POBJtook-house:NSUBJ

374 bicycle,china,colormotorcycle,road,skyrace,bike,politicscolorful,animal,beautifulholland,dance,light

race-bike:NNrace-mountain:NNrace-the:DETrace-cup:NNseat-bike:NNroot-race:ROOTrace-a:DETtri-sprint:NNtrail-river:NNtrail-nlr:NNtri-swim:PREP WITHswim-run:CONJ ANDbike-trail:PREP ONswim-lake:PREP INmotorcycle-a:DET

Continued on next page

125

Page 126: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts375 abandoned,truck,car

grass,cow,fieldshoes,white,bluefilm,nature,landscapegrass,macro,flowers

car-toy:NNaccident-car:NNroot-stuck:ROOTcar-yellow:AMODpuddle-a:DETcars-many:AMODwalking-home:DOBJcars-two:NUMcar-blue:AMODlot-the:DETball-yellow:AMODroot-ball:ROOTside-road:NNpatch-grass:PREP OFtrees-plant:NN

376 snow,tree,treesblue,architecture,buildingwinter,water,skycold,trees,skyfrozen,trees,lake

truck-old:AMODroot-truck:ROOTcar-abandoned:AMODtruck-an:DETtruck-field:PREP INcar-field:PREP INcar-old:AMODtruck-rusty:AMODroot-trucks:ROOTroot-car:ROOTcar-waiting:VMODjam-traffic:NNcar-an:DETroot-winter:ROOTreflection-building:PREP OF

377 book,dog,funnypakistan,earthquake,adventurebuddhism,monks,peopleties,glasses,bandmassachusetts,people,running

cake-birthday:NNbottle-wine:PREP OFroot-dinner:ROOTgirls-kitchen:PREP INroot-breakfast:ROOTbook-the:DETgirls-house:PREP INcandle-the:DETpaper-the:DEThouse-grandparents:POSSstaff-the:DETwine-red:AMODhouse-gingerbread:AMODlunch-a:DETgirl-house:PREP IN

Continued on next page

126

Page 127: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts378 dark,lights,city

lights,colors,colordarkness,red,nighttimebus,light,lightsdriver,spain,night

light-blue:AMODlights-blue:AMODlight-up:PRTexposure-long:AMODlights-car:NNlights-red:AMODlights-green:AMODnight-the:DETexposure-a:DETlights-white:AMODlights-christmas:NNlight-yellow:AMODlights-street:NNbuuren-van:NNstage-the:DET

379 cat,kitten,kittyadorable,rabbit,bunnypet,dog,rabbitcats,kitten,petskitty,orange,cats

likes-sit:XCOMPhouse-parent:POSScat-orange:AMODtaking-nap:DOBJroot-sleeps:ROOTcats-the:DETtowels-the:DETroot-buddy:ROOTmiddle-floor:PREP OFcat-lives:RCMODsleeping-box:PREP INroot-kittens:ROOTchair-office:PREP INbear-house:PREP INshelter-animal:NN

380 locomotive,steam,nightsteam,railroad,railgun,rifles,soldierslocomotive,steam,chinamilitary,tanks,army

train-steam:NNcars-old:AMODcar-old:AMODshow-car:NNroot-trucks:ROOTtrain-old:AMODtruck-ford:NNroot-car:ROOTroot-truck:ROOTcar-train:NNparked-truck:NSUBJroot-train:ROOTtrucks-the:DETvan-door:DEPtruck-a:DET

Continued on next page

127

Page 128: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts381 home,portrait,blue

interesting,portrait,peopledesign,light,redmorning,people,coffeeholiday,christmas,fun

wearing-shirt:DOBJboat-lake:PREP ONstanding-bridge:PREP ONhad-girl:NSUBJride-a:DEThouse-background:PREP INportrait-a:DEThat-paper:NNride-bike:NNhat-white:AMODspent-house:PREP ATtrip-boat:NNpicture-me:PREP OFboy-white:AMODride-mountain:NN

382 hangar,aviation,aircraftfisheye,architecture,cityjudge,car,automobileaviation,fighter,californiaaustin,motorcycle,police

mall-a:DETshow-the:DETcar-street:PREP ONscheme-black:AMODcars-two:NUMstation-street:NNroot-show:ROOTscheme-white:AMODairport-the:DETcar-one:NUMshow-car:NSUBJwheel-the:DETsubway-the:DETshow-tv:NNcolors-white:AMOD

383 goat,cheese,catfeline,kitten,animalscat,kitten,kittykitty,orange,catsrabbit,sweet,pets

bag-a:DETcat-tree:PREP UNDERbag-the:DETnap-a:DETwrapping-paper:DOBJbags-the:DETbasket-a:DETcute-dog:DOBJpig-the:DETcat-bag:PREP INsleeping-basket:PREP INsleeping-box:PREP INroot-cats:ROOTroot-doggy:ROOTroot-dogs:ROOT

Continued on next page

128

Page 129: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts384 cow,animals,nose

summer,river,seagoat,portrait,zooanimals,africa,deerhorns,goat,scotland

cow-a:DETroot-cow:ROOTsheep-a:DETroot-goat:ROOTfarm-a:DETcow-field:PREP INroot-head:ROOThead-a:DETmarket-animal:NNtrip-pizza:CONJ ANDsheep-the:DETlion-the:DETbeach-dog:NNhorses-white:AMODtook-beach:PREP TO

385 railroad,locomotive,steamtrain,engine,steamengine,rail,locomotiverail,engine,steamlocomotive,bridge,track

train-a:DETtrain-car:NNcar-train:NNtrain-an:DETtrain-old:AMODtrain-the:DETyard-train:NNtrain-freight:NNroot-train:ROOTcar-railroad:NNpasses-train:NSUBJroot-passes:ROOTmill-paper:NNroot-heads:ROOTcars-train:NN

386 trip,summer,peoplesquare,portrait,chinairan,portrait,girlcolorful,animal,beautifulwood,art,brown

eat-to:AUXtable-water:NNcandles-the:DETboy-car:PREP INbox-sand:NNplaying-box:PREP INtake-home:DOBJleaf-banana:NNplate-a:DETshirt-an:DETjuice-orange:AMODleaves-banana:NNbowl-fruit:NNroot-reads:ROOTsitting-seat:PREP IN

Continued on next page

129

Page 130: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts387 motorcycle,road,sky

motorcycle,netherlands,nederlandbike,motorcycle,racesport,race,carformula,classic,sport

motorcycle-a:DETbasket-bike:NNrace-a:DETrace-bike:NNbike-mountain:NNrace-the:DETdog-basket:PREP INrace-mountain:NNshow-tv:NNrace-cup:NNbike-front:PREP INbike-road:NNseat-bike:NNtrain-station:DOBJbicycle-a:DET

388 funny,cute,naturesoft,animal,petdogs,funny,cutekitty,orange,catscute,dog,puppy

sleeping-sun:PREP INsit-to:AUXroot-cats:ROOTpillow-a:DETnap-a:DETcats-the:DETcats-black:AMODcute-being:COPchair-computer:NNloves-cat:NSUBJroot-loves:ROOTdog-box:PREP INhome-the:DETloves-sit:XCOMPdog-house:PREP IN

389 president,photo,artcellphones,people,streetmales,room,furnituresuits,street,blackclothing,clothes,canada

standing-way:PREP INin-front:POBJjob-a:DETapartments-the:DETtrain-middle:PREP INhouse-beach:NNbus-tour:NNroot-van:ROOTroot-standing:ROOTvan-the:DETcoach-a:DEThouse-beach:PREP INgrill-the:DETroot-ladies:ROOTstuck-sand:PREP IN

Continued on next page

130

Page 131: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts390 birds,wings,white

fishing,fish,lakeoutdoors,wildlife,beautifulwater,ocean,beachpond,bird,animal

birds-water:NNducks-lake:PREP INswimming-ducks:NSUBJroot-seagulls:ROOTroot-ducks:ROOTducks-river:PREP INroot-swans:ROOTducks-all:PREDETshore-lake:PREP OFflying-water:PREP OVERduck-white:AMODwater-shallow:AMODducks-water:PREP INroot-flock:ROOTgroup-a:DET

391 child,boys,peoplefriend,girl,happystadium,game,peoplesmile,asia,boyfootball,fan,berlin

girl-wedding:PREP INwearing-shirt:DOBJplaying-grass:PREP INin-shirt:POBJgirls-sitting:VMODroot-sister:ROOTlooked-cute:ACOMPgirl-happy:AMODsitting-grass:PREP ONgrass-park:PREP INchair-girl:NNboy-shirt:PREP INbox-sand:NNgirl-cute:AMODcute-boy:DOBJ

392 locomotive,bridge,trackscenery,water,treesbarge,harbour,seachina,water,landscapesigns,australia,nsw

train-freight:NNcrosses-train:NSUBJcovered-bridge:DOBJroot-train:ROOTriver-salmon:NNbridge-lake:DOBJhouse-boat:NNruns-river:NSUBJstation-power:NNstretch-a:DETcold-very:ADVMODground-fore:NNpasses-as:MARKhouse-winter:PREP INhouse-mountains:PREP IN

Continued on next page

131

Page 132: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts393 bike,motorcycle,race

motorcycle,motion,asiamotorcycle,road,skysport,race,carmotorcycle,netherlands,nederland

ride-bike:DOBJbike-front:PREP INbike-road:NNmotorcycle-a:DETride-bike:NSUBJrace-bike:NNdog-basket:PREP INrace-a:DETtrip-bike:NNrace-mountain:NNbike-mountain:NNride-to:AUXbicycle-a:DETbiking-mountain:NNtree-shoe:NN

394 lines,wall,shadowconcrete,wall,abstractcomposition,abstract,geometrysidewalk,yellow,wetgeometry,white,red

sidewalk-the:DETpavement-the:DETtiles-floor:NNfloor-bathroom:NNroot-crack:ROOTroot-floor:ROOTfloor-the:DETlines-the:DETground-the:DETroot-lines:ROOTsidewalk-a:DETglass-broken:AMODroot-damage:ROOTfloor-bathroom:PREP INfloor-kitchen:PREP IN

395 washington,seattle,artadults,furniture,outdoorsengine,art,natureagent,fashion,filmatlanta,woman,costume

sit-chair:PREP INoffice-home:NNin-office:POBJreading-book:DOBJroot-seat:ROOThelp-to:AUXpiece-the:DETstudent-a:DETroot-figure:ROOTchair-room:PREP INboy-birthday:NNbag-blue:AMODroot-pants:ROOTon-floor:POBJbed-boy:NN

Continued on next page

132

Page 133: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts396 silver,car,street

small,big,mansport,race,carhangar,aviation,aircraftwow,light,people

root-car:ROOTcar-street:PREP INcars-many:AMODcar-vintage:AMODparked-car:NSUBJparked-street:PREP INcars-two:NUMparked-street:PREP ONspotted-car:NSUBJcar-street:PREP ONcar-white:AMODcar-old:AMODone-cars:PREP OFgarage-a:DETdogs-two:NUM

397 houseboat,summer,windowadventure,river,tripbarge,france,scotlanddisplay,apple,macprison,film,abandoned

stove-house:PREP INkitchen-a:DETdesk-new:AMODtank-the:DETtub-hot:AMODstove-kitchen:PREP INbox-the:DETsink-kitchen:PREP INbed-truck:NNdesk-office:NNroot-machine:ROOTpipe-water:NNroot-tub:ROOTmachine-old:AMODsilver-the:DET

398 paintings,birds,paintwings,bird,skycemetery,statue,angelsquare,portrait,chinatrip,summer,people

seat-car:NNfloor-tower:PREP INroot-skull:ROOTcar-abandoned:AMODme-car:PREP INwindow-church:PREP ATpainting-wall:NNin-seat:POBJseats-car:NNglass-window:NNdoor-car:NNfloor-glass:NNroot-shrine:ROOTgirl-mirror:PREP INhome-ride:NN

Continued on next page

133

Page 134: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts399 car,automobile,truck

auto,automobile,racevehicle,cars,speedautomobile,ontario,speedspeed,racing,car

car-rental:AMODparked-street:PREP ONone-cars:PREP OFcar-street:PREP INcar-new:AMODwarehouse-brick:NNparked-car:NSUBJcar-french:AMODcar-the:DETspotted-car:NSUBJseat-driver:POSScar-little:AMODcar-classic:AMODcars-many:AMODshow-building:PREP AT

400 formula,classic,sportvintage,car,classicclassic,automobile,redcar,automobile,truckantique,car,truck

show-car:NNshow-car:NSUBJcar-classic:AMODroot-show:ROOTcar-old:AMODtruck-the:DETcars-old:AMODtruck-ford:NNroot-car:ROOTtruck-red:AMODbuilding-britannic:AMODshow-a:DETcars-the:DETone-cars:PREP OFroot-truck:ROOT

401 airplane,pilot,fighterairforce,museum,flagaircraft,pilot,fightertransportation,blue,airplaneairplanes,navy,aviation

building-ferry:NNyellow-blue:CONJ ANDbackground-blue:AMODtail-the:DETlight-traffic:NNroot-faucet:ROOTtelevision-the:DETportrait-self:NNblack-blue:CONJ ANDlens-the:DETblue-a:DETroot-show:ROOTsky-sunny:AMODtruck-a:DETball-plastic:AMOD

Continued on next page

134

Page 135: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts402 colourful,color,colours

president,politicians,hopechristmas,dog,familyhats,cute,handmadepottery,home,retro

wrapping-paper:DOBJcake-birthday:NNroot-food:ROOTcandles-the:DETfish-fresh:AMODhouse-gingerbread:AMODplate-the:DETroot-birthday:ROOTroot-breakfast:ROOTanimals-stuffed:AMODroot-dinner:ROOTparty-birthday:NNcake-velvet:NNmarket-food:NNgirls-kitchen:PREP IN

403 maps,street,citycake,groom,partywedding,cake,flowersshops,fun,floridacheese,night,smile

plate-a:DEThouse-gingerbread:AMODcake-birthday:NNtable-room:PREP INroot-lunch:ROOTcloth-a:DETstaff-the:DETcake-box:PREP INroot-breakfast:ROOTroot-dinner:ROOTtable-house:PREP INmade-home:NSUBJmarket-market:APPOSroot-complete:ROOTall-floor:PREP OVER

404 pet,dog,puppydogs,funny,cuteshooting,studio,playingpets,pups,dogsitting,cat,animal

cat-black:AMODchair-office:NNtable-kitchen:NNhorse-black:AMODcat-grey:AMODchair-computer:NNdog-black:AMODcats-the:DETleather-black:AMODdog-house:PREP INroot-sleeps:ROOTroot-horse:ROOTcats-black:AMODface-to:AUXmove-to:AUX

Continued on next page

135

Page 136: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts405 caribou,arctic,water

elephants,sunset,travelalaska,sheep,wildlifensw,coast,beachdeer,handmade,cute

cross-river:DOBJbed-river:NNmiddle-river:PREP OFhorses-white:AMODbuffalo-water:NNsnow-ground:PREP ONroot-sheep:ROOThole-water:NNlaunch-boat:NNriver-mountain:NNcow-the:DETman-dog:CONJ ANDhorses-wild:AMODruns-river:NSUBJriver-park:PREP IN

406 fall,park,watersigma,portrait,peopleadults,suits,roompictures,fun,friendshuman,school,photo

boys-kitchen:PREP INshirt-brown:AMODshirt-black:AMODvan-60mm:NUMshirt-blue:AMODroot-father:ROOTpants-black:AMODcomputer-a:DETgirls-kitchen:PREP INgirl-boy:CONJ ANDman-shirt:PREP INjacket-black:AMODroot-family:ROOTshirt-yellow:AMODroom-green:AMOD

407 desert,cactus,sunsetsand,waves,blueadult,blue,outdoormexico,beach,oceanbooby,animals,wildlife

pug-parker:APPOSspaniel-pug:CONJ ANDwalking-beach:DOBJinlaws-pug:CONJ ANDbird-the:DETsand-the:DETsand-beach:PREP ATsitting-sand:PREP INwalking-beach:PREP ONbird-blue:AMODfeet-the:DETwalking-sand:PREP INsitting-beach:PREP ONbird-little:AMODbeach-the:DET

Continued on next page

136

Page 137: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts408 design,interior,furniture

kitchen,interior,designinterior,furniture,housecarpet,room,chairstudio,microphones,office

room-living:AMODstanding-kitchen:PREP INdining-room:DOBJroom-living:NNroot-downstairs:ROOTliving-room:DOBJroom-great:AMODlooking-room:PREP INTOroom-new:AMODroom-family:NNroom-kitchen:CONJ ANDin-room:POBJroom-dining:NNbedroom-house:PREP OFbedroom-the:DET

409 locomotive,steam,nightabandoned,truck,carengine,art,naturenavy,airforce,airplanetanks,texas,state

window-shop:NNwindow-store:NNblack-the:DETdisplay-window:NSUBJstore-an:DETwindow-store:PREP OFwindow-broken:AMODmuseum-railroad:NNtrain-steam:NNmachine-old:AMODroot-graffiti:ROOTcage-the:DETroot-train:ROOTcage-bird:NNrailway-valley:NN

410 road,forest,europeshooting,model,portraittrain,sky,cityrock,stone,greenisland,travel,bird

rock-castle:NNriver-background:PREP INlake-background:PREP INground-back:AMODon-bridge:POBJtop-hill:PREP OFboy-local:AMODbackground-the:DETbalcony-the:DETbeach-background:PREP INbeach-green:AMODat-beach:POBJoverlooking-ocean:DOBJrock-background:PREP INcoast-the:DET

Continued on next page

137

Page 138: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts411 office,apple,mac

work,office,appleapple,office,macdisplay,apple,macmac,office,photography

tv-screen:NNoffice-new:AMODscreen-big:AMODlab-the:DETscreen-tv:NNarea-bar:NNscreen-a:DETlab-computer:NNlounge-the:DETtable-window:PREP BYmonitor-the:DETroom-living:NNdesk-room:PREP INscreen-the:DETin-room:POBJ

412 sand,waves,bluebeach,summer,bluewaves,surf,wavecoral,beach,islandisland,sand,islands

beach-private:AMODbeaches-sand:NNpools-rock:NNwater-beautiful:AMODwalking-beach:DOBJon-beach:POBJwater-crystal:NNsitting-sand:PREP INbeach-green:AMODbeach-sandy:AMODoverlooking-ocean:DOBJocean-blue:AMODwashing-clothes:DOBJbeach-little:AMODwaters-blue:AMOD

413 chair,room,officecarpet,room,chaircafe,portrait,filmdisplay,apple,macinterior,furniture,house

theater-movie:NNbedroom-house:PREP INroot-seats:ROOTbed-room:PREP INarea-lounge:NNtv-screen:NNmachine-the:DETroom-hotel:NNtable-bar:PREP INroom-a:DETtheater-a:DETbar-an:DETbedroom-house:PREP OFshelf-book:NNbedroom-old:AMOD

Continued on next page

138

Page 139: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts414 toronto,architecture,blue

tiger,leopard,waterblur,people,streetcats,wild,lioncute,wildlife,squirrel

cub-tiger:NNstump-a:DETsitting-grass:PREP INstump-tree:NNcat-garden:PREP INtiger-a:DETroot-tiger:ROOTgarden-back:AMODcat-lives:RCMODcats-dogs:CONJ ANDtigers-the:DETcat-grass:PREP INpot-flower:NNwatching-birds:DOBJbirds-baby:NN

415 tree,branch,flowerbranch,winter,yellowblossoms,trees,treetree,trunk,leavesleaves,fall,tree

tree-sky:CONJ ANDbats-fruit:NNsleeping-tree:PREP INhigh-tree:PREP INtop-tree:NNbranches-sky:PREP AGAINSTtree-blossom:NNbird-tree:PREP INtree-gum:NNbranches-the:DETup-tree:PREP INroot-branches:ROOTtree-looking:VMODroot-bats:ROOThanging-tree:PREP IN

416 design,interior,furnitureinterior,furniture,housechair,room,officemodern,interior,furniturehome,interior,design

desk-a:DETdesk-computer:NNdesk-new:AMODroot-desk:ROOTdesk-room:PREP INdesk-office:PREP INroot-room:ROOTtable-kitchen:PREP INoffice-home:NNoffice-new:AMODdesk-the:DETdesk-bedroom:PREP INdesk-office:NNtable-window:PREP BYroom-kitchen:CONJ AND

Continued on next page

139

Page 140: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts417 hill,italy,italia

sheep,landscape,skyforest,mountains,cloudscountryside,clouds,greentundra,colorado,mountain

root-hill:ROOTtop-mountain:NNhill-green:AMODgreen-so:ADVMODhillside-the:DETcrater-the:DEThills-green:AMODhill-a:DETfield-green:AMODmountain-highest:AMODside-mountain:NNmountains-green:AMODhorse-white:AMODfield-cow:NNside-hill:NN

418 picture,portrait,peoplenatural,trees,treegold,color,artdance,culture,traditionalarizona,vintage,urban

hand-one:NUMboy-sitting:VMODstanding-wall:PREP IN FRONT OFme-house:PREP INroot-boy:ROOTgirl-every:DETexchange-the:DETboy-sitting:DEPtook-house:NSUBJboy-box:PREP INcute-really:ADVMODboy-chair:PREP INcute-too:ADVMODstanding-girl:NNidea-good:AMOD

419 interior,furniture,housestudio,microphones,officemodern,interior,furniturecarpet,room,chairchairs,interior,office

room-living:AMODtable-house:PREP INroom-kitchen:CONJ ANDtable-chairs:CONJ ANDcarpet-the:DETroot-downstairs:ROOTdoor-front:AMODstanding-way:PREP INroom-living:NNroot-desk:ROOTdesk-new:AMODroom-front:AMODstanding-kitchen:PREP INin-room:POBJroot-room:ROOT

Continued on next page

140

Page 141: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts420 interior,furniture,house

chairs,interior,officerestaurant,street,peopledecoration,home,roomroom,design,home

table-window:PREP BYroom-house:PREP OFlounge-the:DETtable-house:PREP INroom-house:PREP INroom-family:NNtable-kitchen:PREP INroot-tables:ROOTarea-bar:NNroom-dining:NNtables-the:DETtable-room:NNroot-lounge:ROOTtv-screen:NNfireplace-the:DET

421 dog,white,exploredogs,snow,beachrun,grass,petpets,cat,catsrun,dog,fun

dog-white:AMODgirl-dog:CONJ ANDdog-black:AMODroot-horse:ROOThorse-black:AMODroot-black:ROOTrunning-water:PREP INdogs-cats:CONJ ANDcow-a:DETball-tennis:NNsit-to:AUXrunning-field:PREP INhorse-white:AMODdogs-two:NUMenjoying-sun:DOBJ

422 birds,wings,whiterunning,dog,horsedance,woman,jumpfemale,animal,petarctic,ice,bird

root-goose:ROOTstanding-water:PREP INbird-the:DETcaught-bird:DOBJlake-frozen:AMODbird-sitting:VMODgull-a:DETbird-black:AMODseagull-a:DETbirds-little:AMODsparrow-a:DETfeathers-the:DETlooking-food:PREP FORbirds-the:DETbird-water:NN

Continued on next page

141

Page 142: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts423 cat,kitten,kitty

cute,cats,catwaiting,portrait,cuteadorable,funny,naturekitten,fun,jump

likes-sit:XCOMPwindow-sunny:AMODmoment-a:DETcute-being:COPcat-orange:AMODchair-computer:NNshelter-animal:NNchair-office:NNcat-lives:RCMODflowers-house:PREP INloves-sit:XCOMProot-mean:ROOTchair-desk:NNroot-daisy:ROOTrunning-house:PREP AROUND

424 shop,market,fooddecember,christmas,greencopyright,fun,prettypictures,fun,friendsbar,glasses,people

candles-the:DETtable-bar:PREP INshirt-red:AMODboy-car:PREP INgirl-mirror:PREP INbar-a:DETboy-red:PREP INcandle-a:DETvase-the:DETyear-new:NNgirl-bar:PREP INmarket-air:NNroot-birthday:ROOTwindow-shop:PREP OFroot-daughter:ROOT

425 wings,airplane,airplanesfighter,navy,californiajet,airplanes,wingfurniture,chairs,retrotanker,truck,airplane

museum-airplane:NNflying-order:DOBJmuseum-vintage:AMODmay-heritage:NNmay-collection:NNmachine-flying:AMODplane-the:DETbox-black:AMODplane-a:DETairplane-a:DETroot-cow:ROOTroot-bow:ROOTchair-lounge:NNwest-key:NNwalk-as:MARK

Continued on next page

142

Page 143: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts426 bike,motorcycle,race

motorcycle,motion,asiamotorcycle,road,skymotorcycle,netherlands,nederlandformula,classic,sport

motorcycle-a:DETbike-front:PREP INbike-road:NNbicycle-a:DETroot-show:ROOTshow-car:NNbasket-bike:NNdog-basket:PREP INshow-a:DETrace-a:DETlot-parking:NNride-bike:DOBJrace-the:DETbike-mountain:NNrace-bike:NN

427 interior,furniture,housemodern,interior,furnituredesign,interior,furniturechair,room,officefurniture,chairs,retro

desk-a:DETroot-room:ROOTroom-living:AMODliving-room:DOBJtable-chairs:CONJ ANDwalls-green:AMODroom-kitchen:CONJ ANDroom-green:AMODbedroom-house:PREP OFlooking-room:PREP INTOcorner-the:DEThouse-bedroom:AMODroom-house:PREP INdesk-computer:NNdining-room:DOBJ

428 airport,runway,skyrunway,flight,aviationcruise,port,europelanding,aviation,flyinginternational,aircraft,airplane

bridge-big:AMODairport-the:DETroad-new:AMODbridge-bridge:CONJ ANDbridge-highway:PREP OVERairplane-a:DETbridge-goes:RCMODbeach-long:AMODhighway-a:DETseine-river:NNtrack-the:DETgoes-bridge:NSUBJpark-car:NNbridge-longest:AMODgoes-train:NSUBJ

Continued on next page

143

Page 144: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts429 door,windows,house

windows,house,greencottage,vintage,pinkdecoration,home,roombathroom,abandoned,interior

root-box:ROOTdoor-side:NNdoor-front:AMODdoor-office:NNroom-house:PREP OFhouse-every:DETroot-toilet:ROOTdoor-windows:CONJ ANDbox-an:DEThouse-bedroom:AMODbox-phone:NNback-door:DEPbox-red:AMODlooking-door:DOBJroot-complete:ROOT

430 carpet,room,chairpolaroid,abandoned,californiamodern,interior,furniturefloor,window,interiorinterior,furniture,house

root-bedroom:ROOTbedroom-house:PREP INroot-downstairs:ROOTroom-family:NNbed-bedroom:PREP INstanding-door:PREP INroom-the:DETroot-suite:ROOTroot-room:ROOThouse-bedroom:AMODroot-guest:ROOTliving-room:DOBJbasement-the:DETroom-kitchen:CONJ ANDroom-living:NN

431 bench,winter,snowhut,green,treefence,grass,fieldchair,abandoned,oldrange,rifles,iraq

bench-a:DETfarm-the:DETroot-bench:ROOTheat-the:DETbench-the:DETseat-a:DETwater-a:DETgarden-water:NNroot-grown:ROOTweek-last:AMODhouse-boat:NNroot-seat:ROOTroot-metal:ROOTstump-the:DETgreen-very:ADVMOD

Continued on next page

144

Page 145: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts432 automobile,transportation,vintage

fisheye,portrait,closeupsilver,car,streetcar,automobile,truckracing,driver,united

root-show:ROOTcar-classic:AMODme-car:PREP INlot-parking:NNshow-car:NNportrait-self:NNparked-street:PREP ONshow-a:DETshow-car:NSUBJtruck-ford:NNhas-car:NSUBJcar-a:DETcars-old:AMODseat-driver:POSSparked-street:PREP IN

433 army,iraq,kuwaitvietnam,soldier,adultsmales,soldier,warairforce,vietnam,navysoldiers,weapons,uniform

race-the:DETbike-mountain:NNrace-bike:NNrace-mountain:NNtree-joshua:NNride-the:DETblack-orange:CONJ ANDbiking-mountain:NNrace-a:DETmotorcycle-a:DETpark-mountain:NNrace-cup:NNorange-black:CONJ ANDangle-a:DETflash-a:DET

434 auto,truck,canadabus,abandoned,cloudsstore,night,architectureautomobile,truck,californiaengine,truck,auto

truck-front:PREP INvan-white:AMODparked-street:PREP INroot-van:ROOTcar-front:PREP INroot-county:ROOThas-car:NSUBJcar-green:AMODbus-tour:NNstreet-city:PREP INbus-city:NNdealership-car:NNroot-coach:ROOTdog-truck:PREP INpark-car:DOBJ

Continued on next page

145

Page 146: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts435 auto,automobile,race

automobile,ontario,speedvehicle,cars,speedspeed,racing,carsport,race,car

spotted-car:NSUBJcar-toy:NNcar-new:AMODcar-classic:AMODcar-street:PREP INparked-car:NSUBJparked-street:PREP INparked-street:PREP ONshow-car:NNcar-blue:AMODcar-green:AMODone-cars:PREP OFshow-car:NSUBJwarehouse-brick:NNcar-rental:AMOD

436 flying,california,pilotairplane,pilot,fighterwings,bird,skyjet,airplane,flightaircraft,pilot,fighter

seat-front:AMODview-seat:PREP FROMplane-the:DETcar-the:DEThome-the:DETwindow-truck:NNmirror-rearview:NNback-car:PREP OFhome-car:NNtrip-road:NNmirror-side:NNseat-back:AMODhome-way:NNin-car:POBJback-home:DEP

437 bus,abandoned,cloudsauto,truck,canadapolice,car,carsdriver,cars,autotruck,tanker,massachusetts

root-coach:ROOTstation-bus:NNtrain-little:AMODcoach-a:DETtrain-road:NNcar-front:PREP INroot-van:ROOTparked-street:PREP INcar-street:NNhouse-car:CONJ ANDlive-people:NSUBJvan-white:AMODhouse-front:PREP INbuses-the:DETwindow-rear:AMOD

Continued on next page

146

Page 147: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts438 polaroid,marsh,landscape

aerial,blue,seafun,sky,vacationaerial,city,germanywindow,frost,water

car-cable:NNview-clear:AMODroot-school:ROOTroot-travel:ROOTcastle-hill:PREP ONclear-water:DOBJclear-crystal:ADVMODwall-great:AMODview-car:PREP FROMside-mountain:PREP OFroot-crystal:ROOTlift-the:DETcastle-dover:NNfish-river:PREP INcenter-picture:PREP OF

439 fall,park,waterhome,portrait,blueindividual,person,peoplejudge,cat,littlecool,portrait,cute

shirt-a:DETme-shirt:PREP INin-shirt:POBJshirt-white:AMODme-house:PREP INshirt-new:AMODshirt-pink:AMODcar-way:PREP ONshirt-dress:NNshirt-blue:AMODriding-cars:PREP INboy-shirt:PREP INin-car:POBJsmile-a:DETpicture-me:PREP OF

440 halloween,dog,costumepicture,portrait,peopleoregon,food,workbuddha,monks,statuegirls,child,beauty

root-pig:ROOTapple-a:DETbaby-a:DETball-little:AMODshots-few:AMODboy-baby:NNroot-ginger:ROOTrose-black:PREP INthought-cute:CCOMPshots-a:DETroot-grace:ROOTgirl-white:AMODorange-an:DETbag-paper:NNhome-a:DET

Continued on next page

147

Page 148: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts441 room,design,home

design,interior,furniturehome,interior,designretro,modern,furnitureinterior,furniture,house

root-room:ROOTroom-house:PREP INbedroom-main:AMODroom-house:PREP OFshopping-window:NNleads-door:NSUBJfireplace-the:DETtable-kitchen:PREP INhouse-guest:NNarea-kitchen:NNkitchen-sink:DEProot-guest:ROOTroom-great:AMODcolor-wall:NNbedroom-house:PREP OF

442 elephants,sunset,travelhorse,argentina,fieldhorses,landscape,cloudscows,clouds,grasshorse,sky,landscape

root-cow:ROOTroot-horses:ROOTcows-road:PREP INhorses-white:AMODcrossing-road:DOBJhorses-the:DETfarmer-a:DETroot-horse:ROOThorse-a:DEThorse-black:AMODcow-the:DETroot-elephant:ROOTcow-a:DEThorse-the:DEThorse-drawn:VMOD

443 home,interior,designstudio,microphones,officechair,room,officeinterior,furniture,housemodern,interior,furniture

root-downstairs:ROOTbedroom-house:PREP OFbedroom-house:PREP INroot-room:ROOTstanding-door:PREP INbedroom-spare:AMODroom-house:PREP INroom-new:AMODroom-guest:NNbedroom-a:DEThas-bedroom:NSUBJbedroom-the:DETleads-door:NSUBJroom-living:AMODroom-living:NN

Continued on next page

148

Page 149: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts444 room,design,home

work,office,appledecoration,home,roomfurniture,toys,housedesign,interior,furniture

table-window:PREP BYtable-kitchen:PREP INroom-house:PREP OFdisplay-the:DETsign-table:PREP INbook-new:AMODtable-house:PREP INtable-bar:PREP INhouse-gingerbread:AMODtable-room:NNlounge-the:DETshopping-window:NNreflected-mirror:PREP INdesk-room:PREP INarea-lounge:NN

445 horses,explore,animalgoat,mountain,wildlifedog,white,exploregoat,cheese,catrunning,dog,horse

dog-white:AMODgoat-a:DEThorses-white:AMODcow-a:DETpony-a:DETdogs-two:NUMtaken-family:AGENTdogs-cats:CONJ ANDdog-brown:AMODroot-cow:ROOTriding-horse:DOBJforest-new:NNhorse-a:DETroot-goat:ROOTcow-field:PREP IN

446 hangar,aviation,aircraftairport,travel,architectureairforce,museum,flagcolour,people,artpolice,car,cars

garage-parking:NNsubway-the:DETseats-the:DETtruck-big:AMODstation-train:NNstation-central:AMODexit-the:DETroot-trucks:ROOTcar-police:NNline-red:AMODtrucks-the:DETsticker-a:DETtrain-station:DOBJairport-the:DETlot-parking:NN

Continued on next page

149

Page 150: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts447 hawaii,flower,copyright

horse,red,whitefestival,india,travelband,metal,redbicycle,china,color

market-the:DETmarket-local:AMODmarket-a:DETroot-market:ROOTmai-chiang:NNhorse-a:DEThorse-black:AMODmarket-street:NNarea-market:NNmarket-there:ADVMODhorse-the:DETwoman-a:DETperu-river:APPOShorse-wooden:AMODhorse-drawn:VMOD

448 railroad,locomotive,steamlocomotive,bridge,trackhouseboat,house,hollandtrain,engine,steamrailway,bridge,steam

cars-train:NNtrain-a:DETcar-train:NNtrain-freight:NNcar-railroad:NNcrosses-train:NSUBJcar-box:NNhouse-yellow:AMODroot-train:ROOTrailroad-the:DETtracks-railroad:NNtrain-an:DETtrain-road:NNyard-train:NNtrain-passenger:NN

449 garden,trees,treevalley,water,riverhill,architecture,cityscenic,outdoors,treeancient,tree,city

forest-national:AMODroot-suspension:ROOTtrails-the:DETside-river:PREP OFbike-mountain:NNbridge-suspension:NNvalley-the:DETcanyon-river:NNroot-trail:ROOTbridge-canyon:PREP OVERbridge-little:AMODloop-the:DETtrail-a:DETtrail-bike:NNwheel-water:NN

Continued on next page

150

Page 151: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts450 design,light,red

home,portrait,bluesquare,portrait,chinafall,park,watercheering,fun,national

seat-back:AMODgirls-all:PREDETgirls-the:DETseat-car:PREP OFgirls-standing:DEPstanding-line:PREP INvan-the:DETline-bathroom:PREP FORgirl-car:PREP INroot-girls:ROOTme-shirt:PREP INhome-the:DEThome-way:NNriding-cars:PREP INin-car:POBJ

451 adorable,rabbit,bunnypet,dog,rabbitbunny,white,pupsrabbit,sweet,petsrabbit,white,adorable

cat-white:AMODdog-white:AMODdog-window:PREP INfamily-foster:AMODroot-puppy:ROOTdog-box:PREP INdog-service:NNtaken-family:AGENTpuppy-the:DETbear-polar:AMODdog-house:PREP INretriever-golden:AMODroot-doggy:ROOTcute-dog:DOBJold-months:NPADVMOD

452 mist,mountains,cloudsgrass,landscape,cloudsfog,mountains,skygreen,sky,cloudscow,landscape,clouds

field-cow:NNhorse-white:AMODtop-mountain:PREP OFmountain-a:DEThill-a:DETroot-hill:ROOThill-green:AMODhill-house:PREP NEARmountain-distance:PREP INtrip-road:NNroot-dunes:ROOTstanding-field:PREP INroad-mountain:NNparkway-the:DETmountain-the:DET

Continued on next page

151

Page 152: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts453 adorable,rabbit,bunny

cats,kitten,petskitty,white,catsbasket,cat,kittenfeline,kitten,animals

cat-bag:PREP INcat-house:PREP INcute-being:COPcats-the:DETroot-kittens:ROOTdog-bag:PREP INhouse-cat:NNcat-pot:PREP INposition-a:DETcat-basket:PREP INpuppy-a:DETbowl-dog:NNpuppy-cute:AMODcat-cute:AMODchair-bag:NN

454 small,big,manhealth,red,whitenevada,hotel,adultcheering,fun,nationaldelete,people,woman

girls-all:PREDETgirls-standing:DEPline-bathroom:PREP FORstanding-line:PREP INdressed-black:PREP INshirt-red:AMODme-dress:PREP INdress-red:AMODhead-nags:NNfloor-shangri:PREP OFgirl-red:PREP INgirl-bar:PREP INriding-cars:PREP INdevil-dress:PREP INin-office:POBJ

455 kitchen,interior,designroom,design,homedesign,interior,furnitureinterior,furniture,housedecoration,home,room

room-house:PREP INtable-kitchen:PREP INroom-house:PREP OFflowers-fresh:AMODsign-table:PREP INroom-guest:NNtable-window:PREP BYdecorated-flowers:PREP WITHaround-house:POBJhouse-bedroom:AMODcolor-wall:NNliving-room:DOBJroot-complete:ROOTbedroom-house:PREP OFkitchen-house:PREP IN

Continued on next page

152

Page 153: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts456 sidewalk,people,woman

photographers,portrait,photosshooting,studio,playingpennsylvania,animal,zooraft,pool,green

dog-window:PREP INdogs-cats:CONJ ANDwindow-shop:NNdogs-two:NUMpool-swimming:NNroot-dogs:ROOTman-old:AMODshrine-the:DETcafe-a:DETguy-a:DETwoman-sitting:VMODone-black:AMODpuppy-the:DETshow-tv:NNcreature-the:DET

457 pet,dog,rabbitkitty,orange,catsfeline,kitten,animalsdogs,white,cutestanding,animal,cat

dog-house:PREP INfence-the:DETshelter-animal:NNdogs-cats:CONJ ANDcat-street:NNdogs-two:NUMroot-dogs:ROOTcute-a:DETone-dogs:PREP OFcats-the:DETcute-dog:DOBJdog-street:NNdog-water:PREP INwatching-birds:DOBJdog-cute:AMOD

458 mac,black,musicdisplay,apple,machost,graffiti,hotelcommercials,japanese,japanfamily,love,red

screen-the:DETscreen-computer:NNscreen-big:AMODroot-screen:ROOTsign-the:DETcomputer-the:DETscreen-video:AMODmonitor-the:DETscreen-tv:NNfront-of:PREPwindows-room:PREP INcomputer-a:DETbook-new:AMODscreen-blue:AMODboard-the:DET

Continued on next page

153

Page 154: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts459 racing,driver,united

formula,classic,sportrace,car,autosports,car,racesport,race,car

root-show:ROOTplate-license:NNshow-car:NSUBJroot-car:ROOTspotted-car:NSUBJshow-the:DETbuilding-d70:PREP INshow-building:PREP ATscheme-white:AMODred-white:CONJ ANDshow-car:NNcar-classic:AMODwindow-rear:AMODcar-police:NNparked-street:PREP ON

460 boston,buildings,boatscruise,port,europewindows,people,cloudslondon,sky,riverbig,sky,water

bridge-harbour:NNcrosses-river:DOBJcrosses-bridge:NSUBJhouse-opera:NNspans-bridge:NSUBJbridge-the:DETbridge-beautiful:AMODbridge-famous:AMODarches-the:DETview-bridge:PREP OFeye-london:NNpasses-bridge:PREP UNDERbridge-manhattan:NNbridge-background:PREP INbridge-avenue:NN

461 health,sky,cloudsenvironment,health,californiajet,clouds,militarycraft,plane,skylook,clouds,plane

tower-cell:NNsign-sky:PREP INsky-summer:NNpole-telephone:NNplane-sky:PREP INtower-phone:NNlines-power:NNpole-power:NNwires-the:DETplane-flying:DEPairplane-sky:PREP INroot-plane:ROOTpoles-telephone:NNfly-birds:NSUBJlooks-sky:NSUBJ

Continued on next page

154

Page 155: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts462 office,apple,mac

mac,office,photographyhome,interior,designroom,design,homekitchen,interior,design

root-desk:ROOToffice-home:NNdesk-room:PREP INdesk-computer:NNdesk-a:DETdesk-the:DETdesk-office:PREP INroom-computer:NNdesk-bedroom:PREP INkitchen-house:PREP INtable-chairs:CONJ ANDdesk-new:AMODdesk-office:NNcomputer-the:DEToffice-the:DET

463 trip,summer,peopleprotesters,london,politicsadventure,photography,valleysfaces,portrait,womanbrown,wood,girl

lot-parking:NNstanding-street:PREP INroot-visit:ROOTsitting-house:PREP IN FRONT OFman-hat:PREP INman-old:AMODbed-truck:NNride-a:DETride-train:NNroot-met:ROOTbed-truck:PREP OFriding-cars:PREP INroot-ben:ROOTroot-man:ROOTseat-front:AMOD

464 suits,girls,beachshooting,model,portraitjeep,girl,armycheerleader,sports,girlswoman,dress,model

ride-a:DETgirl-sexy:AMODroot-laura:ROOTgirl-shirt:PREP INgirl-teenage:AMODgirl-bikini:PREP INon-bridge:POBJwoman-young:NSUBJumbrella-white:AMODroot-sister:ROOTroot-friend:ROOThair-the:DETgirl-looking:VMODflower-hair:PREP INone-girls:PREP OF

Continued on next page

155

Page 156: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts465 formula,classic,sport

motorcycle,road,skymotorcycle,netherlands,nederlandriot,protesters,photojournalismengine,art,nature

show-car:NSUBJmotorcycle-a:DETroot-show:ROOTcar-classic:AMODowner-the:DETred-black:CONJ ANDbuilding-britannic:AMODshow-building:PREP ATbuilding-d70:PREP INtruck-fire:NNtruck-red:AMODshow-car:NNfair-street:NNmarket-central:AMODcap-the:DET

466 woods,landscape,skyfall,landscape,skyjeep,sky,bluebarn,trees,fieldhouse,landscape,trees

pond-the:DETslide-a:DETroot-land:ROOTbridge-creek:PREP OVERforest-the:DETlake-houses:DEPtree-willow:NNroot-truck:ROOTriver-little:AMODhouse-forest:PREP INmill-the:DETriver-white:AMODshot-window:PREP THROUGHcar-an:DETmiddle-forest:PREP OF

467 bike,motorcycle,racebicycle,motion,girlbicycle,track,artracing,horse,sportdriver,white,horse

bicycle-a:DETbasket-bike:NNbike-road:NNdog-basket:PREP INbike-mountain:NNbike-front:PREP INmotorcycle-a:DETride-bike:NSUBJride-to:AUXroot-ride:ROOTrace-a:DETstreet-busy:AMODgirls-little:AMODride-bike:DOBJrace-bike:NN

Continued on next page

156

Page 157: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts468 horse,argentina,field

horses,explore,animaluniform,world,historicwar,soldiers,protesthorse,red,white

horses-the:DEThorse-the:DEThorse-a:DETroot-horse:ROOTroot-horses:ROOTrace-the:DEThorses-field:PREP INhorse-black:AMODbarn-the:DETriding-horse:DOBJgame-ball:NNgame-a:DETcow-a:DETsecurity-the:DETclass-the:DET

469 auto,automobile,raceracing,cars,classiccars,racing,classicsport,race,carspeed,racing,car

car-toy:NNspotted-car:NSUBJcar-classic:AMODparked-car:NSUBJtruck-ford:NNshow-car:NNcar-new:AMODone-cars:PREP OFcar-field:PREP INwarehouse-brick:NNparked-street:PREP INparked-street:PREP ONcar-red:AMODcar-sitting:VMODcar-background:PREP IN

470 squirrel,california,funnycute,dog,puppyfunny,cute,naturerodent,nature,squirrelfun,dog,animal

sitting-fence:PREP ONmonkey-a:DETcage-a:DETcage-the:DEThouse-bird:NNbird-window:PREP INwindow-kitchen:NNfeeders-bird:NNfeeder-bird:NNbackyard-the:DETmonkey-little:AMODroot-pigeon:ROOTmonkey-the:DETtable-bird:NNbox-bird:NN

Continued on next page

157

Page 158: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts471 car,automobile,truck

driver,cars,autovehicle,cars,speedauto,automobile,raceautomobile,transportation,vintage

spotted-car:NSUBJcars-two:NUMparked-car:NSUBJcar-police:NNcar-street:PREP INcar-classic:AMODcar-white:AMODcars-many:AMODshow-car:NSUBJparked-street:PREP INseat-driver:POSSshow-car:NNcar-little:AMODparked-street:PREP ONwhile-car:NN

472 flying,california,pilotracing,horse,sportaviation,fighter,californiatennis,green,linesnsw,coast,signs

plate-home:NNseats-the:DETseats-house:PREP INpool-the:DETseats-box:NNbridge-walking:AMODwater-green:AMODsail-to:AUXwall-field:NNdeck-the:DETfield-center:NNbest-seats:DEPboats-wooden:AMODwalking-bridge:PREP OVERsail-the:DET

473 cute,dog,puppycat,kitten,kittygroom,sunset,womanpet,dog,rabbitpups,baby,pet

cat-cute:AMODroot-watches:ROOTwindow-shop:NNpuppy-a:DETdogs-two:NUMcow-a:DETfigure-out:PRTcat-street:NNshelter-animal:NNdog-street:NNcats-the:DETcat-house:PREP INroot-brother:ROOTroot-fat:ROOTroot-buddy:ROOT

Continued on next page

158

Page 159: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts474 flight,bird,birds

fighter,jet,planeaustralia,nature,wildlifewing,flight,aviationbooby,kauai,hawaii

root-seagull:ROOTroot-gull:ROOTseagull-a:DETflying-river:PREP OVERflying-bird:NSUBJroot-seagulls:ROOTegret-great:AMODbird-sky:PREP INbird-flying:XCOMPbird-flight:PREP INflying-lake:PREP OVERgull-a:DETflying-house:DOBJbird-flying:VMODflying-beach:PREP OVER

475 boat,lake,bluecraft,handmade,dressitaly,pet,natureflight,plane,aviationphoto,portrait,people

bag-plastic:AMODbox-newspaper:NNroot-tank:ROOTbucket-a:DETshape-good:AMODtable-chairs:CONJ ANDwater-rain:NNroot-pot:ROOTtrash-the:DETsurface-a:DETmetal-the:DETwash-to:AUXfilled-water:PREP WITHdoor-car:NNtub-hot:AMOD

476 dogs,funny,cutehorses,portrait,animaldog,animals,explorefunny,cute,naturepuppy,baby,animals

bag-the:DETroot-ginger:ROOTbag-sleeping:AMODroot-sleeps:ROOTsleeping-basket:PREP INcat-bag:PREP INcats-two:NUMroot-cats:ROOTchair-office:PREP INhouse-cat:NNsitting-basket:PREP INtaking-nap:DOBJpuppy-cute:AMODpillow-a:DETsleeping-sun:PREP IN

Continued on next page

159

Page 160: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts477 roadblock,protest,london

demonstration,paris,policeparade,seattle,officersphotojournalism,color,olympusriot,photojournalism,color

shirt-red:AMODgirl-red:PREP INboy-red:PREP INbottles-water:PREP OFrace-a:DETroot-men:ROOTpants-the:DETman-shirt:PREP INgirls-school:NNwomen-the:DETroot-team:ROOTroot-club:ROOTgirls-young:AMODcoat-red:AMODpants-red:AMOD

478 motorcycle,road,skyracing,classic,carsformula,historic,classictrack,formula,racesport,race,car

race-the:DETsuit-the:DETboys-blue:PREP INspotted-car:NSUBJmotorcycle-a:DETrace-mountain:NNrace-a:DETmachine-green:AMODroot-show:ROOTrace-bike:NNroot-stage:ROOTshow-car:NNtrucks-the:DETbags-the:DETparked-street:PREP ON

479 vacation,europe,bluewashington,snow,treesapartments,pool,swimmingsunlight,trees,architecturepoliticians,bush,washington

bridge-beautiful:AMODhouse-white:AMODstreet-house:PREP FROMroot-row:ROOTremember-do:AUXdc-washington:NNbalcony-hotel:NNrow-a:DETfence-picket:NNgoes-bridge:NSUBJwindow-bus:NNbuilding-wooden:AMODbuilding-largest:AMODlive-in:PRTbuilding-little:AMOD

Continued on next page

160

Page 161: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts480 red,light,colors

flags,america,architecturestripes,lines,bluevehicle,vintage,automobilemontreal,red,subway

garage-parking:NNroot-chairs:ROOTred-blue:CONJ ANDflag-american:AMODroot-clothes:ROOTred-white:AMODpaint-the:DETwhile-car:NNsubway-the:DETchairs-beach:NNroot-rail:ROOTred-white:CONJ ANDsite-construction:NNroot-work:ROOTsign-park:PREP IN

481 tollbooth,illinois,chicagoriot,world,italyontario,mall,cityprotest,france,protestersroadblock,protest,london

street-city:PREP INbus-tour:NNscene-street:NNsign-green:AMODstreet-main:AMODbuses-the:DETwalking-street:DOBJsign-background:PREP INroad-busy:AMODcastle-background:PREP INbuilding-background:PREP INmiddle-street:PREP OFstation-bus:NNpictures-pictures:NSUBJroad-beach:NN

482 road,city,peopletollbooth,illinois,chicagotokyo,buildings,nightriot,world,italyurban,skyline,sky

sign-blue:AMODbuilding-blue:AMODbuilding-distance:PREP INview-street:PREP OFroad-busy:AMODstreet-house:PREP NEARview-street:NNdowntown-the:DETbuilding-background:PREP INroad-ring:NNbuilding-brown:AMODbuilding-black:AMODtower-distance:PREP INbuilding-green:AMODroot-city:ROOT

Continued on next page

161

Page 162: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts483 sewing,country,doll

shore,natural,blueunderwater,dive,naturecraft,handmade,dressangel,fish,water

blue-white:CONJ ANDblue-dark:AMODtank-water:NNgreen-dark:AMODwire-chicken:NNbag-market:NNsitting-garden:PREP INshell-a:DETmade-glass:PREP OFroot-basket:ROOTsilver-the:DETgrill-the:DETtable-garden:PREP INtank-a:DEThouse-yard:PREP IN

484 dogs,funny,cutepuppy,baby,animalsdog,animals,explorecute,dog,puppycats,kitten,pets

girl-bed:PREP INpillow-a:DETanimals-the:DETdog-brown:AMODroot-sleeps:ROOTcat-bag:PREP INbed-room:PREP INchair-pink:AMODnap-a:DETpig-the:DETroot-cats:ROOTroot-nap:ROOTchair-bag:NNbanks-outer:NNrunning-house:PREP AROUND

485 cat,kitten,kittycats,kitten,petskitty,orange,catspet,dog,rabbitkitten,fun,jump

cats-black:AMODtree-cat:NNcat-black:AMODroot-loves:ROOTcats-two:NUMsitting-box:PREP INroot-cats:ROOTcat-kitchen:PREP INplaying-basket:PREP INcat-house:NNcat-box:PREP INcats-playing:DEPloves-cat:NSUBJcats-the:DETbox-new:AMOD

Continued on next page

162

Page 163: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts486 park,animal,wildlife

big,animal,wildlifelong,white,hairtusks,nature,safariafrican,animal,zoo

root-lion:ROOTpony-a:DETcave-a:DETelephant-baby:NNelephant-a:DETroot-cave:ROOTlion-a:DETlion-the:DETsprings-hot:NNelephant-male:AMODlion-female:AMODwild-the:DETold-year:NPADVMODbear-black:AMODcub-the:DET

487 roadblock,water,treeroad,clouds,landscaperoad,forest,europetaiwan,green,architectureairport,runway,sky

root-roads:ROOTline-white:AMODbridge-road:PREP OVERroad-bridge:DEPover-bridge:POBJroad-front:PREP INfrom-bridge:POBJcows-road:PREP INroad-long:AMODroad-the:DETbridge-distance:PREP INroad-house:PREP TOroad-house:PREP BYview-road:PREP OFbridge-lake:DOBJ

488 adult,bird,birdssummer,river,seafab,animal,animalsscotland,nature,cowwaterfall,creek,moss

pot-plant:NNduck-black:AMODcat-garden:PREP INbird-sitting:VMODrica-costa:NNbath-bird:NNbasking-sun:PREP INbird-white:AMODbird-water:NNone-birds:PREP OFhouse-tropical:AMODsitting-fence:PREP ONmade-home:DOBJtree-banana:NNhangs-out:PRT

Continued on next page

163

Page 164: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts489 natural,trees,tree

fall,park,waterengland,green,waterportland,lights,microphonesphotographer,people,photographers

root-met:ROOTyoung-girl:DEPboy-blue:PREP INgame-ball:NNsmile-a:DETin-shirt:POBJroot-visit:ROOTone-girls:PREP OFflower-hair:PREP INcute-boy:DOBJin-car:POBJgirl-coat:PREP INgreens-the:DEThome-bus:NNroot-smile:ROOT

490 suburban,car,wildhospital,people,californiadrawing,nature,colorscake,groom,partyhome,interior,design

chair-green:AMODchair-pink:AMODroot-students:ROOTstudents-the:DETtable-train:NNgirl-chair:PREP INhome-new:AMODin-office:POBJchair-orange:AMODbags-the:DETboy-box:PREP INbox-big:AMODguitar-a:DETchair-room:PREP INmovie-a:DET

491 cow,rural,skypups,baby,petdog,beach,watercows,england,exploresheep,dog,white

root-dogs:ROOTcow-a:DETroot-cow:ROOTwalking-dogs:DOBJdog-service:NNhorse-white:AMODdog-white:AMODgirl-dog:CONJ ANDcow-the:DETdogs-the:DETfamily-foster:AMODretriever-golden:AMODtaken-family:AGENTboy-dog:CONJ ANDhorses-white:AMOD

Continued on next page

164

Page 165: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts492 ruins,asia,decay

roof,window,redvillage,spain,windowsjapanese,garden,redworld,germany,berlin

walls-city:NNwalls-old:AMODwalls-the:DETwall-old:AMODwall-castle:PREP OFwalls-castle:PREP OFwall-garden:PREP INwall-stone:NNwall-castle:NNwall-city:NNbase-tower:PREP OFbricks-the:DETpart-wall:PREP OFwall-ancient:AMODwall-a:DET

493 sails,sailboat,sailsailboat,ship,blueboat,sail,sailingsailboat,sails,sailboats,ships,ship

root-sail:ROOTsail-boat:DOBJboat-sail:AMODsailboat-a:DETboats-sail:AMODsail-to:AUXone-boats:PREP OFboat-blue:AMODsail-the:DETboat-river:PREP INlake-clear:NNboat-harbor:PREP INboat-tour:NNriver-phraya:NNraces-boat:NN

494 historical,fun,traditionalparis,panorama,polardrum,festival,rocklondon,people,protestrock,music,concert

looks-on:PRTband-the:DETroot-father:ROOTroot-band:ROOTtruck-a:DETreflection-window:NNband-rock:NNroot-mike:ROOTlight-window:PREP FROMmodel-the:DETwindow-bar:NNgirl-mirror:PREP INreflection-window:PREP INjacket-black:AMODguy-sitting:VMOD

Continued on next page

165

Page 166: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts495 house,home,interior

wow,light,peopleprison,orange,womanretro,black,portraitlights,street,people

me-front:PREP INstanding-girl:NNstanding-me:NSUBJroot-standing:ROOTstanding-front:PREP INshoes-white:AMODskirt-the:DETdress-blue:AMODstanding-around:PRTboy-white:AMODroot-ladies:ROOTgirls-black:PREP INfloor-dance:NNdress-black:AMODlady-dress:PREP IN

496 bike,motorcycle,racemotorcycle,motion,asiabicycle,motion,girlofficers,motorcycle,peoplemotorcycle,road,sky

bike-front:PREP INbicycle-a:DETroot-ride:ROOTrace-a:DETbike-road:NNride-bike:NSUBJdog-basket:PREP INride-to:AUXtour-bike:NNride-bike:DOBJbike-mountain:NNhorse-drawn:VMODcap-the:DETmotorcycle-a:DETtruck-white:AMOD

497 subway,people,graffiticabin,airplane,planetelephones,night,redtollbooth,car,lightsunderground,people,street

booth-a:DETbooth-telephone:NNphone-a:DETsign-yellow:AMODmachine-green:AMODbox-phone:NNbooth-phone:NNroot-machine:ROOTbooth-the:DETmachine-a:DETtrain-sky:NNoffice-box:NNdog-hot:AMODroot-phone:ROOTmachine-vending:AMOD

Continued on next page

166

Page 167: Supplementary Material B - ConceptLearner: Discovering ...conceptlearner.csail.mit.edu/suppB.pdf · Supplementary Material B - ConceptLearner: Discovering Visual Concepts from Weakly

Table1 – continued from previous pageIndex Image NUS-WIDE Concepts SBU Concepts498 track,locomotive,engine

train,engine,steamrailway,bridge,steamauto,truck,canadarail,engine,steam

train-freight:NNcanal-ship:NNcar-abandoned:AMODtrain-an:DETpasses-bridge:PREP UNDERroot-heads:ROOTtrain-road:NNyard-train:NNroot-truck:ROOTtruck-an:DETtown-historic:NNtruck-a:DETroot-rolls:ROOTroot-train:ROOTtrucks-the:DET

499 trip,summer,peoplewow,light,peopledog,beach,waterwings,bird,skywar,world,army

root-display:ROOTfish-fresh:AMODroot-show:ROOTshow-car:NNmarket-japan:PREP INfair-street:NNdisplay-window:NSUBJstore-shoe:NNroot-vendor:ROOTwindow-shop:NNshop-shoe:NNpink-black:CONJ ANDjob-a:DETshow-a:DETmarket-place:NN

500 bus,abandoned,cloudscar,automobile,truckautomobile,truck,californiaauto,truck,canadavintage,car,classic

car-an:DETone-cars:PREP OFcar-old:AMODparked-car:NSUBJparked-street:PREP INcar-classic:AMODbus-school:NNcar-abandoned:AMODroot-van:ROOTcar-street:PREP INparked-street:PREP ONcar-sitting:VMODroot-coach:ROOTcars-old:AMODcar-vintage:AMOD

167