Search by logosSearch by logosuse case for Layar Visionuse case for Layar Vision

Dmitry Namiot Dmitry Namiot dnamiot@gmail.comdnamiot@gmail.com

Lomonosov Moscow State Lomonosov Moscow State UniversityUniversity

IntroductionIntroduction

Our conception shortly:Our conception shortly:

Search nearby things (places) with Search nearby things (places) with the same logo we can recognize via the same logo we can recognize via Layar VisionLayar Vision

ExampleExample

•Here is a typical ATMHere is a typical ATM

Example (cont.)Example (cont.)

• Each ATM has got bank’s logoEach ATM has got bank’s logo

Example (cont.)Example (cont.)

• Suppose you see ATM that does not Suppose you see ATM that does not work:work:

ModelModel

• How to find more ATMs for the same How to find more ATMs for the same bank nearby? bank nearby?

• Visual geo search – let us use bank’s Visual geo search – let us use bank’s logo as a key for searchlogo as a key for search

• Each search is a typical geo-layer. Each search is a typical geo-layer. We just need to know logo (name) for We just need to know logo (name) for getting to the proper geo-layergetting to the proper geo-layer

ModelModel

• Layar Vision enabled layer is a wrapper for Layar Vision enabled layer is a wrapper for several geo-layersseveral geo-layers

• As soon as the logo is recognized by Layar As soon as the logo is recognized by Layar Vision we can switch to the “standard” Vision we can switch to the “standard” geo-layer for this bankgeo-layer for this bank

• That switch could be performed manually That switch could be performed manually (as an action for the Layar Vision enabled (as an action for the Layar Vision enabled layer response) or simply via auto-trigger layer response) or simply via auto-trigger (we do not need some special response (we do not need some special response from Layar Vision enabled layer at all)from Layar Vision enabled layer at all)

The steps are:The steps are:

• Collect logos (two Russian banks in Collect logos (two Russian banks in this example)this example)

• Upload them to Layar in order to Upload them to Layar in order to train Layar Vision recognize themtrain Layar Vision recognize them

• Create “standard” geo-location layer Create “standard” geo-location layer for the each brand (each logo). for the each brand (each logo).

• Invoke (open) geo-layer in action Invoke (open) geo-layer in action defined for vision enabled layerdefined for vision enabled layer

How does it workHow does it work

• Vision enabled layer here is actually just a Vision enabled layer here is actually just a placeholder for geo-layersplaceholder for geo-layers

• Vision enabled layer can either display the Vision enabled layer can either display the recognized logo + action for switching to recognized logo + action for switching to the appropriate geo-layerthe appropriate geo-layer

• OROR

• Vision enabled layer can define auto-Vision enabled layer can define auto-trigger for geo-layer associated with the trigger for geo-layer associated with the recognized logorecognized logo

Technical detailsTechnical details

• We can use one endpoint for all We can use one endpoint for all supported requestssupported requests

• By default server side script returns By default server side script returns data for vision enabled layerdata for vision enabled layer

• In the parameterized requests it In the parameterized requests it returns POIs for geo-layersreturns POIs for geo-layers

ConclusionConclusion

• Visual geo search – go the AR layer Visual geo search – go the AR layer after getting the logo recognizedafter getting the logo recognized

• This concept demonstrates search This concept demonstrates search for ATMs by bank’s logofor ATMs by bank’s logo

• Could be extended of course to any Could be extended of course to any logo (logos)logo (logos)

• Analogue: logo here replaces QR-Analogue: logo here replaces QR-code with landing to search pagecode with landing to search page