When robots open their eyes

  • View
    340

  • Download
    0

Embed Size (px)

Transcript

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    When robots open their eyes...

    Xavier Gir-i-Nieto

    @DocXavi

    Versi 2016/2

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)2

    Introduction

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)3

    Densely linked slides

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)4

    Acknowledgements

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Why studying engineering ?

    5Source: University degrees with higher employment rate in Span (El Pas, 22/12/2015)

    http://elpais.com/elpais/2015/12/22/media/1450786621_713557.html

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)6

    Source: University degrees with higher employment rate in Span (El Pas, 22/12/2015)

    Why studying engineering ?

    http://elpais.com/elpais/2015/12/22/media/1450786621_713557.html

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)7

    Source: 25 Best jobs in America (Glassdoor)

    IT degrees (telecommunication and computer science) are the closest ones to the best job: Data scientist.

    Why studying IT ?

    https://www.glassdoor.com/Best-Jobs-in-America-LST_KQ0,20.htm

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Where are the robots ?

    Nexi, del MIT Media Lab (Foto: Spencer Lowel)

    http://robotic.media.mit.edu/portfolio/nexi/http://robotic.media.mit.edu/portfolio/nexi/

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Li Fei-Fei, How were teaching computers to understand pictures TEDTalks 2014.

    Where are the robots ?

    https://www.ted.com/talks/fei_fei_li_how_we_re_teaching_computers_to_understand_pictures?language=enhttps://www.ted.com/talks/fei_fei_li_how_we_re_teaching_computers_to_understand_pictures?language=enhttps://www.ted.com/talks/fei_fei_li_how_we_re_teaching_computers_to_understand_pictures?language=enhttp://www.youtube.com/watch?v=40riCqvRoMs

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Font: Andrej Karpathy, What I learned from competing against a computer on ImageNet (2014)

    Where are the robots ?

    http://karpathy.github.io/2014/09/02/what-i-learned-from-competing-against-a-convnet-on-imagenet/

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Source: Andrej Karpathy, What I learned from competing against a computer on ImageNet (2014)

    Where are the robots ?

    http://karpathy.github.io/2014/09/02/what-i-learned-from-competing-against-a-convnet-on-imagenet/

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Font: Andrej Karpathy, What I learned from competing against a computer on ImageNet (2014)

    Where are the robots ?

    http://karpathy.github.io/2014/09/02/what-i-learned-from-competing-against-a-convnet-on-imagenet/

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278-2324.

    Machine learning(Deep learning)

    Where are the robots ?

    http://yann.lecun.com/exdb/publis/pdf/lecun-01a.pdfhttp://yann.lecun.com/exdb/publis/pdf/lecun-01a.pdfhttp://yann.lecun.com/exdb/publis/pdf/lecun-01a.pdf

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Krizhevsky, Alex, Ilya Sutskever, and Geoffrey E. Hinton. "Imagenet classification with deep convolutional neural networks." In Advances in neural information processing systems, pp. 1097-1105. 2012

    Where are the robots ?

    http://papers.nips.cc/paper/4824-imagenet-classification-whttp://papers.nips.cc/paper/4824-imagenet-classification-whttp://papers.nips.cc/paper/4824-imagenet-classification-w

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Object detection

    Girshick, Ross, Jeff Donahue, Trevor Darrell, and Jitendra Malik. "Region-based convolutional networks for accurate object detection and segmentation." Pattern Analysis and Machine Intelligence, IEEE Transactions on 38, no. 1 (2016): 142-158.

    Where are the robots ?

    http://www.cs.berkeley.edu/~rbg/papers/pami/rcnn_pami.pdfhttp://www.cs.berkeley.edu/~rbg/papers/pami/rcnn_pami.pdfhttp://www.cs.berkeley.edu/~rbg/papers/pami/rcnn_pami.pdf

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Object segmentation

    Source: Pascal Visual Object Challenge

    Where are the robots ?

    http://pascallin.ecs.soton.ac.uk/challenges/VOC/voc2012/segexamples/index.html

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Face detection and recognition

    Farfade, Sachin Sudhakar, Mohammad Saberian, and Li-Jia Li. "Multi-view Face Detection Using Deep Convolutional Neural Networks." ICMR (2015).

    Where are the robots ?

    http://arxiv.org/abs/1502.02766http://arxiv.org/abs/1502.02766http://arxiv.org/abs/1502.02766

  • ETSE

    TB (B

    arce

    lona

    ) / E

    TSEI

    AA

    T (T

    erra

    ssa)

    Uni

    vers

    itat P

    olit

    cnic

    a de

    Cat

    alun

    ya (U

    PC)

    Xavier Gir i Nieto, When robots open their eyes.... UPC Outreach Programme (February 2016)

    Activity Recognition

    Tran, Du, Lubomir Bourdev, Rob Fergus, Lorenzo Torresani, and Manohar Paluri. "Learning spatiotemporal features with 3D convolutional networks." In Proc