28
From Dusk till Dawn: Modeling in the Dark Filip Radenović Johannes L. Schönberger Dinghuang Ji Jan-Michael Frahm Ondřej Chum Jiří Matas CVPR 2016

From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

From Dusk till Dawn:Modeling in the Dark

Filip Radenović Johannes L. Schönberger Dinghuang JiJan-Michael Frahm Ondřej Chum Jiří Matas

CVPR 2016

Page 2: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Modeling in the Dark

Page 3: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Modeling in the Dark

We cannot do this, BUT…

Page 4: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Separate Day & Night Dense Reconstructions

Standard DenseDay & Night Images

Page 5: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Separate Day & Night Dense Reconstructions

Standard DenseDay & Night Images

Artifacts

Page 6: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Separate Day & Night Dense Reconstructions

Standard Dense

Day Dense

Night Dense

Day & Night Images

Artifacts

Clean

Clean

Page 7: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Separate Day & Night Dense Reconstructions

Standard Dense Day Dense Night Dense

Page 8: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Separate Day & Night Dense Reconstructions

Standard Dense Day Dense Night Dense

Artifacts

Page 9: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Separate Day & Night Dense Reconstructions

Standard Dense Day Dense Night Dense

Artifacts

Page 10: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Separate Day & Night Dense Reconstructions

Standard Dense Day Dense Night Dense

Artifacts

Page 11: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Day & Night Dense Models

Day ModelNight Model

Page 12: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Day & Night Dense Models

Day ModelNight Model

Page 13: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Fused Geometry

Geometric Fusion

Page 14: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Recoloring

Fused Geometry Night Illumination

Page 15: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Image Dataset

Clustering into Day & Night

Page 16: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Image Dataset

SfM Clustering

Sparse Model

Clustering into Day & Night

Page 17: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

Clustering into Day & Night

Page 18: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Clustering into Day & Night

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

• Images and 3D points in sparse scene graph

Page 19: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Clustering into Day & Night

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

• Images and 3D points in sparse scene graph

• Color histogram of images

Page 20: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Clustering into Day & Night

day day night night

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

• Images and 3D points in sparse scene graph

• Color histogram of images

• Graph-cut

Page 21: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

day day night night

Separate Dense Reconstruction of Day & Night

Day/Night Clusters

Day

Night

Dense Model

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

• Images and 3D points in sparse scene graph

• Color histogram of images

• Graph-cut

Page 22: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Day ModelNight Model

Geometric Fusion & RecoloringDay/Night Clusters

Day

Night

Dense Model

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

Page 23: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Geometric Fusion & Recoloring

• Merge point clouds

Day/Night Clusters

Day

Night

Dense Model

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

Page 24: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

Fused Geometry Night Illumination

Geometric Fusion & Recoloring

• Merge point clouds

Day/Night Clusters

Day

Night

Dense Model

Image Dataset

SfM Clustering

Day/Night ImagesScene GraphSparse Model

Page 25: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

• Automatic reconstruction of day & night images

Contributions

Page 26: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

• Automatic reconstruction of day & night images

• Geometric fusion of day & night dense models

Contributions

Page 27: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

• Automatic reconstruction of day & night images

• Geometric fusion of day & night dense models

• Color transfer to recolor unreconstructed areas

Contributions

Page 28: From Dusk till Dawn: Modeling in the Darkcmp.felk.cvut.cz/.../Radenovic-CVPR16presentation.pdf · CVPR 2016. Modeling in the Dark. Modeling in the Dark We cannot do this, BUT

ResultsDay Image Day Model Night Model Fused Night Model Night Image

See you at Spotlight Poster #21