22
Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Embed Size (px)

Citation preview

Page 1: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Relative Volume Constraintsfor 3D Image Editing

Computer Vision Group TU Munich

Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers

May 25th, 2012

Page 2: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 2

Single View Reconstruction

Single Image 3D Representation

New Lighting and Material

Page 3: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 3

Workflow

Graphcut-basedsegmentation1

1 Boykov, Jolly: Interactive graph cuts for optimal boundary region segmentation of objects in n-d images. ICCV ‘01

input image segmentation reconstruction final result

user strokes

interactiveadaption of

volume /smoothness

Page 4: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 4

Results

Page 5: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 5

Results

Page 6: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 6

Sharp Edges

Minimal Surfacewith Fixed Volume

The Same withLocal Smoothness Relaxation

Page 7: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 7

Relative Depth Profiles

Reconstruction withRelative Depth

Depth Profile indicatingRelative Depth

Page 8: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 8

Relative Depth Profiles

Reconstruction with Fixed Volume

Input Image

Page 9: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 9

Relative Depth Profiles

Reconstruction with Relative Depth Profile

Depth Profile indicatingRelative Depth

Page 10: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 10

Subvolume Ratios

Reconstruction with Relative Depth Profile

andSubvolume Ratio

User Drawn AreaIndicating Projected Subvolume

Page 11: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 11

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Page 12: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 12

Results

Reconstructions with New Constraints

Local Smoothness

Page 13: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 13

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Page 14: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 14

Results

Reconstructions with New Constraints

Page 15: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 15

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Page 16: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 16

Results

Reconstructions with New Constraints

Local Smoothness

Page 17: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 17

Results

Input Image

Page 18: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 18

Results

Reconstructions with New Constraints

Local Smoothness (User Input)

Page 19: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 19

Results

Input Image

Page 20: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 20

Results

Reconstructions with New Constraints

Local Smoothness (User Input)

Page 21: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 21

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Page 22: Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 22

Results

Reconstructions with New Constraints