Relative Volume Constraints for 3D Image Editing Computer Vision Group TU Munich Eno Töppe, Claudia...

Relative Volume Constraintsfor 3D Image Editing

Computer Vision Group TU Munich

Eno Töppe, Claudia Nieuwenhuis, Daniel Cremers

May 25th, 2012

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 2

Single View Reconstruction

Single Image 3D Representation

New Lighting and Material

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 3

Workflow

Graphcut-basedsegmentation1

1 Boykov, Jolly: Interactive graph cuts for optimal boundary region segmentation of objects in n-d images. ICCV ‘01

input image segmentation reconstruction final result

user strokes

interactiveadaption of

volume /smoothness

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 4

Results

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 5

Results

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 6

Sharp Edges

Minimal Surfacewith Fixed Volume

The Same withLocal Smoothness Relaxation

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 7

Relative Depth Profiles

Reconstruction withRelative Depth

Depth Profile indicatingRelative Depth

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 8

Relative Depth Profiles

Reconstruction with Fixed Volume

Input Image

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 9

Relative Depth Profiles

Reconstruction with Relative Depth Profile

Depth Profile indicatingRelative Depth

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 10

Subvolume Ratios

Reconstruction with Relative Depth Profile

andSubvolume Ratio

User Drawn AreaIndicating Projected Subvolume

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 11

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 12

Results

Reconstructions with New Constraints

Local Smoothness

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 13

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 14

Results

Reconstructions with New Constraints

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 15

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 16

Results

Reconstructions with New Constraints

Local Smoothness

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 17

Results

Input Image

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 18

Results

Reconstructions with New Constraints

Local Smoothness (User Input)

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 19

Results

Input Image

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 20

Results

Reconstructions with New Constraints

Local Smoothness (User Input)

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 21

Results

Input Image Reconstruction with Constant Volume

+Local Smoothness

Töppe, Nieuwenhuis, Cremers: Relative Volume Constraints for 3D Image Editing 22

Results

Reconstructions with New Constraints