54
May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh X. Nguyen Computer Science & Engineering Department University of Minnesota at Twin Cities http://www.cs.umn.edu/~baoquan This work is to appear in IEEE Visualization 2001

POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

May 17, 2001

POP: A Hybrid Point and Polygon Rendering System for Large Data

Baoquan ChenMinh X. Nguyen

Computer Science & Engineering DepartmentUniversity of Minnesota at Twin Cities

http://www.cs.umn.edu/~baoquan

This work is to appear in IEEE Visualization 2001

Page 2: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

2Baoquan Chen 2001 4 millions samples

Page 3: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

3Baoquan Chen 200114 millions samples

Page 4: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

4Baoquan Chen 2001

Volumetric DataVolumetric Data

MRICTPETUltrasonography

Confocal Microscopy

Micro-Tomography

Simulated DatasetsVoxelized

Page 5: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

5Baoquan Chen 2001

Mixing of Polygons and Volumes

Page 6: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

6Baoquan Chen 2001

Surface model Novel view

Key view

Texture mapping

Image-based Rendering

Filling holes(ray casting)

Page 7: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

7Baoquan Chen 2001

Architecture Design

UnifiedPipeline

Texture

Me

mo

ry

Page 8: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

8Baoquan Chen 2001

3D Volume Rotation

Page 9: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

9Baoquan Chen 2001

x

y

z

a y

b z

x beam shear:

x = x + a y + b z

Rotation by 4 2D Beam Shears

Page 10: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

10Baoquan Chen 2001

Rotation by 4 2D Beam Shears

original

1. y beam shear 2. z beam shear

3. x beam shear 4. y beam shear

Page 11: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

11Baoquan Chen 2001

x

y

z

a y

b y

y slice shear:

x = x + a yz = z + b y

Rotation by 4 2D Slice Shears

Page 12: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

12Baoquan Chen 2001

Rotation by 4 2D Slice Shears

1. y slice shear 2. z slice shear

3. x slice shear 4. y slice shear

original

Page 13: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

13Baoquan Chen 2001

x

y

z

b y

g z

a y x-beam y-slice shear:

Rotation by 3 2D Beam-Slice Shears

x = x + a y + g z z = z + b y

Page 14: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

14Baoquan Chen 2001

Rotation by 3 2D Beam-Slice Shears

3. y beam shear2. x beam y slice shear

1. y beam x slice shear

original

Page 15: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

15Baoquan Chen 2001

x

y

z

y-slice

z-slice

x-beamR = Sx Sz

3D 3D

Rotation by 2 3D Beam Shears

Page 16: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

16Baoquan Chen 2001

Rotation by 2 3D Beam Shears

original gazebo after interpolation

first 3D integer shear second 3D integer shear

Page 17: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

17Baoquan Chen 2001

POP System

Page 18: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

18Baoquan Chen 2001

Goals

•Maintain interactive frame rate for large models (108 – 109 samples) on commodity graphics hardware

+

Page 19: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

19Baoquan Chen 2001

Previous Systems (I)

•Level of detail representation and control [Funkhouser 93] [Duchaineau 97] [Hoppe 96, Hoppe 97][Xia 97] ……

Page 20: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

20Baoquan Chen 2001

Previous Systems (II)• Visibility Culling

[Greene & Kass 93][Zhang et al. 97] ……

Page 21: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

21Baoquan Chen 2001

Previous Systems (III)•Point representation and rendering

Levoy & Whitted 1985Shade, et al. 1998 (LDI)Grossman & Dally 1998Rusinkiewicz & Levoy 2000 (Qsplat)Pfister, et al. 2000 (Surfel)……

Wand, et al. 2001Zwicker, et al. 2001Pauly & Gross 2001

Page 22: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

22Baoquan Chen 2001

Qsplat (I)

•Place a sphere at each node, large enough to touch neighbor spheres

Page 23: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

23Baoquan Chen 2001

Qsplat (II)

•Build-up a bounding sphere hierarchy to facilitate efficient rendering

Page 24: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

24Baoquan Chen 2001

Surfel• A given mesh is sampled on multiresolution

rectilinear grids.• Points on the same level have the same size.

Page 25: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

25Baoquan Chen 2001

Problems (I)

Page 26: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

26Baoquan Chen 2001

Problems (II)

Polygon Point

Page 27: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

27Baoquan Chen 2001

PointsPolygons

Polygons vs. Points

Good for large, flat orsubtly curved regions

Good for models withdetail everywhere

Incremental rasterization Independent rasterization

LOD data structuresmore complex (expensive)

LOD data structures straightforward

Backward processing Forward processing

Connectivity ensuresinterpolation

No connectivitythus, holes/splats

Page 28: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

28Baoquan Chen 2001

POP system

PreprocessingView Information

Rendering Engine

Screen Image

MeshPreprocessed

Data

• Preprocessing: Build-up data hierarchy

• Rendering: traverse tree and render points or polygons

Page 29: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

29Baoquan Chen 2001

Hierarchical structure of POP

V 0V 2V 1 V 0V 4V 1 V 0V 3V 2V 0V 4V 3

V 2

V 1

V 3

V 4

V 0

Page 30: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

30Baoquan Chen 2001

QSplatPOP

POP vs. Qsplat

Works best when the faces of models have uniform size

The topology of the mesh is discarded

The topology of the mesh is partially kept

Works for arbitrary models

Page 31: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

31Baoquan Chen 2001

Node Structure

3RVLWLRQDQG

5DGLXV)ODJV 1RUPDO

:LGWK�RI&RQH�RI1RUPDOV

&RORU�2SWLRQDO�

V 0V 2V 1 V 0V 4V 1 V 0V 3V 2V 0V 4V 3

Page 32: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

32Baoquan Chen 2001

Node Structure

3RVLWLRQDQG

5DGLXV1RUPDO

:LGWK�RI&RQH�RI1RUPDOV

&RORU�2SWLRQDO�)ODJV

• Tight bounding sphere• Error can be accumulated• Compact representation

Page 33: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

33Baoquan Chen 2001

Node Structure

• Number of children (0, 2, 3, or 4)• Rendering flags

3RVLWLRQDQG

5DGLXV1RUPDO

:LGWK�RI&RQH�RI1RUPDOV

&RORU�2SWLRQDO�

)ODJV

Page 34: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

34Baoquan Chen 2001

Node Structure

• Average of children’s normals• Or, if leaf child, average of the normals

of the leaf triangle’s three vertices• Normal quantized to grid on faces of a

cube

3RVLWLRQDQG

5DGLXV1RUPDO

:LGWK�RI&RQH�RI1RUPDOV

&RORU�2SWLRQDO�

PPuuPPuu��

)ODJV

Page 35: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

35Baoquan Chen 2001

Node Structure

• Each node contains bounding cone ofchildren’s normals

• Hierarchical backface culling [Kumar 96]

3RVLWLRQDQG

5DGLXV1RUPDO

:LGWK�RI&RQH�RI1RUPDOV

&RORU�2SWLRQDO�

)ODJV

CulledCulled Not CulledNot Culled

9LHZHU

Page 36: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

36Baoquan Chen 2001

Node Structure

• The intermediate node color is the average of children nodes’ colors

• The leaf node color is the average of the whole triangle (pre-texture mapping)

3RVLWLRQDQG

5DGLXV1RUPDO

:LGWK�RI&RQH�RI1RUPDOV

&RORU�2SWLRQDO�

)ODJV

Page 37: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

37Baoquan Chen 2001

Rendering Algorithm (I)

•T raverse hierarchy recursively

LI��QRGH�QRW�YLVLEOH�LI��QRGH�QRW�YLVLEOH�6NLS�WKLV�EUDQFK6NLS�WKLV�EUDQFK

HOVH�LI��OHDI�QRGH�HOVH�LI��OHDI�QRGH�'UDZ�D�WULDQJOH'UDZ�D�WULDQJOH

HOVH�LI��VL]H�RQ�VFUHHQ���WKUHVKROG�HOVH�LI��VL]H�RQ�VFUHHQ���WKUHVKROG�'UDZ�D�VSODW'UDZ�D�VSODW

HOVHHOVH7UDYHUVH�FKLOGUHQ7UDYHUVH�FKLOGUHQ

+LHUDUFKLFDO�IUXVWXP��+LHUDUFKLFDO�IUXVWXP��EDFNIDFH�FXOOLQJEDFNIDFH�FXOOLQJ

$GMXVWHG�WR�PDLQWDLQ$GMXVWHG�WR�PDLQWDLQGHVLUHG�IUDPH�UDWHGHVLUHG�IUDPH�UDWH

/HYHO�RI�GHWDLO/HYHO�RI�GHWDLOFRQWUROFRQWURO

7ULDQJOH�UHQGHULQJ7ULDQJOH�UHQGHULQJ

3RLQW�UHQGHULQJ3RLQW�UHQGHULQJ

Page 38: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

38Baoquan Chen 2001

Rendering Algorithm (II)

• Utilize coherence

– RHFRUG�QRGHV�WKDW�DUH�GLVSOD\HG�IRU�HFRUG�QRGHV�WKDW�DUH�GLVSOD\HG�IRU�WKH�SUHYLRXV�IUDPHWKH�SUHYLRXV�IUDPH

²² 6WDUW�WKH�WUHH�WUDYHUVDO�IURP�WKHVH�6WDUW�WKH�WUHH�WUDYHUVDO�IURP�WKHVH�QRGHVQRGHV

Page 39: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

39Baoquan Chen 2001

Source image

Target image

High Quality Texture Mapping

Page 40: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

40Baoquan Chen 2001

magnification

mixed

minification

mixed

Four-Region Subdivision

Page 41: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

41Baoquan Chen 2001

Forward Footprint Projection (Splatting)

Source image Target image

Texture Mapping Methods (I)

ExpensiveExpensive(Ellipsoid evaluation)(Ellipsoid evaluation)

Page 42: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

42Baoquan Chen 2001

Forward Point Projection

Source image Target image

Texture Mapping Methods (II)

•• Efficient (Circular filter)Efficient (Circular filter)•• Good forGood for minificationminification

regionregion

Page 43: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

43Baoquan Chen 2001

Backward Footprint Projection (EWA)

Source image Target image

Texture Mapping Methods (III)

ExpensiveExpensive(Ellipsoid evaluation)(Ellipsoid evaluation)

Page 44: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

44Baoquan Chen 2001

Backward Point Projection (BiLin or MIPMAP)

Source image Target image

Texture Mapping Methods (IV)

•• Efficient (Efficient (bibi-- or trior tri--linear interpolationlinear interpolation))

•• Good for magnification Good for magnification regionregion

Page 45: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

45Baoquan Chen 2001

•• For For minificationminification region: forward point region: forward point projection (projection (splattingsplatting) )

•• For magnification region: backward For magnification region: backward point projectionpoint projection

Hybrid Order Rendering

Point renderingPoint rendering

Polygon renderingPolygon rendering

Page 46: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

46Baoquan Chen 2001

Backward Bilinear Interpolation

AliasingAliasing

Good qualityGood quality

Page 47: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

47Baoquan Chen 2001

Pure Point Rendering

Good qualityGood quality

Bad qualityBad quality

Page 48: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

48Baoquan Chen 2001

Hybrid Polygon-Point Rendering

Good qualityGood quality

Page 49: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

49Baoquan Chen 2001

Results

•Hardware: 800 MHZ Pentium III PC w/ 256 MB

•NVIDIA GeForce2 GTS

1,087,716 triangles654,666 triangles

Page 50: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

50Baoquan Chen 2001

Results

Page 51: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

51Baoquan Chen 2001QSplat POP

Results

Page 52: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

52Baoquan Chen 2001

QSplat POP

Results

Page 53: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

53Baoquan Chen 2001

Results

QSplatPOP

Thres = 1.0272,047 pts,255,708 tris,1.62fps

Thres = 1.0317,557 pts,

Page 54: POP: A Hybrid Point and Polygon Rendering System for Large … · 2015. 11. 25. · May 17, 2001 POP: A Hybrid Point and Polygon Rendering System for Large Data Baoquan Chen Minh

54Baoquan Chen 2001

Results

Thres = 2.0267,567 pts,48,143 tris,2.84 fps

Thres = 3.4147,263 pts,7,348 tris,5.43 fps

POPPOP QSplat

Thres = 1.0317,557 pts,