1
Mesh Ensemble Motion Graphs Doug L. James Christopher D. Twigg Andrew Cove Carnegie Mellon University Robert Y. Wang Massachusetts Institute of Technology Figure 1: Mesh ensemble motion graph examples synthesized in real time and without nonphysical interpenetrations. All examples have several thousand compressed degrees of freedom, and resulted from expensive thin-shell finite element simulations with robust contact handling. Abstract We describe a technique for using space-time cuts to smoothly tran- sition between stochastic mesh animation clips while subject to physical noninterpenetration constraints. These transitions are used to construct Mesh Ensemble Motion Graphs for interactive data- driven animation of high-dimensional mesh animation datasets, such as those arising from expensive physical simulations of de- formable objects blowing in the wind (see Figure 1). We formulate the transition computation as an integer programming problem, and use a novel randomized algorithm to compute transitions subject to noninterpenetration constraints. 1 Asynchronous Mesh Transitions Compressed mesh animations are attractive for real-time hardware- accelerated playback of complex mesh deformation phenomena that is otherwise too expensive to compute on the fly [James and Twigg 2005]. Mesh ensembles with numerous distributed mesh elements, such as a garden of flowers or thousands of colliding flags driven by stochastic wind forces, provide a challenge for data- driven animation given the intrinsically high-dimensional dynamic phenomena. However, such examples are appealing candidates for interactive data-driven animation given the high cost of simulation using robust contact handling [Bridson et al. 2002]. Motion graph techniques [Kovar et al. 2002; Lee et al. 2002] provide the basic abstraction for data-driven animation, yet simply splicing together motion clips (to loop or transition within the dataset) leads to tran- sition artifacts, since in high dimensional state spaces it is exceed- ingly rare to find close transitions, and synchronized transitions in- troduce undesirable errors with strong spatial correlation. To overcome these limitations, we allow asychonous transitions whereby each mesh subgroup can transition at a different frame so as to minimize its transition error (see Figure 2). In practice this is easily achieved by minimizing a separable objective function Φ( τ ) that measures the smoothness of the transition as a function of each of the G mesh groups’ transition offset times, τ Z G . Given a tran- sition τ , we exploit tree-structured scene kinematics to reconstruct the scene shape during the asynchronous transition. Figure 2: Asynchronous transitions allow scene components to transi- tion at slightly different times–yellow indicates mesh groups undergoing transitions–and thus avoid transition artifacts by (i) reducing total transi- tion error, and (ii) diffusing group transition errors in both space and time. 2 Noninterpenetration Constraint Programming Although asynchronous mesh ensemble transitions are conceptu- ally similar to space-time cut techniques used for video-based ren- dering [Kwatra et al. 2003], mesh animations have the added com- plexity of a 3D embedding for which not all shape configurations are feasible due to interpenetrations. Unfortunately, allowing mesh groups to transition any time they desire can lead to low-quality animations with substantial and unsightly interpenetration artifacts. We address this by minimizing the transition cost function for τ subject to geometric noninterpenetration constraints between all ensemble mesh groups. We first compute the unconstrained min- imum and detect unsatisfied noninterpenetration constraints. Next we apply an iterative local search strategy to randomly sample com- ponents of τ associated with unsatisfied noninterpenetration con- straints. When the list of known interpenetration constraints has been emptied, new unsatisfied constraints are computed by per- forming collision detection on randomly sampled frames from the transition. Similar to other randomized constraint programming techniques [Selman et al. 1996], we either eventually find a fea- sible τ that eliminates all existing interpenetrations, or we time-out and investigate other transition opportunities. Deformable collision detection is optimized by exploiting the compressed shape repre- sentation [James and Twigg 2005], as well as sparse functional dependencies of the noninterpenetration constraints on τ . Thus, in a fraction of the time required to compute the original high- quality robust-contact physically based animations, we can com- pute noninterpenetrating asynchronous transitions to build Mesh Ensemble Motion Graphs for interactive animation of complex high-dimensional, deformation phenomena. References BRIDSON, R., FEDKIW, R. P., AND ANDERSON, J. 2002. Robust Treatment of Colli- sions, Contact, and Friction for Cloth Animation. ACM Transactions on Graphics 21, 3 (July), 594–603. JAMES, D. L., AND TWIGG, C. D. 2005. Skinning Mesh Animations. ACM Trans- actions on Graphics 24, 3 (Aug.), 399–407. KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion Graphs. ACM Transac- tions on Graphics 21, 3 (July), 473–482. KWATRA, V., SCH ¨ ODL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. GraphCut Textures: Image and Video Synthesis Using Graph Cuts. ACM Transactions on Graphics 22, 3 (July), 277–286. LEE, J., CHAI , J., REITSMA, P. S. A., HODGINS, J. K., AND POLLARD, N. S. 2002. Interactive Control of Avatars Animated With Human Motion Data. ACM Transactions on Graphics 21, 3 (July), 491–500. SELMAN, B., KAUTZ, H., AND COHEN, B. 1996. Local search strategies for sat- isfiability testing. In DIMACS Series in Discrete Mathematics and Theoretical Computer Science, vol. 26. American Mathematical Society, 521–532.

Mesh Ensemble Motion Graphs - Computer graphicsgraphics.cs.cmu.edu/projects/memg/memgSketch.pdf · Mesh Ensemble Motion Graphs ... Figure 1: Mesh ensemble motion graph examples synthesized

  • Upload
    lyngoc

  • View
    227

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Mesh Ensemble Motion Graphs - Computer graphicsgraphics.cs.cmu.edu/projects/memg/memgSketch.pdf · Mesh Ensemble Motion Graphs ... Figure 1: Mesh ensemble motion graph examples synthesized

Mesh Ensemble Motion Graphs

Doug L. James Christopher D. Twigg Andrew CoveCarnegie Mellon University

Robert Y. WangMassachusetts Institute of Technology

Figure 1: Mesh ensemble motion graph examples synthesized in real time and without nonphysical interpenetrations. All examples have several thousandcompressed degrees of freedom, and resulted from expensive thin-shell finite element simulations with robust contact handling.

AbstractWe describe a technique for using space-time cuts to smoothly tran-sition between stochastic mesh animation clips while subject tophysical noninterpenetration constraints. These transitions are usedto construct Mesh Ensemble Motion Graphs for interactive data-driven animation of high-dimensional mesh animation datasets,such as those arising from expensive physical simulations of de-formable objects blowing in the wind (see Figure 1). We formulatethe transition computation as an integer programming problem, anduse a novel randomized algorithm to compute transitions subject tononinterpenetration constraints.

1 Asynchronous Mesh TransitionsCompressed mesh animations are attractive for real-time hardware-accelerated playback of complex mesh deformation phenomenathat is otherwise too expensive to compute on the fly [James andTwigg 2005]. Mesh ensembles with numerous distributed meshelements, such as a garden of flowers or thousands of collidingflags driven by stochastic wind forces, provide a challenge for data-driven animation given the intrinsically high-dimensional dynamicphenomena. However, such examples are appealing candidates forinteractive data-driven animation given the high cost of simulationusing robust contact handling [Bridson et al. 2002]. Motion graphtechniques [Kovar et al. 2002; Lee et al. 2002] provide the basicabstraction for data-driven animation, yet simply splicing togethermotion clips (to loop or transition within the dataset) leads to tran-sition artifacts, since in high dimensional state spaces it is exceed-ingly rare to find close transitions, and synchronized transitions in-troduce undesirable errors with strong spatial correlation.

To overcome these limitations, we allow asychonous transitionswhereby each mesh subgroup can transition at a different frame soas to minimize its transition error (see Figure 2). In practice this iseasily achieved by minimizing a separable objective function Φ(�τ)that measures the smoothness of the transition as a function of eachof the G mesh groups’ transition offset times,�τ ∈Z

G. Given a tran-sition �τ , we exploit tree-structured scene kinematics to reconstructthe scene shape during the asynchronous transition.

Figure 2: Asynchronous transitions allow scene components to transi-tion at slightly different times–yellow indicates mesh groups undergoingtransitions–and thus avoid transition artifacts by (i) reducing total transi-tion error, and (ii) diffusing group transition errors in both space and time.

2 Noninterpenetration Constraint ProgrammingAlthough asynchronous mesh ensemble transitions are conceptu-ally similar to space-time cut techniques used for video-based ren-dering [Kwatra et al. 2003], mesh animations have the added com-plexity of a 3D embedding for which not all shape configurationsare feasible due to interpenetrations. Unfortunately, allowing meshgroups to transition any time they desire can lead to low-qualityanimations with substantial and unsightly interpenetration artifacts.We address this by minimizing the transition cost function for �τsubject to geometric noninterpenetration constraints between allensemble mesh groups. We first compute the unconstrained min-imum and detect unsatisfied noninterpenetration constraints. Nextwe apply an iterative local search strategy to randomly sample com-ponents of �τ associated with unsatisfied noninterpenetration con-straints. When the list of known interpenetration constraints hasbeen emptied, new unsatisfied constraints are computed by per-forming collision detection on randomly sampled frames from thetransition. Similar to other randomized constraint programmingtechniques [Selman et al. 1996], we either eventually find a fea-sible�τ that eliminates all existing interpenetrations, or we time-outand investigate other transition opportunities. Deformable collisiondetection is optimized by exploiting the compressed shape repre-sentation [James and Twigg 2005], as well as sparse functionaldependencies of the noninterpenetration constraints on �τ . Thus,in a fraction of the time required to compute the original high-quality robust-contact physically based animations, we can com-pute noninterpenetrating asynchronous transitions to build MeshEnsemble Motion Graphs for interactive animation of complexhigh-dimensional, deformation phenomena.

References

BRIDSON, R., FEDKIW, R. P., AND ANDERSON, J. 2002. Robust Treatment of Colli-sions, Contact, and Friction for Cloth Animation. ACM Transactions on Graphics21, 3 (July), 594–603.

JAMES, D. L., AND TWIGG, C. D. 2005. Skinning Mesh Animations. ACM Trans-actions on Graphics 24, 3 (Aug.), 399–407.

KOVAR, L., GLEICHER, M., AND PIGHIN, F. 2002. Motion Graphs. ACM Transac-tions on Graphics 21, 3 (July), 473–482.

KWATRA, V., SCHODL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. GraphCutTextures: Image and Video Synthesis Using Graph Cuts. ACM Transactions onGraphics 22, 3 (July), 277–286.

LEE, J., CHAI, J., REITSMA, P. S. A., HODGINS, J. K., AND POLLARD, N. S.2002. Interactive Control of Avatars Animated With Human Motion Data. ACMTransactions on Graphics 21, 3 (July), 491–500.

SELMAN, B., KAUTZ, H., AND COHEN, B. 1996. Local search strategies for sat-isfiability testing. In DIMACS Series in Discrete Mathematics and TheoreticalComputer Science, vol. 26. American Mathematical Society, 521–532.