Dynamic Shape Capture using Multi-View Photometric Stereo
ACM Trans. Graphics (Proc. SIGGRAPH Asia), December 2009

Our system rapidly acquires images under varying illumination in order to compute photometric normals from multiple viewpoints. The normals are then used to reconstruct detailed mesh sequences of dynamic shapes such as human performers.
Abstract
We describe a system for high-resolution capture of moving 3D geometry,
beginning with dynamic normal maps from multiple views.
The normal maps are captured using active shape-from-shading
(photometric stereo), with a large lighting dome providing a series
of novel spherical lighting configurations. To compensate for
low-frequency deformation, we perform multi-view matching and
thin-plate spline deformation on the initial surfaces obtained by integrating
the normal maps. Next, the corrected meshes are merged
into a single mesh using a volumetric method. The final output is
a set of meshes, which were impossible to produce with previous
methods. The meshes exhibit details on the order of a few millimeters,
and represent the performance over human-size working
volumes at a temporal resolution of 60Hz.
Paper
Video
- AVI (DIVX)
Links
Citation
Daniel Vlasic, Pieter Peers, Ilya Baran, Paul Debevec, Jovan Popović, Szymon Rusinkiewicz, and Wojciech Matusik.
"Dynamic Shape Capture using Multi-View Photometric Stereo."
ACM Trans. Graphics (Proc. SIGGRAPH Asia) 28(5), December 2009.
BibTeX
@article{Vlasic:2009:DSC, author = "Daniel Vlasic and Pieter Peers and Ilya Baran and Paul Debevec and Jovan Popovi{\'c} and Szymon Rusinkiewicz and Wojciech Matusik", title = "Dynamic Shape Capture using Multi-View Photometric Stereo", journal = "ACM Trans. Graphics (Proc. SIGGRAPH Asia)", year = "2009", month = dec, volume = "28", number = "5" }