Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface

Tomoya Okazaki; Takayuki Okatani; Koichiro Deguchi

doi:10.1007/978-3-540-92957-4_36

Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface

Tomoya Okazaki, Takayuki Okatani, Koichiro Deguchi

INF - System Information Sciences

Research output: Contribution to journal › Conference article › peer-review

7 Citations (Scopus)

Abstract

In this paper, we present a method for synthesizing virtual appearance of an object by projecting images onto the surface of the object using projectors. The object surface is assumed to have a known diffuse reflectance property; its shape is allowed to have an arbitrary shape. Using a system consisting of multiple projectors and a camera, the method first estimates their internal and external parameters as well as the object surface based on the projection of structured patterns, and then measures surface normals by the method of photometric stereo that uses the same projectors as point sources of illumination. By enabling highly accurate calibration of the projectors as well as reconstruction of the object shape and also by reducing the random errors in surface normals that significantly affect final appearance, it is made possible to synthesize high-quality appearance associated with an arbitrary virtual reflectance property.

Original language	English
Pages (from-to)	410-422
Number of pages	13
Journal	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	5414 LNCS
DOIs	https://doi.org/10.1007/978-3-540-92957-4_36
Publication status	Published - 2009
Event	3rd Pacific Rim Symposium on Image and Video Technology, PSIVT 2009 - Tokyo, Japan Duration: 2009 Jan 13 → 2009 Jan 16

Keywords

Augmented reality
Autocalibration
Photometric stereo
Projector-camera

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-540-92957-4_36

Fingerprint

Dive into the research topics of 'Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface'. Together they form a unique fingerprint.

Cite this

Okazaki, T., Okatani, T., & Deguchi, K. (2009). Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 5414 LNCS, 410-422. https://doi.org/10.1007/978-3-540-92957-4_36

Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface. / Okazaki, Tomoya; Okatani, Takayuki; Deguchi, Koichiro.
In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 5414 LNCS, 2009, p. 410-422.

Research output: Contribution to journal › Conference article › peer-review

Okazaki, T, Okatani, T & Deguchi, K 2009, 'Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface', Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5414 LNCS, pp. 410-422. https://doi.org/10.1007/978-3-540-92957-4_36

Okazaki T, Okatani T, Deguchi K. Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2009;5414 LNCS:410-422. doi: 10.1007/978-3-540-92957-4_36

Okazaki, Tomoya ; Okatani, Takayuki ; Deguchi, Koichiro. / Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system : High quality reproduction of a virtual reflectance property on a real object surface. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2009 ; Vol. 5414 LNCS. pp. 410-422.

@article{71b6b5440fbe42dab284f6ae32cac2ff,

title = "Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface",

abstract = "In this paper, we present a method for synthesizing virtual appearance of an object by projecting images onto the surface of the object using projectors. The object surface is assumed to have a known diffuse reflectance property; its shape is allowed to have an arbitrary shape. Using a system consisting of multiple projectors and a camera, the method first estimates their internal and external parameters as well as the object surface based on the projection of structured patterns, and then measures surface normals by the method of photometric stereo that uses the same projectors as point sources of illumination. By enabling highly accurate calibration of the projectors as well as reconstruction of the object shape and also by reducing the random errors in surface normals that significantly affect final appearance, it is made possible to synthesize high-quality appearance associated with an arbitrary virtual reflectance property.",

keywords = "Augmented reality, Autocalibration, Photometric stereo, Projector-camera",

author = "Tomoya Okazaki and Takayuki Okatani and Koichiro Deguchi",

year = "2009",

doi = "10.1007/978-3-540-92957-4_36",

language = "English",

volume = "5414 LNCS",

pages = "410--422",

journal = "Lecture Notes in Computer Science",

issn = "0302-9743",

publisher = "Springer Verlag",

}

TY - JOUR

T1 - Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system

T2 - 3rd Pacific Rim Symposium on Image and Video Technology, PSIVT 2009

AU - Okazaki, Tomoya

AU - Okatani, Takayuki

AU - Deguchi, Koichiro

PY - 2009

Y1 - 2009

N2 - In this paper, we present a method for synthesizing virtual appearance of an object by projecting images onto the surface of the object using projectors. The object surface is assumed to have a known diffuse reflectance property; its shape is allowed to have an arbitrary shape. Using a system consisting of multiple projectors and a camera, the method first estimates their internal and external parameters as well as the object surface based on the projection of structured patterns, and then measures surface normals by the method of photometric stereo that uses the same projectors as point sources of illumination. By enabling highly accurate calibration of the projectors as well as reconstruction of the object shape and also by reducing the random errors in surface normals that significantly affect final appearance, it is made possible to synthesize high-quality appearance associated with an arbitrary virtual reflectance property.

AB - In this paper, we present a method for synthesizing virtual appearance of an object by projecting images onto the surface of the object using projectors. The object surface is assumed to have a known diffuse reflectance property; its shape is allowed to have an arbitrary shape. Using a system consisting of multiple projectors and a camera, the method first estimates their internal and external parameters as well as the object surface based on the projection of structured patterns, and then measures surface normals by the method of photometric stereo that uses the same projectors as point sources of illumination. By enabling highly accurate calibration of the projectors as well as reconstruction of the object shape and also by reducing the random errors in surface normals that significantly affect final appearance, it is made possible to synthesize high-quality appearance associated with an arbitrary virtual reflectance property.

KW - Augmented reality

KW - Autocalibration

KW - Photometric stereo

KW - Projector-camera

UR - http://www.scopus.com/inward/record.url?scp=60149100616&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=60149100616&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-92957-4_36

DO - 10.1007/978-3-540-92957-4_36

M3 - Conference article

AN - SCOPUS:60149100616

SN - 0302-9743

VL - 5414 LNCS

SP - 410

EP - 422

JO - Lecture Notes in Computer Science

JF - Lecture Notes in Computer Science

Y2 - 13 January 2009 through 16 January 2009

ER -

Shape reconstruction by combination of structured-light projection and photometric stereo using a projector-camera system: High quality reproduction of a virtual reflectance property on a real object surface

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this