Article,
Multi-view stereo of an object immersed in a refractive medium
Affiliations
- [1] Université de Toulouse [NORA names: France; Europe, EU; OECD];
- [2] DIKU, Department of Computer Science, Copenhagen, Denmark [NORA names: Denmark; Europe, EU; Nordic; OECD];
- [3] University of Zurich [NORA names: Switzerland; Europe, Non-EU; OECD];
- [4] Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen [NORA names: France; Europe, EU; OECD]
Abstract
In this article, we show how to extend the multi-view stereo technique when the object to be reconstructed is inside a transparent but refractive medium, which causes distortions in the images. We provide a theoretical formulation of the problem accounting for a general non-planar shape of the refractive interface, and then a discrete solving method. We also present a pipeline to recover precisely the geometry of the refractive interface, considered as a convex polyhedral object. It is based on the extraction of visible polyhedron vertices from silhouette images and matching across a sequence of images acquired under circular camera motion. These contributions are validated by tests on synthetic and real data.
Keywords
camera motion,
contribution,
convex polyhedral objects,
data,
distortion,
extraction,
formulation,
geometry,
images,
interface,
medium,
method,
motion,
multi-view stereo,
multi-view stereo techniques,
non-planar shape,
objective,
pipeline,
polyhedral objects,
polyhedron vertices,
problem,
refractive interface,
refractive media,
sequence,
sequence of images,
shape,
silhouette,
silhouette images,
solving method,
stereo,
stereo technique,
technique,
test,
theoretical formulation,
vertices