We derive and demonstrate new methods for dewarping images depicted in convex mirrors in artwork and
for estimating the three-dimensional shapes of the mirrors themselves. Previous methods were based on the
assumption that mirrors were spherical or paraboloidal, an assumption unlikely to hold for hand-blown glass
spheres used in early Renaissance art, such as Johannes van Eyck's Portrait of Giovanni (?) Arnolfini and his
wife (1434) and Robert Campin's Portrait of St. John the Baptist and Heinrich von Werl (1438). Our methods
are more general than such previous methods in that we assume merely that the mirror is radially symmetric
and that there are straight lines (or colinear points) in the actual source scene. We express the mirror's shape
as a mathematical series and pose the image dewarping task as that of estimating the coefficients in the series
expansion. Central to our method is the plumbline principle: that the optimal coefficients are those that dewarp
the mirror image so as to straighten lines that correspond to straight lines in the source scene. We solve for
these coefficients algebraically through principal component analysis, PCA. Our method relies on a global figure
of merit to balance warping errors throughout the image and it thereby reduces a reliance on the somewhat
subjective criterion used in earlier methods. Our estimation can be applied to separate image annuli, which is
appropriate if the mirror shape is irregular. Once we have found the optimal image dewarping, we compute
the mirror shape by solving a differential equation based on the estimated dewarping function. We demonstrate
our methods on the Arnolfini mirror and reveal a dewarped image superior to those found in prior work|an
image noticeably more rectilinear throughout and having a more coherent geometrical perspective and vanishing
points. Moreover, we find the mirror deviated from spherical and paraboloidal shape; this implies that it would
have been useless as a concave projection mirror, as has been claimed. Our dewarped image can be compared to
the geometry in the full Arnolfini painting; the geometrical agreement strongly suggests that van Eyck worked
from an actual room, not, as has been suggested by some art historians, a "fictive" room of his imagination. We
apply our method to other mirrors depicted in art, such as Parmigianino's Self-portrait in a convex mirror and
compare our results to those from earlier computer graphics simulations.
The invariance and covariance of extracted features from an object under certain transformation play quite important roles in the fields of pattern recognition and image understanding. For instance, in order to recognize a three dimentional object, we need specific features extracted from a given object. These features should be independent of the pose and the location of an object. To extract such feature, The authors have presented the three dimensional vector autoregressive model (3D VAR model). This 3D VAR model is constructed on the quaternion, which is the basis of SU(2) (the rotation group in two dimensional complex space). Then the 3D VAR model is defined by the external products of 3D sequential data and the autoregressive(AR) coefficients, unlike the usual AR models. Therefore the 3D VAR model has some prominent features. For example, The AR coefficients of the 3D VAR model behave like vectors under any three dimensional rotation. In this paper, we derive the invariance from 3D VAR coefficients by inner product of each 3D VAR coefficient. These invariants make it possible to recognize the three dimensional curves.
The invariance and covariance of extracted features from an object under certain transformation play quite important roles in the fields of pattern recognition and image understanding. For instance, in order to recognize a three dimensional object, we need specific features extracted from a given object. These features should be independent of the pose and the location of an object. To extract such features, the authors have presented the three dimensional vector autoregressive model (3D VAR model). This 3D VAR model is constructed on the quarternion, which is the basis of SU(2) (the rotation group in two dimensional complex space). Then the 3D VAR model is defined by the external products of 3D sequential data and the autoregressive (AR) coefficients, unlike the conventional AR models. Therefore the 3D VAR model has some prominent features. For example, the AR coefficients of the 3D VAR model behave like vectors under any three dimensional rotation. In this paper, we present an effective straightforward algorithm to obtain the 3D VAR coefficients from lower order to higher order recursively.
KEYWORDS: Autoregressive models, 3D modeling, Data modeling, Americium, Radon, Pattern recognition, Promethium, Data compression, Visual process modeling, Image understanding
The invariance and covariance of extracted features from an object under certain transformation play quite important roles in the fields of pattern recognition and image understanding. For instance, in order to recognize a three dimensional (3D) object, we need specific features extracted from a given object. These features should be independent of the pose and the location of an object. To extract such feature, one of the authors has presented the 3D vector autoregressive (VAR) model. This 3D VAR model is constructed on the quaternion, which is the basis of SU(2) (the rotation group in two dimensional complex space). Then the 3D VAR model is defined by the external products of 3D sequential data and the autoregressive (AR) coefficients, unlike the conventional AR models. Therefore the 3D VAR model has some prominent features. For example, the AR coefficients of the 3D VAR model behave like vectors under any three dimensional rotation. In this paper, we present the recursive computation of 2D VAR coefficients and 3D VAR coefficients. This method reduce the cost of computation of VAR coefficients. We also define the partial correlation (PARCOR) vectors for the 2D VAR model and 3D VAR model from the point of view of data compression and pattern recognition.
The factorization method by Tomasi and Kanade gives a stable and an accurate reconstruction. However is difficult to apply their method to real-time applications. Then we present an iterative factorization method for the GAP model with tracking the feature points. In this method, through the fixed size measurement matrix, which is independent of the number of the frames, the motion and the shape are to be reconstructed at every frame. Some experiments are also given to show the performance of our proposed iterative method.
We present the intuitive interpretation of affine epipolar geometry for the orthographic, scaled orthographic, and paraperspective projection models in terms of the factorization method for the generalized affine projection (GAP) model proposed by Fujiki and Kurata (1997). Using the GAP model introduced by Mundy and Zisserman (1992), each affine projection model can be resolved into the orthographic projection model by the introduction of virtual image planes, then the affine epipolar geometry can be simply obtained from the estimation of the factorization method. We show some experiments using synthetic data and real images and also demonstrate to reconstruct the dense 3D structure of the object.
The factorization method has been sued for recovering both the shape of an object and the motion of a camera from sequential images. This method consist of two steps. The first step is to decompose measurement matrix into a product of two matrices. And the second step is to determine a non- singular matrix to revise these matrices. Mathematical consideration of this method is not paid much attention. In this paper, we elucidate the mathematical meaning of the second step. This gives intuitive interpretation of many facts of shape from motion problem. It makes clear to understand why we need three distinct affine projection images to determine the shape and motion of camera and what information we can get from two affine projection images. We also consider the factorization method for two images.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.