Flat refractive geometry

Tali Treibitz; Yoav Y. Schechner; Clayton Kunz; Hanumant Singh

doi:10.1109/TPAMI.2011.105

Flat refractive geometry

Tali Treibitz, Yoav Y. Schechner, Clayton Kunz, Hanumant Singh

Research output: Contribution to journal › Article › peer-review

Abstract

While the study of geometry has mainly concentrated on single viewpoint (SVP) cameras, there is growing attention to more general non-SVP systems. Here, we study an important class of systems that inherently have a non-SVP: a perspective camera imaging through an interface into a medium. Such systems are ubiquitous: They are common when looking into water-based environments. The paper analyzes the common flat-interface class of systems. It characterizes the locus of the viewpoints (caustic) of this class and proves that the SVP model is invalid in it. This may explain geometrical errors encountered in prior studies. Our physics-based model is parameterized by the distance of the lens from the medium interface, besides the focal length. The physical parameters are calibrated by a simple approach that can be based on a single frame. This directly determines the system geometry. The calibration is then used to compensate for modeled system distortion. Based on this model, geometrical measurements of objects are significantly more accurate than if based on an SVP model. This is demonstrated in real-world experiments. In addition, we examine by simulation the errors expected by using the SVP model. We show that when working at a constant range, the SVP model can be a good approximation.

Original language	English
Article number	5770266
Pages (from-to)	51-65
Number of pages	15
Journal	IEEE Transactions on Pattern Analysis and Machine Intelligence
Volume	34
Issue number	1
DOIs	https://doi.org/10.1109/TPAMI.2011.105
State	Published - 2012
Externally published	Yes

Bibliographical note

Funding Information:
The authors thank the reviewers for their insightful comments and Hank Chezar of the USGS and Boaz Zion of Volcani Center for letting them use their images in Fig. 1. They thank Ben Herzberg and Gal Gur-Arye for help in the experimental dives. Yoav Y. Schechner is a Landau Fellow —supported by the Taub Foundation. This work was supported by the US-Israel Binational Science Foundation (BSF grant 2006384) and the Israeli Ministry of Science, Culture and Sport (Grant 3-3426). This reasearch was supported by the Ollendorff Minerva Center for Vision and Image Science. Minerva is funded through the BMBF. Yoav Y. Schechner was partially supported by US Department of the Navy Grant N62909-10-1-4056 issued by the US Office of Naval Research (ONR) Global and the United States has a royalty-free license throughout the world in all copyrightable materials contained herein. Funding was also provided in part by the CenSSIS ERC of the US National Science Foundation (NSF) under Grant EEC-9986821. Tali Treibitz was partailly supported under grants from NSF ATM-0941760 and ONR N00014-08-1-0638. Tali Treibitz is an Awardee of the Weizmann Institute of Science—National Postdoctoral Award Program for Advancing Women in Science.

Keywords

3D/stereo scene analysis
Computer vision
camera calibration
imaging geometry
vision and scene understanding

ASJC Scopus subject areas

Software
Computer Vision and Pattern Recognition
Computational Theory and Mathematics
Artificial Intelligence
Applied Mathematics

Access to Document

10.1109/TPAMI.2011.105

Cite this

@article{69aea1f178964796a0e366fb98735a83,

title = "Flat refractive geometry",

abstract = "While the study of geometry has mainly concentrated on single viewpoint (SVP) cameras, there is growing attention to more general non-SVP systems. Here, we study an important class of systems that inherently have a non-SVP: a perspective camera imaging through an interface into a medium. Such systems are ubiquitous: They are common when looking into water-based environments. The paper analyzes the common flat-interface class of systems. It characterizes the locus of the viewpoints (caustic) of this class and proves that the SVP model is invalid in it. This may explain geometrical errors encountered in prior studies. Our physics-based model is parameterized by the distance of the lens from the medium interface, besides the focal length. The physical parameters are calibrated by a simple approach that can be based on a single frame. This directly determines the system geometry. The calibration is then used to compensate for modeled system distortion. Based on this model, geometrical measurements of objects are significantly more accurate than if based on an SVP model. This is demonstrated in real-world experiments. In addition, we examine by simulation the errors expected by using the SVP model. We show that when working at a constant range, the SVP model can be a good approximation.",

keywords = "3D/stereo scene analysis, Computer vision, camera calibration, imaging geometry, vision and scene understanding",

author = "Tali Treibitz and Schechner, {Yoav Y.} and Clayton Kunz and Hanumant Singh",

note = "Funding Information: The authors thank the reviewers for their insightful comments and Hank Chezar of the USGS and Boaz Zion of Volcani Center for letting them use their images in Fig. 1. They thank Ben Herzberg and Gal Gur-Arye for help in the experimental dives. Yoav Y. Schechner is a Landau Fellow —supported by the Taub Foundation. This work was supported by the US-Israel Binational Science Foundation (BSF grant 2006384) and the Israeli Ministry of Science, Culture and Sport (Grant 3-3426). This reasearch was supported by the Ollendorff Minerva Center for Vision and Image Science. Minerva is funded through the BMBF. Yoav Y. Schechner was partially supported by US Department of the Navy Grant N62909-10-1-4056 issued by the US Office of Naval Research (ONR) Global and the United States has a royalty-free license throughout the world in all copyrightable materials contained herein. Funding was also provided in part by the CenSSIS ERC of the US National Science Foundation (NSF) under Grant EEC-9986821. Tali Treibitz was partailly supported under grants from NSF ATM-0941760 and ONR N00014-08-1-0638. Tali Treibitz is an Awardee of the Weizmann Institute of Science—National Postdoctoral Award Program for Advancing Women in Science.",

year = "2012",

doi = "10.1109/TPAMI.2011.105",

language = "English",

volume = "34",

pages = "51--65",

journal = "IEEE Transactions on Pattern Analysis and Machine Intelligence",

issn = "0162-8828",

publisher = "IEEE Computer Society",

number = "1",

}

TY - JOUR

T1 - Flat refractive geometry

AU - Treibitz, Tali

AU - Schechner, Yoav Y.

AU - Kunz, Clayton

AU - Singh, Hanumant

N1 - Funding Information: The authors thank the reviewers for their insightful comments and Hank Chezar of the USGS and Boaz Zion of Volcani Center for letting them use their images in Fig. 1. They thank Ben Herzberg and Gal Gur-Arye for help in the experimental dives. Yoav Y. Schechner is a Landau Fellow —supported by the Taub Foundation. This work was supported by the US-Israel Binational Science Foundation (BSF grant 2006384) and the Israeli Ministry of Science, Culture and Sport (Grant 3-3426). This reasearch was supported by the Ollendorff Minerva Center for Vision and Image Science. Minerva is funded through the BMBF. Yoav Y. Schechner was partially supported by US Department of the Navy Grant N62909-10-1-4056 issued by the US Office of Naval Research (ONR) Global and the United States has a royalty-free license throughout the world in all copyrightable materials contained herein. Funding was also provided in part by the CenSSIS ERC of the US National Science Foundation (NSF) under Grant EEC-9986821. Tali Treibitz was partailly supported under grants from NSF ATM-0941760 and ONR N00014-08-1-0638. Tali Treibitz is an Awardee of the Weizmann Institute of Science—National Postdoctoral Award Program for Advancing Women in Science.

PY - 2012

Y1 - 2012

N2 - While the study of geometry has mainly concentrated on single viewpoint (SVP) cameras, there is growing attention to more general non-SVP systems. Here, we study an important class of systems that inherently have a non-SVP: a perspective camera imaging through an interface into a medium. Such systems are ubiquitous: They are common when looking into water-based environments. The paper analyzes the common flat-interface class of systems. It characterizes the locus of the viewpoints (caustic) of this class and proves that the SVP model is invalid in it. This may explain geometrical errors encountered in prior studies. Our physics-based model is parameterized by the distance of the lens from the medium interface, besides the focal length. The physical parameters are calibrated by a simple approach that can be based on a single frame. This directly determines the system geometry. The calibration is then used to compensate for modeled system distortion. Based on this model, geometrical measurements of objects are significantly more accurate than if based on an SVP model. This is demonstrated in real-world experiments. In addition, we examine by simulation the errors expected by using the SVP model. We show that when working at a constant range, the SVP model can be a good approximation.

AB - While the study of geometry has mainly concentrated on single viewpoint (SVP) cameras, there is growing attention to more general non-SVP systems. Here, we study an important class of systems that inherently have a non-SVP: a perspective camera imaging through an interface into a medium. Such systems are ubiquitous: They are common when looking into water-based environments. The paper analyzes the common flat-interface class of systems. It characterizes the locus of the viewpoints (caustic) of this class and proves that the SVP model is invalid in it. This may explain geometrical errors encountered in prior studies. Our physics-based model is parameterized by the distance of the lens from the medium interface, besides the focal length. The physical parameters are calibrated by a simple approach that can be based on a single frame. This directly determines the system geometry. The calibration is then used to compensate for modeled system distortion. Based on this model, geometrical measurements of objects are significantly more accurate than if based on an SVP model. This is demonstrated in real-world experiments. In addition, we examine by simulation the errors expected by using the SVP model. We show that when working at a constant range, the SVP model can be a good approximation.

KW - 3D/stereo scene analysis

KW - Computer vision

KW - camera calibration

KW - imaging geometry

KW - vision and scene understanding

UR - http://www.scopus.com/inward/record.url?scp=81855172258&partnerID=8YFLogxK

U2 - 10.1109/TPAMI.2011.105

DO - 10.1109/TPAMI.2011.105

M3 - Article

AN - SCOPUS:81855172258

SN - 0162-8828

VL - 34

SP - 51

EP - 65

JO - IEEE Transactions on Pattern Analysis and Machine Intelligence

JF - IEEE Transactions on Pattern Analysis and Machine Intelligence

IS - 1

M1 - 5770266

ER -

Flat refractive geometry

Abstract

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this