Framework for Representing and Reasoning about Three-Dimensional Objects for Vision

Published

June 30, 1988

Author(s)

E Walker, Martin Herman, T Kanade

Abstract

The capabilities for representing and reasoning about three-dimensional objects are essential for knowledge-based, 3D photo-interpretation system that combine domain knowledge with image processing, as demonstrated by such systems as 3D Mosaic and Acronym. Three-dimensional representation of objects is necessary for many additional applications such as robot navigation and 3D change detection. Geometric reasoning is especially important, since geometric relationships between objects parts are a rich source of domain knowledge. A practical framework for geometric representation and reasoning must incorporate projections between a 2D image and a 3D scene, shape and surface properties of objects, and geometric and topological relationships between objects. In addition, it should allow easy modification and extension of the system''s domain knowledge and be flexible enough to organize its reasoning efficiently to take advantage of the current available knowledge. We are developing such a framework, called the 3D FORM (Frame-based Object Recognition and Modelling) System. This system uses frames to represent objects such as buildings and walls, geometric features such as lines and planes, and geometric relationships such as parallel lines. Active procedures attached to the frames dynamically compute values as needed. Since the order of processing is controlled largely by accessing objects'' slots, the system performs both top-down and bottom-up reasoning, depending on the current available knowledge. The FORM system is being implemented using the CMU-built Framekit tool in Common Lisp [3]. Examples of interpretation using a simple model of building as rectangular prism are presented.

Citation

Ai Magazine

Volume

9 No. 2

Pub Type

Journals

Download Paper

Local Download

Keywords

Geometric Reasoning, World Modeling

Citation

Walker, E. , Herman, M. and Kanade, T. (1988), Framework for Representing and Reasoning about Three-Dimensional Objects for Vision, Ai Magazine, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=820275 (Accessed May 8, 2026)

Additional citation formats