NIST logo

Publication Citation: Versus: A Framework for General Content-Based Comparisons

NIST Authors in Bold

Author(s): Peter Bajcsy; Antoine Vandecreme; Benjamin J. Long; Paul Khouri Saba; Joe Chalfoun; Luigi Marini; Devin Bonnie; Rob Kooper; Michal Ondrejcek; Kenton McHenry;
Title: Versus: A Framework for General Content-Based Comparisons
Published: December 05, 2011
Abstract: Abstract,We present a framework for the execution and dissemination of customizable content-based file comparison methods. Given digital objects such as files, database entries, or in-memory data structures, we are interested in establishing their proximity (i.e. similarity or dissimilarity) not based on their byte representation (i.e. file format or file system metadata on the file) but on the actual information contained within the files (text, images, 3D, video, audio, etc.). As a generalization of traditional content-based search and retrieval approaches, we propose a general piece of Cyberinfrastructure that can be used not only for text-based search but also for non-text, content-based comparison in general (e.g. duplicate file identification, detecting changes that occur to a files information over time, and ground truth data comparisons). The proposed framework abstracts these tasks by breaking comparisons into three reusable components: (1) the loading of digital contents to some type of content specific data structure; (2) the extraction of features and feature descriptors representing specific aspects of the contents of that data; and (3) the computation of a numeric content proximity of those two feature descriptors. We describe an implementation of this abstraction as a Java API and a RESTful (Representational State Transfer) service API. These represent both a set of tools to support the access and execution of content-based comparisons on local and distributed computational resources (e.g. desktop or cloud environment), as well as a library of methods focused on images, 3D models, text, and documents comprised of the three.
Conference: eScience 2012
Proceedings: 2012 Eighth IEEE International Conference on e-Science
Location: Chicago, IL
Dates: October 8-12, 2012
Keywords: content based comparison; cyberinfrastructure; large data collections
Research Areas: Data and Informatics, Data Mining, Cloud Computing, Information Processing Systems, Scientific Computing
PDF version: PDF Document Click here to retrieve PDF version of paper (545KB)