SHREC 2010 - Shape Retrieval Contest based on Generic 3D Warehouse

Call For Participation:

SHREC 2010 - Shape Retrieval Contest based on Generic 3D Warehouse

Objective

The objective of this track is to evaluate the performance of 3D shape retrieval approaches on a Generic 3D shape benchmark based on the Google 3D Warehouse.

Introduction

With the increasing number of 3D models are created everyday and stored in databases. Effectively searching a 3D repository for 3D shapes which are similar to a given 3D query model has become an important area of research. Benchmarking allows researchers to evaluate the quality of results of different 3D shape retrieval approaches. Here, we propose a new publicly available 3D shape benchmark based on the Google 3D Warehouse to advance the state of art in 3D shape retrieval

Task description

The task is to evaluate the dissimilarity between every two objects in the database mentioned above and then output the dissimilarity matrix.

Data set

All the 3D models in the generic shape benchmark were acquired by a web crawler from the Google 3D Warehouse. To classify the 3D shape models into a ground truth database, one person based on the Google tags has classified objects into ground truth categories based mainly on visual similarity. In this benchmark, there will be over three thousand 3D models. The file format used to represent the 3D models will be the ASCII Object File Format (*.off).

Evaluation Methodology

We will employ the following evaluation measures: Precision-Recall curve; Average Precision (AP) and Mean Average Precision (MAP); E-Measure; Discounted Cumulative Gain; Nearest Neighbor, First-Tier (Tier1) and Second-Tier (Tier2).

Procedure

The following list is a step-by-step description of the activities:

• The participants must register by sending a message to %20shrec [at] nist.gov (SHREC[at]nist[dot]gov). Early registration is encouraged, so that we get an impression of the number of participants at an early stage.
• The database will be made available via this website. Final Test Dataset now Posted test dataset.
• Participants will submit the dissimilarity matrix (also named as distance matrix) for the test database. Upto 5 matrixs per group may be submitted, resulting from different runs. Each run may be a different algorithm, or a different parameter setting. More information on the dissimilarity matrix file format. More information on the dissimilarity matrix file format
• The evaluations will be done automatically.
• The organization will release the evaluation scores of all the runs.
• The participants write a two page description of their method and commenting the evaluation results with two figures.
• The track results are combined into a joint paper, published in the proceedings of the Eurographics Workshop on 3D Object Retrieval.
• The description of the tracks and their results are presented at the Eurographics Workshop on 3D Object Retrieval (May 2, 2010).

Schedule

Please Cite the paper :

SHREC'10 Track: Generic 3D Warehouse., T.P. Vanamali, A. Godil, H. Dutagaci,T. Furuya, Z. Lian, R. Ohbuchi, In: M. Daoudi, T. Schreck, M. Spagnuolo, I. Pratikakis, R. Veltkamp (eds.), Proceedings of the Eurographics/ACM SIGGRAPH Symposium on 3D Object Retrieval, 2010.