1. The Evaluation
The 2013 NIST Open Handwriting Recognition and Translation Evaluation (OpenHaRT 2013) is the second evaluation in the document recognition and translation evaluation series. The evaluation is to take place in the Spring 2013 followed by a workshop in the Fall 2013.
- Evaluation plan (v1.7, last uploaded March 20, 2013) - this document describes the evaluation protocol proposed for OpenHaRT'13. Please note this document will be updated as changes are made to the evaluation plan. These changes will be relayed to the participants via announcements sent to our mailing list.
- Data format specification package (v6.3, last uploaded August 13, 2012) - this package provides sample data to illustrate the data format expected by OpenHaRT'13.
- Evaluation registration form - to participate in the evaluation, you must register your site by filling out this form. Registration deadline is December 31, 2012
- Data license agreement - to obtain training data, you must register for the evaluation and sign this data license agreement.
- Invitation request form - fill out this form if you need to provide supporting documentation for your travel request.
- System description template - please use the Microsoft Word 2003 US letter version of the IEEE Manuscript Templates for Conference Proceedings
- OpenHaRT Pipeline (version 1.1.2, last uploaded May 24, 2013) - a software tool that evaluates OpenHaRT evaluation submissions.
- December 31, 2012: Evaluation registration deadline
- February 14 - 28, 2013: Evaluation dry run period
- April 9 - May 14, 2013: Formal evaluation period
- August 23, 2013: Post-evaluation workshop (see more below)
The 2013 evaluation results can be viewed HERE.
2. The Workshop
The 1st NIST 2013 Open Handwriting Recognition and Translation (OpenHaRT) Workshop will be held on August 23, 2013 in conjunction with the ICDAR 2013 conference in Washington DC, USA at the Washington DC Omni Shoreham Hotel.
The Multimodal Information Group from the National Institute of Standards and Technology (NIST), an agency within the U.S. Department of Commerce, invites active researchers to participate in the OpenHaRT workshop. OpenHaRT is an evaluation series that calibrates current technical capabilities in document text recognition and the workshop provides a forum for the evaluation participants, as well as active researchers who are interested in this field, to examine and discuss current state of the art in document analysis in the context of the evaluation.
To spread the information about new research in recognition and translation technique, we invite researchers and people interested in the results of the OpenHaRT evaluation to participate in the 1st OpenHaRT Workshop. Main parts of the workshop are the presentations of the evaluation participants who present their systems and the presentation of the evaluation results. Additionally non-evaluation participants are invited to submit their research papers for presentation at the workshop. Areas of interest include, but are not limited to:
- Image text recognition and translation
- Data resources for image text recognition and translation research
- Performance evaluation
To register for the OpenHaRT'13 workshop, please go to http://www.regonline.com/Register/Checkin.aspx?EventId=1226633 and select the "Workshops/Tutorial/DC" registrant type. The workshop fee is $65.
- May 15, 2013: Paper submission
- June 15, 2013: System description submission (OpenHaRT'13 participants only)
- June 30, 2013: Decision notification
- July 15, 2013: Final paper submission and early registration deadline
- August 23, 2013: ICDAR'13 satellite workshop in the Washington DC area
- All papers including the system descriptions must use the Microsoft Word 2003 US letter version of the IEEE Manuscript Templates for Conference Proceedings.
- All papers including the system descriptions must be submitted via Easy Chair.
Workshop Agenda and Proceedings
Audrey Tong, NIST, USA
Volker Märgner, Technische Universität Braunschweig, Germany
Haikal El Abed, Technische Universität Braunschweig, Germany
Apostolos Antonacopoulos, University of Salford, UK
Email firstname.lastname@example.org if you have any questions/comments.
[ Main ]