Scientific Statement Classification over arXiv.org

Published

August 29, 2019

Author(s)

Bruce R. Miller, Deyan Ginev

Abstract

We introduce a new classification task for scientific statements and release a large-scale dataset for supervised learning. Our resource is derived from a machine- readable representation of the arXiv.org collection of preprint articles. We explore fifty author-annotated categories and empirically motivate a task design of grouping 10.5 million annotated paragraphs into thirteen classes. We demonstrate the task setup aligns with known success rates from the state of art, peaking at a 0.91 F1- score via a BiLSTM encoder-decoder model. Additionally, we introduce a lexeme serialization for mathematical formulas, and demonstrate that context-aware models could improve when also trained on the symbolic modality. Finally, we discuss the limitations of both data and task design, and outline potential directions towards increasingly complex models of scientific discourse, beyond isolated statements.

Proceedings Title

Language Resources and Evaluation Conference (LREC2020)

Conference Dates

May 3-5, 2020

Conference Location

Marseille

Pub Type

Conferences

Download Paper

Local Download

Keywords

natural language processing, deep learning, mathematical documents, arXiv

Citation

Miller, B. and Ginev, D. (2019), Scientific Statement Classification over arXiv.org, Language Resources and Evaluation Conference (LREC2020), Marseille, -1, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=928554 (Accessed May 6, 2024)