Abstract

Reuters Corpus Volume I (RCV1) is an archive of over 800,000 manually categorized newswire stories recently made available by Reuters, Ltd. for research purposes. Use of this data for research on text categorization requires a detailed understanding of the real world constraints under which the data was produced. Drawing on interviews with Reuters personnel and access to Reuters documentation, we describe the coding policy and quality control procedures used in producing the RCV1 data, the intended semantics of the hierarchical category taxonomies, and the corrections necessary to remove errorful data. We refer to the original data as RCV1-v1, and the corrected data as RCV1-v2. We benchmark several widely used supervised learning methods on RCV1-v2, illustrating the collection's properties, suggesting new directions for research, and providing baseline results for future studies. We make available detailed, per-category experimental results, as well as corrected versions of the category assignments and taxonomy structures, via online appendices.

Keywords

CategorizationComputer scienceBenchmark (surveying)Information retrievalDocumentationCoding (social sciences)Text categorizationData collectionBaseline (sea)Natural language processingSemantics (computer science)Artificial intelligenceData scienceMathematics

Related Publications

Publication Info

Year
2004
Type
article
Volume
5
Pages
361-397
Citations
2600
Access
Closed

External Links

View on DOI.org

Social Impact

Altmetric
PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

2600
OpenAlex

Cite This

David Lewis, Yiming Yang, Tony Rose et al. (2004). RCV1: A New Benchmark Collection for Text Categorization Research. Journal of Machine Learning Research , 5 , 361-397. https://doi.org/10.5555/1005332.1005345

Identifiers

DOI
10.5555/1005332.1005345