Abstract
In this paper, we describe a case study of a sentence-level categorization in which tagging instructions are developed and used by four judges to classify clauses from the Wall Street Journal as either subjective or objective . Agreement among the four judges is analyzed, and based on that analysis, each clause is given a final classification. To provide empirical support for the classifications, correlations are assessed in the data between the subjective category and a basic semantic class posited by Quirk, Greenbaum, Leech and Svartvik (1985).
Keywords
Computer scienceCategorizationSentenceSubjectivityNatural language processingClass (philosophy)Artificial intelligenceLinguisticsEpistemology
Affiliated Institutions
Related Publications
Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation
Commonly used evaluation measures including Recall, Precision, F-Measure and Rand Accuracy are biased and should not be used without clear understanding of the biases, and corre...
Publication Info
- Year
- 1999
- Type
- article
- Volume
- 5
- Issue
- 2
- Pages
- 187-205
- Citations
- 174
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
174
OpenAlex
11
Influential
77
CrossRef
Cite This
Rebecca Bruce,
Janyce Wiebe
(1999).
Recognizing subjectivity: a case study in manual tagging.
Natural Language Engineering
, 5
(2)
, 187-205.
https://doi.org/10.1017/s1351324999002181
Identifiers
- DOI
- 10.1017/s1351324999002181