Abstract
Speakers of a language can construct an unlimited number of new words through morphological derivation. This is a major cause of data sparseness for corpus-based approaches to lexical semantics, such as distributional semantic models of word meaning. We adapt compositional methods originally developed for phrases to the task of deriving the distributional meaning of morphologically complex words from their parts. Semantic representations constructed in this way beat a strong baseline and can be of higher quality than representations directly constructed from corpus data. Our results constitute a novel evaluation of the proposed composition methods, in which the full additive model achieves the best performance, and demonstrate the usefulness of a compositional morphology component in distributional semantics. 1
Keywords
Computer scienceNatural language processingDistributional semanticsSemantics (computer science)Artificial intelligenceConstruct (python library)Task (project management)Component (thermodynamics)Word (group theory)Meaning (existential)Lexical semanticsLinguisticsSemantic similarityLexical itemProgramming language
Affiliated Institutions
Related Publications
Glove: Global Vectors for Word Representation
Recent methods for learning vector space representations of words have succeeded in capturing fine-grained semantic and syntactic regularities using vector arithmetic, but the o...
Finding Structure in Time
Time underlies many interesting human behaviors. Thus, the question of how to represent time in connectionist models is very important. One approach is to represent time implici...
Parallel networks that learn to pronounce English text
This paper describes NETtalk, a class of massively-parallel network systems that learn to convert English text to speech. The memory representations for pronunciations are learn...
Feature-rich part-of-speech tagging with a cyclic dependency network
We present a new part-of-speech tagger that demonstrates the following ideas: (i) explicit use of both preceding and following tag contexts via a dependency network representati...
Exemplar-Based Sparse Representation Features: From TIMIT to LVCSR
The use of exemplar-based methods, such as support vector machines (SVMs), k-nearest neighbors (kNNs) and sparse representations (SRs), in speech recognition has thus far been l...
Publication Info
- Year
- 2013
- Type
- article
- Pages
- 1517-1526
- Citations
- 109
- Access
- Closed
External Links
Citation Metrics
109
OpenAlex
Cite This
Angeliki Lazaridou,
Marco Marelli,
Roberto Zamparelli
et al.
(2013).
Compositional-ly Derived Representations of Morphologically Complex Words in Distributional Semantics.
, 1517-1526.