Linguistics Research Today is a free monthly online journal that collates and summarizes the latest research about Linguistics, including details on human language, phonetics, syntax, phonology.

Topics in semantic representation.

Griffiths TL, Steyvers M, Tenenbaum JB

Department of Psychology, University of California, Berkeley, CA 94720-1650, USA. tom_griffiths@berkeley.edu

Processing language requires the retrieval of concepts from memory in response to an ongoing stream of information. This retrieval is facilitated if one can infer the gist of a sentence, conversation, or document and use that gist to predict related concepts and disambiguate words. This article analyzes the abstract computational problem underlying the extraction and use of gist, formulating this problem as a rational statistical inference. This leads to a novel approach to semantic representation in which word meanings are represented in terms of a set of probabilistic topics. The topic model performs well in predicting word association and the effects of semantic association and ambiguity on a variety of language-processing and memory tasks. It also provides a foundation for developing more richly structured statistical models of language, as the generative process assumed in the topic model can easily be extended to incorporate other kinds of semantic and syntactic structure.

Published 15 May 2007 in Psychol Rev, 114(2): 211-44.
Full-text of this article is available online (may require subscription).

© 2005-2008 Linguistics Research Today. All Rights Reserved.