Abstract

Text classification is an important and classical problem in natural language processing. There have been a number of studies that applied convolutional neural networks (convolution on regular grid, e.g., sequence) to classification. However, only a limited number of studies have explored the more flexible graph convolutional neural networks (convolution on non-grid, e.g., arbitrary graph) for the task. In this work, we propose to use graph convolutional networks for text classification. We build a single text graph for a corpus based on word co-occurrence and document word relations, then learn a Text Graph Convolutional Network (Text GCN) for the corpus. Our Text GCN is initialized with one-hot representation for word and document, it then jointly learns the embeddings for both words and documents, as supervised by the known class labels for documents. Our experimental results on multiple benchmark datasets demonstrate that a vanilla Text GCN without any external word embeddings or knowledge outperforms state-of-the-art methods for text classification. On the other hand, Text GCN also learns predictive word and document embeddings. In addition, experimental results show that the improvement of Text GCN over state-of-the-art comparison methods become more prominent as we lower the percentage of training data, suggesting the robustness of Text GCN to less training data in text classification.

Keywords

Computer scienceText graphArtificial intelligenceGraphConvolutional neural networkNatural language processingPattern recognition (psychology)Text miningTheoretical computer science

Related Publications

LightGCN

Graph Convolution Network (GCN) has become new state-of-the-art for collaborative filtering. Nevertheless, the reasons of its effectiveness for recommendation are not well under...

2020 3523 citations

Cluster-GCN

Graph convolutional network (GCN) has been successfully applied to many\ngraph-based applications; however, training a large-scale GCN remains\nchallenging. Current SGD-based al...

2019 1120 citations

Publication Info

Year
2019
Type
article
Volume
33
Issue
01
Pages
7370-7377
Citations
1867
Access
Closed

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

1867
OpenAlex
236
Influential
1331
CrossRef

Cite This

Liang Yao, Chengsheng Mao, Yuan Luo (2019). Graph Convolutional Networks for Text Classification. Proceedings of the AAAI Conference on Artificial Intelligence , 33 (01) , 7370-7377. https://doi.org/10.1609/aaai.v33i01.33017370

Identifiers

DOI
10.1609/aaai.v33i01.33017370
arXiv
1809.05679

Data Quality

Data completeness: 88%