Adversarial learning for distant supervised relation extraction

Zeng, D., Dai, Y., Li, F., Sherratt, R. S. ORCID: https://orcid.org/0000-0001-7899-4445 and Wang, J. (2018) Adversarial learning for distant supervised relation extraction. Computers, Materials & Continua, 55 (1). pp. 121-136. ISSN 1546-2226 doi: 10.3970/cmc.2018.055.121

Abstract/Summary

Recently, many researchers have concentrated on using neural networks to learn features for Distant Supervised Relation Extraction (DSRE). These approaches generally use a softmax classifier with cross-entropy loss, which inevitably brings the noise of artificial class NA into classification process. To address the shortcoming, the classifier with ranking loss is employed to DSRE. Uniformly randomly selecting a relation or heuristically selecting the highest score among all incorrect relations are two common methods for generating a negative class in the ranking loss function. However, the majority of the generated negative class can be easily discriminated from positive class and will contribute little towards the training. Inspired by Generative Adversarial Networks (GANs), we use a neural network as the negative class generator to assist the training of our desired model, which acts as the discriminator in GANs. Through the alternating optimization of generator and discriminator, the generator is learning to produce more and more discriminable negative classes and the discriminator has to become better as well. This framework is independent of the concrete form of generator and discriminator. In this paper, we use a two layers fully-connected neural network as the generator and the Piecewise Convolutional Neural Networks (PCNNs) as the discriminator. Experiment results show that our proposed GAN-based method is effective and performs better than state-of-the-art methods.

Item Type	Article
URI	https://reading-clone.eprints-hosting.org/id/eprint/77404
Identification Number/DOI	10.3970/cmc.2018.055.121
Refereed	Yes
Divisions	Life Sciences > School of Biological Sciences > Biomedical Sciences Life Sciences > School of Biological Sciences > Department of Bio-Engineering
Publisher	Tech Science Press
Download/View statistics	View download statistics for this item