Rxivist logo

Using distant supervision to augment manually annotated data for relation extraction

By Peng Su, Gang Li, Cathy Wu, K. Vijay-Shanker

Posted 02 May 2019
bioRxiv DOI: 10.1101/626226 (published DOI: 10.1371/journal.pone.0216913)

Significant progress has been made in applying deep learning on natural language processing tasks recently. However, deep learning models typically require a large amount of annotated training data while often only small labeled datasets are available for many natural language processing tasks in biomedical literature. Building large-size datasets for deep learning is expensive since it involves considerable human effort and usually requires domain expertise in specialized fields. In this work, we consider augmenting manually annotated data with large amounts of data using distant supervision. However, data obtained by distant supervision is often noisy, we first apply some heuristics to remove some of the incorrect annotations. Then using methods inspired from transfer learning, we show that the resulting models outperform models trained on the original manually annotated sets.

Download data

  • Downloaded 361 times
  • Download rankings, all-time:
    • Site-wide: 100,806
    • In bioinformatics: 8,630
  • Year to date:
    • Site-wide: 153,122
  • Since beginning of last month:
    • Site-wide: 159,584

Altmetric data

Downloads over time

Distribution of downloads per paper, site-wide