Rxivist logo

Rxivist combines preprints from bioRxiv with data from Twitter to help you find the papers being discussed in your field. Currently indexing 65,690 bioRxiv papers from 290,986 authors.

SummaryAUC: a tool for evaluating the performance of polygenic risk prediction models in validation datasets with only summary level statistics

By Lei Song, Aiyi Liu, Molecular Genetics of Schizophrenia Consortium, Jianxin Shi

Posted 29 Jun 2018
bioRxiv DOI: 10.1101/359463 (published DOI: 10.1093/bioinformatics/btz176)

Motivation: Polygenic risk score (PRS) methods based on genome-wide association studies (GWAS) have a potential for predicting the risk of developing complex diseases and are expected to become more accurate with larger training data sets and innovative statistical methods. The area under the ROC curve (AUC) is often used to evaluate the performance of PRSs, which requires individual genotypic and phenotypic data in an independent GWAS validation dataset. We are motivated to develop methods for approximating AUC of PRSs based on the summary level data of the validation dataset, which will greatly facilitate the development of PRS models for complex diseases. Results: We develop statistical methods and an R package SummaryAUC for approximating the AUC and its variance of a PRS when only the summary level data of the validation dataset are available. SummaryAUC can be applied to PRSs with SNPs either genotyped or imputed in the validation dataset. We examined the performance of SummaryAUC using a large-scale GWAS of schizophrenia. SummaryAUC provides accurate approximations to AUCs and their variances. The bias of AUC is typically less than 0.5% in most analyses. SummaryAUC cannot be applied to PRSs that use all SNPs in the genome because it is computationally prohibitive. Availability: https://github.com/lsncibb/SummaryAUC

Download data

  • Downloaded 520 times
  • Download rankings, all-time:
    • Site-wide: 19,451 out of 65,690
    • In bioinformatics: 2,891 out of 6,504
  • Year to date:
    • Site-wide: 12,785 out of 65,690
  • Since beginning of last month:
    • Site-wide: 18,190 out of 65,690

Altmetric data


Downloads over time

Distribution of downloads per paper, site-wide


Sign up for the Rxivist weekly newsletter! (Click here for more details.)


News