The Open Targets Platform allows prioritisation of drug targets based on the strength of their association with a disease.
We allow for the prioritisation of targets by scoring target-disease associations based on evidence from our data sources. Similar data sources (e.g. GWAS Catalog and PheWAS) are grouped together into data types (e.g. Genetic associations). The score for the associations ranges from 0 to 1; the stronger the evidence for an association, the stronger the association score (closer to 1). A score of 0 corresponds to no evidence supporting an association. In the Open Targets Platform, we represent the different scores with varying shades of blue: the darker the blue, the stronger the association.
What are the factors that affect the confidence we have in the evidence used for our associations? We assess key factors such as frequency, severity and significance of the evidence to provide association scores to help you answer these questions:
Which targets have the most evidence for being associated with a disease?
What is the relative weight of the evidence for different targets associated with a disease?
Our scoring framework is a four-tier process: we first score the individual evidence, then we aggregate the evidence scores into data sources scores, followed by the aggregation of data source scores to give rise to the data types scores. Our overall association score is the result of the aggregation of all data source scores together.
We start by generating a score for each evidence from different data sources (e.g. GWAS catalog, European Variation Archive) within a data type (e.g. Genetic associations). We define the evidence score as:
s = F * S * C
s = score
F = frequency, the relative occurrence of a target-disease evidence
S = severity, the magnitude or strength of the effect described by the evidence
C = confidence, overall confidence for the observation that generates the target-disease evidence
The evidence score summarises the strength of the evidence and depends on factors that affect its relative strength. These factors are specific to the different data sources in the Platform:
Data sources and factors that affect the relative strength of the evidence scores
GWAS and PheWASCatalog (functional consequence score of variants, normalised p-value and normalised sample size); European Variation Archive (functional consequence score of variants e.g. germline variants that cause transcript ablation will have a score of 1, whereas variants that are intronic will have a score of 0.5); UniProt (curator inference score based on how strong the evidence for the gene's involvement in the disease is. If the evidence is strong, the score will be 1. For evidence deemed not to be strong by the curator, the score will be 0.5); Gene2Phenotype (variants are inferred by curators and will have a score of 1, the highest functional consequence score); Genomics England PanelAPP (gene-disease associations are curated and crowdsourced by experts and will have the highest score of 1)
Cancer Gene Census (functional consequence score of variants); European Variation Archive (functional consequence score of variants); IntOgen (binned score based on tumour type categories. If the gene has several signals of positive selections in the tumour, the score will be 0.25. If the gene is already described as a cancer gene and exhibits a signal of positive selection in a tumor type, the score will be 0.5. If in addition to a signal of positive selection, the gene is functionally connected to other genes in the same tumor type, the score will be 0.75)
ChEMBL (Clinical trials phase binned score. Scores will be 0.09 for phase 0, 0.1 for phase I, 0.2 for Phase II, 0.7 for Phase III, and 1 for Phase IV drugs)
Pathways & systems biology, previously known as
Reactome (functional consequence of 1 for a pathway inferred by a curator). Sysbio (p-values or rank-based scores are used for scoring if provided, otherwise a score of 0.5 is assigned). SLAPenrich (scored according to Iorio F et al 2018 followed by quantifying, in large cohorts of cancer patients, the divergence of the total number of samples with genomic alterations in a Reactome-pathway from its expectation, accounting for mutational burdens and total exonic block lengths of genes in that pathway.) PROGENy (scored per sample and pathway following a modifications of the original implementation described by Schubert et al. 2016. Further details can be found elsewhere.)
Expression Atlas score (normalised p-value, normalised expression fold change and normalised percentile rank)
Europe PMC (weighted document sections, sentence locations and title for full text articles and abstracts (Kafkas et al 2016))
Once we have the scores for each evidence, we calculate an overall score for a data source (e.g. Genomics England PanelAPP) followed by a score for a data type (e.g. Genetic associations). In this step, we take into account that although multiple occurrences of evidence can suggest a strong association, the inclusion of further new evidence should not have a great impact on the overall score. For this reason, we calculate the sum of the harmonic progression of each score and adjust the contribution of each of them using a heuristic weight. Throughout this process, the value of the score is always capped at 1, the highest association score. Note that some data sources will be down weighted, namely
Europe PMC (see the image above for more details).
Our current scoring framework is a modified version of the original one described "Open Targets: a platform for therapeutic target identification and validation" and it is available on GitHub.
We will continue to explore and work on alternative statistical models to keep providing robust scoring systems for our target-disease associations. If you have questions or want to discuss this further, please email our Support team.