Skip to main content
Download PDF

Development of a prognostic risk model for clear cell renal cell carcinoma by systematic evaluation of DNA methylation markers

Clinical Epigenetics volume 13, Article number: 103 (2021) Cite this article

Abstract

Background

Current risk models for renal cell carcinoma (RCC) based on clinicopathological factors are sub-optimal in accurately identifying high-risk patients. Here, we perform a head-to-head comparison of previously published DNA methylation markers and propose a potential prognostic model for clear cell RCC (ccRCC).

Patients and methods

Promoter methylation of PCDH8, BNC1, SCUBE3, GREM1, LAD1, NEFH, RASSF1A, GATA5, SFRP1, CDO1, and NEURL was determined by nested methylation-specific PCR. To identify clinically relevant methylated regions, The Cancer Genome Atlas (TCGA) was used to guide primer design. Formalin-fixed paraffin-embedded (FFPE) tissue samples from 336 non-metastatic ccRCC patients from the prospective Netherlands Cohort Study (NLCS) were used to develop a Cox proportional hazards model using stepwise backward elimination and bootstrapping to correct for optimism. For validation purposes, FFPE ccRCC tissue of 64 patients from the University Hospitals Leuven and a series of 232 cases from The Cancer Genome Atlas (TCGA) were used.

Results

Methylation of GREM1, GATA5, LAD1, NEFH, NEURL, and SFRP1 was associated with poor ccRCC-specific survival, independent of age, sex, tumor size, TNM stage or tumor grade. Moreover, the association between GREM1, NEFH, and NEURL methylation and outcome was shown to be dependent on the genomic region. A prognostic biomarker model containing GREM1, GATA5, LAD1, NEFH and NEURL methylation in combination with clinicopathological characteristics, performed better compared to the model with clinicopathological characteristics only (clinical model), in both the NLCS and the validation population with a c-statistic of 0.71 versus 0.65 and a c-statistic of 0.95 versus 0.86 consecutively. However, the biomarker model had limited added prognostic value in the TCGA series with a c-statistic of 0.76 versus 0.75 for the clinical model.

Conclusion

In this study we performed a head-to-head comparison of potential prognostic methylation markers for ccRCC using a novel approach to guide primers design which utilizes the optimal location for measuring DNA methylation. Using this approach, we identified five methylation markers that potentially show prognostic value in addition to currently known clinicopathological factors.

Highlights

  • This work represents a head to head comparison of promising published DNA methylation biomarkers for ccRCC.

  • TCGA data was used to select optimal DNA methylation location to guide primer design.

  • We propose a new prognostic model for ccRCC adding five DNA methylation markers to the standard clinicopathological factors.

  • Preliminary results suggest added clinical value and merit further validation in larger cohort studies.

Introduction

Renal cell carcinoma (RCC) is the most common malignant neoplasm of the kidney and accounts for 2–3% of the total human cancer burden [1]. Clear cell RCC (ccRCC) is the most prevalent histopathological subtype, comprising 80–90% of all RCC cases [2]. Patients with non-metastatic ccRCC are treated with curative intent by (partial) nephrectomy. The clinical course after surgery is however erratic, as approximately 30% of these patients still develop metastases during follow-up and around ~ 10% die of disease progression within five years after surgery [3]. Currently, it is difficult to recognize these high-risk patients upon initial diagnosis. Despite the fact that current clinical characteristics or prognostic models, such as the TNM staging system, Fuhrman grading, the Stage, Size, Grade, and Necrosis (SSIGN) Risk Score, and the University of California Los Angeles Integrated Staging System (UISS), are considered to be strong prognostic indicators [4,5,6,7], these do not yet lead to the desired accuracy in predicting patient outcome. For example, the c-index for SSIGN to predict disease recurrence is 0.82, indicating that there is room for improvement. [8]. In addition, there have been several changes in the landscape of RCC management since the inception of such models. Therefore, there is a need to identify and develop additional molecular prognostic markers that can enhance the predictive performance of current prognostic models [5, 9,10,11,12,13].

In the search for prognostic markers, DNA methylation in particular has received recognition as epigenetic alterations are more frequently found in RCC compared to genetic alterations [14]. Despite this attention, DNA methylation biomarkers have not yet bridged the gap between laboratory and clinic [10], possibly due to lack of uniformity among the different studies [10, 15]. Particularly, observed disparities in genomic location of the methylation assay are suggested to have implications for the development of DNA methylation markers and their translation into clinic [16, 17].

To review the current evidence on methylation markers in RCC, we previously performed a systematic review and identified GREM1, RASSF1A, GATA5, LAD1, NEFH, SCUBE3, PCDH8, SFRP1, and BNC1 as the most promising prognostic methylation markers for RCC at the moment [15]. We also previously identified a DNA methylation marker panel consisting of GREM1, LAD1, NEURL, and NEFH that predicts disease outcome for ccRCC patients [18].

Despite the fact that these markers, and approximately 70 other potential prognostic methylation markers for RCC, have been published over the last decades [15], a direct comparison of the performance of all these markers is lacking and none of these biomarkers is currently used in clinical practice. In this study, we performed a head-to-head comparison of the most promising methylation markers identified in literature using new technical assays designed to cover the most clinically relevant methylated genomic regions [16]. Prognostic value of the markers was assessed using multivariable prediction modeling in a series of ccRCC cases derived from the prospective Netherlands Cohort Study (NLCS). The performance of the final model was further validated in non-metastatic ccRCC cases collected from the archives of the Department of Pathology, Universtity Hospitals Leuven and in a series of ccRCC cases from The Cancer Genome Atlas (TCGA).

Materials and methods

Methylation specific PCR assay development

In our systematic review on prognostic methylation markers in RCC [15], we did not only observe extensive heterogeneity regarding the methylation analysis techniques used across the different studies, but also regarding the exact genomic location that was used to asses a particular gene. It is known that the clinical value of DNA methylation may differ according to the exact genomic location that is analyzed, even within the gene promoter region, which complicates head-to-head comparison of DNA methylation markers’ performance and hampers subsequent clinical translation [16, 17, 19]. We therefore applied the approach that we recently developed using publicly available DNA methylation data from The Cancer Genome Atlas (TCGA) [16] to determine the genomic location of methylation that is most likely to be clinically relevant and thus represents the optimal location for methylation assay development. Methylation data from ccRCC samples and normal kidney samples from TCGA were plotted to gain insight in the promoter CpG-island methylation pattern of each gene. Primers for methylation-specific PCR (MSP) were designed in regions in which there was statistically significant differential methylation between tumor and normal samples, and normal samples had a methylation level (i.e. the β-value) lower than 0.2 (see Additional file 1: Fig. S1 for examples).

Our previously designed MSP assays for GREM1 (three different regions [19]), LAD1, NEFH and NEURL were also re-evaluated to see whether we could further improve these assays. All our previously designed MSP assays were located at genomic regions that complied to the above-described criteria (data not shown). However, for LAD1, NEFH, and NEURL an additional, potentially clinically relevant promoter region was identified for which new assays were designed. Also, for PCDH8, BNC1, and SCUBE3 two clinically relevant regions were identified and two different assays were developed. However, the primer sets for BNC1 region i and SCUBE3 region ii failed optimization and were not used in further analyses.

Study population

Formalin-fixed paraffin-embedded (FFPE) primary ccRCC tissue samples were obtained from the NLCS, a prospective, population-based cohort study. This study was initiated in 1986 and included 120,852 men and women in the ages of 55–69 years at baseline [20]. After 20.3 years of follow-up, 608 incident RCC cases were identified and tumor tissues were collected from 51 pathology laboratories throughout the Netherlands. Tissue collection was conducted in two phases: initially only tumor samples of cases identified in the first 11.3 years of follow-up were included, but recently the series was expanded to 20.3 years of follow-up. Tumor tissue was available for 453 of the identified RCC cases. Hematoxylin and eosin (HE) stained slides of tumor tissues were revised by two experienced genitourinary pathologists to confirm tumor histology and Fuhrman grade. Information on patient and tumor characteristics (i.e. sex, age at diagnosis, TNM stage, and tumor size) was derived from the pathology reports and the cancer registry. TNM stage was classified according to the 1987 version of the TNM classification [21], as recoding to more recent TNM classifications was not possible due to a lack of needed information. Difference in tumor size between the 1987 version and more recent TNM classifications was addressed by including tumor size as a covariate in the statistical models. Follow-up was accomplished by record linkage to the causes of death registry from Statistics Netherlands and the municipal population registries. Patients included for this study had not received adjuvant therapy and further details of the tissue collection and follow-up have been described in detail elsewhere [22].

For this study, only patients with histologically confirmed ccRCC, with non-metastatic disease at diagnosis were included (n = 336). This led to the inclusion of some patients with TNM stage IV disease (n = 9) but with M0 regarding distant metastasis. The clinicopathological characteristics of the included patients are summarized in Additional file 1: Table S1 and S2.

For the validation of our proposed prognostic model, we used FFPE ccRCC tissue samples (n = 64) from the archives of the Department of Pathology, University Hospitals Leuven. These tumor samples were collected prospectively from patients with sporadic ccRCC, treated with radical or partial nephrectomy without any neo-adjuvant therapy, and are further referred to as the hospital-based series. All HE slides were revised by an experienced genitourinary pathologist. The clinicopathological characteristics of the included patients are summarized in Additional file 1: Table S3.

The Cancer Genome Atlas data analysis

A patient series with the same clinicopathological characteristics (i.e. ccRCC subtype, non-metastatic disease) with a median follow up of 39 months was derived from TCGA, and was used as an additional validation cohort (Additional file 1: Table S4). DNA promoter methylation was measured using the Illumina Human Methylation 450 K platform. For each of the five genes included in the final model, the probes located closest to, or within our primer region, were identified (Additional file 1: Table S5). For genes for which more than one probe was identified, the methylation level was determined by calculating the mean β-value of these probes. We defined methylated samples as those with a (mean) β-value of > 0.2.

DNA isolation and sodium bisulfite conversion

Genomic DNA from five 20-μm slices from FFPE ccRCC tissue from the population-based series, collected during the first 11.3 years of follow-up, was isolated as follows: paraffin was removed with xylene and genomic DNA was extracted by salt-precipitation. Briefly, 450 μl of cell lysis solution (10 mM Tris/HCl (pH 7.4), 400 mM NaCl, 2 mM EDTA), 25 μl of 10% SDS and 50 μl of proteinase K solution (20 mg/ml) were added to the tissue samples and incubated over-night at 55 °C. Proteins were precipitated using 175 μl of saturated NaCl, followed by centrifugation (2 min, 13.200 rpm). DNA was precipitated by the addition of 0.6 volumes of iso-propanol, dissolved in TE (pH 7.4) and stored at − 20 °C [23]. The isolated DNA was further cleaned up using QIAamp DNA Mini Kit (Qiagen, Venlo, the Netherlands) according to the manufacturer’s instructions. Genomic DNA from four 20 μm slices samples collected in the second phase of follow-up was isolated after macro-dissection using the QIAamp DNA Mini Kit (Qiagen, Venlo, the Netherlands) according to the manufacturer’s instructions. To isolate genomic DNA from the ccRCC hospital-based series FFPE samples, we first cut ten 10-μm slices, incubated the slides overnight at 37 °C and deparaffinized the sections by incubation for 5 min on Xylene twice. Afterwards, the slides were incubated twice for 3 min in 100% Ethanol, followed by an incubation for 1 min in 96% Ethanol and for 1 min in 70% Ethanol. Genomic DNA was thereafter isolated using the QIAamp DNA FFPE Tissue kit according to manufacturer’s protocol. The quality and concentration of the extracted DNA was estimated using NanoDrop quantification (NanoDrop ND-2000 m Spectrophotometer). To further evaluate the DNA integrity of our samples, we performed DNA integrity test on a subset of samples (Additional file 1: Table S12). In the population-based series, sodium bisulfite modification of 500 ng genomic DNA was performed using the EZ DNA Methylation Kit (Zymo Research, California, USA) according to the manufacturer’s instructions. In the hospital-based series, sodium bisulfite conversion of 500 ng genomic DNA was performed using EpiTect Bisulfite kit (Qiagen, Venlo, the Netherlands) according to manufacturer’s instructions.

Promoter CpG island methylation analysis

Promoter CpG-island methylation was determined by nested MSP [24].To facilitate MSP analysis on DNA derived from FFPE material, DNA was first amplified with flanking PCR primers. Details on MSP PCR protocol and conditions are described in Additional file 1: Table S6, S7, S8 and S9. All primer sequences are provided in Additional file 1: Table S10. All PCR reactions were performed with controls for unmethylated alleles (CpGenomeTM Human Non-Methylated DNA Standard, MerckMillipore, USA or EpiTect control DNA unmethylated, Qiagen, Venlo, The Netherlands), methylated alleles (CpGenomeTM Human Methylated DNA Standard, MerckMillipore, USA or an in-house prepared in vitro methylated DNA control), and a no-template control without DNA. Ten µl of each MSP reaction was directly loaded onto 3% agarose gels containing Midori Green Advance DNA Stain (Nippon Genetics Europe, Dueren, Germany) and visualized under UV illumination. Reproducibility of MSP analysis was assessed by repeating 10% of the cases. Representative agarose gel examples of MSP experiments are shown in Additional file 1: Fig. S2, S3, S4 and S5.

Statistical analysis

Cause-specific survival (CSS) was defined as time from cancer diagnosis until RCC-related death or end of follow-up. Analyses were restricted to 10 years after diagnosis as deaths related to RCC are not likely after that period.

Univariable survival analyses for all potential methylation markers separately were performed using Kaplan–Meier and log rank tests. Hazard ratios (HR) and corresponding 95% confidence intervals (CI) were determined with Cox proportional hazards models adjusted for potential confounders. Factors were considered possible confounders if they were known prognostic factors for RCC and included age at diagnosis (continuous), sex, and tumor size (mm). TNM staging was analyzed as a categorical factor stratifying into stage I, II, III and IV. Moreover, Fuhrman grading was also analyzed as a categorical factor distinguishing grade 1, 2, 3 and 4. To build a multivariable prediction model containing multiple methylation markers, we performed a backward stepwise elimination procedure using the likelihood-ratio test and a liberal α of 0.1 to prevent the exclusion of potentially important predictors from the model [25]. This was done to identify the most predictive combination of risk factors for survival of patients with non-metastatic ccRCC. Therefore, all known RCC prognostic factors (age at diagnosis, sex, TNM stage, tumor grade, and tumor size) were included in the model regardless of statistical significance. Continuous variables were included as such. We used restricted cubic splines to assess evidence of a non-linear association with the log-hazard of an event. The final model was compared with a model containing the known RCC prognostic factors (age at diagnosis, sex, TNM stage, Fuhrman grade, and tumor size) only. Model performance was assessed using Harrell’s c-statistic and Akaike’s Information Criteria (AIC). The preferred model was the one with the lowest AIC and the highest c-statistic (c-statistic was leading if the highest c-statistic did not have the lowest AIC). The initial prediction model was internally validated using bootstrapping (number of bootstraps was 1000) [25]. Results from this validation step were used to penalize the regression coefficients to prevent too optimistic predictions and to estimate an optimism-corrected c-statistic.

To visualize model performance in our dataset, risk scores for individual patients were computed based on the final model and were used to split the data into 3 subgroups based on tertiles. Kaplan–Meier curves were created for all subgroups. All analyses were performed using the statistical software STATA 14.1 and R 3.4.1.

Results

Patient characteristics and epigenetic characterization of ccRCCs

Additional file 1: Table S1 and S2 show the baseline characteristics of the population-based series. The majority of the patients was male (58.6%), and the mean age at diagnosis was 71.2 years. The median ccRCC-specific survival in the total population was 8.1 years. During 10 years follow-up, 122 patients died of a renal cancer-related cause. The frequency of promoter methylation of the studied genes ranged from 18% (SFRP1) to 84% (RASSF1A) (Additional file 1: Fig. S6 and Table S11). For PCDH8, LAD1, NEFH, and NEURL two, and in the case of GREM1 three, different locations within the promoter region were analyzed. The methylation frequencies of NEURL, LAD1, and GREM1 slightly differed according to the region analyzed (NEURL-i 39% vs. NEURL-ii 35%, LAD1-i 28% vs. LAD1-ii 37%, and GREM1-i 29% vs. GREM1-ii 42% vs. GREM1-iii 40%). For PCDH8 no difference in methylation frequency was observed, while for NEFH the methylation frequency greatly varied between the two regions analyzed (NEFH-i 28% vs. NEFH-ii 69%) (Additional file 1: Fig. S6 and Table S11).

Clinical value of DNA methylation is location dependent

Next, we used Kaplan–Meier analysis to examine the prognostic value of the 11 candidate DNA methylation markers (including the different genomic locations, in total 17 assays) in the population-based series of non-metastatic ccRCC cases (Additional file 1: Fig. S7 and Fig. S8). The methylation status of GREM1 (region i), LAD1 (region i and ii), NEFH (region i), NEURL (region ii), SFRP1, and GATA5 was significantly associated with poorer ccRCC-specific survival (log-rank test, P ≤ 0.0001–0.0117, Additional file 1: Fig. S7). Notably, the association between methylation of GREM1, NEFH, NEURL and patient outcome was dependent on the region that is methylated. For GREM1, only methylation of the region located most upstream of the TSS (GREM1-i) was associated with patient outcome (log-rank test, P = 0.0022), while for the other two regions no significant association with survival was found (log-rank test, GREM1-ii P = 0.5662 and GREM1-iii P = 0.2102). Also, for NEFH and NEURL, methylation of only one of the two studied regions was associated with ccRCC-specific survival (log-rank test, NEFH-i P = 0.0067 versus NEFH-ii P = 0.9680 and NEURL-i P = 0.1533 versus NEURL-ii P = 0.0010).

Multivariate Cox proportional hazards analyses showed that advanced disease stage and Fuhrman grade were independent, statistically significant predictors of poor survival (Additional file 1: Table S11). Subsequently, the prognostic value of the individual methylation markers was assessed in a multivariate model together with known prognostic variables (i.e. TNM stage, Fuhrman grade, and tumor size) including age at diagnosis and gender. In multivariate analyses, methylation of GREM1-i, LAD1-i, LAD1-ii, NEFH-i, NEURL-ii, SFRP1, and GATA5 remained statistically significant predictors of poor survival (HRGREM1-i 1.86 (95% CI 1.16–2.97), HRLAD1-i 2.26 (95% CI 1.47–3.48), HRLAD1-ii 1.71 (95% CI 1.12–2.61), HRNEFH-i 1.74 (95% CI 1.11–2.74), HRNEURL-ii 1.94 (95% CI 1.21–3.13), HRSFRP1 1.89 (95% CI 1.16–3.08), and HRGATA5 1.67 (95% CI 1.08–2.60) (Additional file 1: Table S11).

A prognostic risk model for patients with non-metastatic ccRCC

We next sought to determine whether these prognostic methylation markers could add prognostic value to the clinical variables that are currently used to predict prognosis (i.e. TNM stage, Fuhrman grade, and tumor size). The final prognostic risk model consisted of the standard prognostic variables and five methylation markers (i.e. NEFH-ii, GREM1-ii, GATA5, NEURL-ii and LAD1-ii). TNM stage, Fuhrman grade, and methylation of LAD1-ii were the most significant predictors of survival. All coefficients and HRs for the final model are presented in Table 1. The c-statistic for the final model was 0.71 (0.65 after correction for optimism), with an AIC of 674. Comparison with the clinical model containing the standard prognostic variables alone (c-statistic 0.65, AIC 681) showed that model fit and performance were better for our final prognostic model including the five methylation markers (Table 2). Kaplan–Meier curves were generated for the final model, showing a low-, intermediate- and high-risk group that could be identified with the prognostic model including the five methylation markers (Fig. 1).

Table 1 Hazard ratios for the final model in non-metastatic ccRCC (population-based series)
Full size table
Table 2 Comparison of model performance and fit
Full size table
Fig. 1
figure 1

Risk score calculated by final model and survival curves in the population-based ccRCC series. Kaplan–Meier curves for overall cause-specific survival based on risk score. Patients were divided into low-, intermediate-, and high-risk groups based on tertiles

Full size image

Validation of the prognostic risk model in the hospital-based series

Additional file 1: Table S3 shows the baseline characteristics of the hospital-based series. Compared to the population-based series, patients in the hospital-based series had a significantly lower mean age at diagnosis (59.3 ± 12.1 versus 71.2 ± 6.3 years). In both series, the majority of patients were diagnosed with stage II disease (61.9% and 59.6%). Except for the methylation of GREM1-ii, methylation frequencies of the genes included in the final model were comparable between the hospital-based and the population-based series (Additional file 1: Table S1, S2 and S3). Notably, performance of our final prognostic model in the hospital-based series was significantly better than its performance in the population-based series, with a c-statistic of 0.95 versus 0.71. Comparably, the model including only standard prognostic variables seemed to have a better performance in the hospital-based series with a c-statistic of 0.86 versus a c-statistic of 0.65 in the population-based series (Table 2). However, comparison of the clinical model with the final prognostic model in the hospital-based series revealed that model fit and performance were better for the final model, indicating that the addition of methylation markers to the clinical model provides additional prognostic value (Table 2).

Validation of the prognostic model in the TCGA series

Additional file 1: Table S4 shows the baseline characteristics of the TCGA series. Compared to the population-based series, patients in the TCGA series also had a lower mean age at diagnosis (61.7 ± 12.3 versus 71.2 ± 6.3), and considerably more patients were diagnosed with stage I disease (56.0% versus 5.7%), and hence fewer with stage II. Methylation frequencies of the five genes included in the model differed between the population-based and the TCGA series, with generally lower methylation frequencies in the TCGA series, except for methylation of NEURL-ii which was found to be methylated in 95% of the TCGA cases compared to 35% in the population-based series (Additional file 1: Table S1, S2 and S4). In this respect, it has to be pointed out that methylation in TCGA is measured using a quantitative assay (i.e. the Illumina Human Methylation 450 K platform) and that for some genes the available probes were not exactly located within the MSP assay (see Additional file 1: Table S5).

Performance of our prognostic model with the methylation markers in the TCGA series was somewhat better than its performance in the population-based series, with a c-statistic of 0.76 versus 0.71. However, the model including only standard prognostic variables without the methylation markers showed a comparable performance to the prognostic model with (Table 2). Hence, addition of the methylation markers to the model provided limited incremental prognostic value in the TCGA series.

Protein and mRNA expression data

No protein expression data was available for any of our markers in TCGA nor in the Central Proteomic Tumor Analysis Consortium. However, mRNA-seq data from TCGA revealed statistically significant differences between normal and tumor tissue (Mann–Whitney test, P < 0.05), as well as between normal and the various tumor stages (Kruskal–Wallis rank sum test, P < 0.05) for all the markers described (data not shown).

Discussion

In the present study, we performed a head-to-head comparison of reported potential prognostic methylation markers for ccRCC and developed a prognostic risk model for non-metastatic ccRCC patients that includes standard clinicopathological features plus five methylation markers. Our model including the methylation markers might have additional prognostic value as compared to the model including only clinicopathological factors.

Up until now, a direct comparison of the performance of suggested prognostic methylation biomarkers from previous studies has not been feasible, due to large differences among studies, especially in the exact genomic location of DNA-methylation assays [26]. In order to facilitate a direct comparison for this study, we applied our in-house developed strategy to design methylation assays at the clinically most relevant genomic location for all studied biomarkers [16].

A total of 6 (i.e. GREM1 (region i), LAD1 (region i and ii), NEFH (region i), NEURL (region ii), SFRP1, and GATA5) out of the 11 published, promising methylation markers were validated as predictors of CSS in a population-based series of ccRCC patients independent of standard prognostic variables. Using multivariable prediction modeling we developed a prognostic risk model including the standard prognostic variables and five methylation markers (i.e. NEFH-ii, GREM1-ii, GATA5, NEURL-ii and LAD1-ii) that appears to have independent prognostic value in addition to the standard clinical and pathological variables.

Our model showed similar results in a second, hospital-based series with a better prognostic performance of the prognostic model over the clinical model. However, in TCGA, performance of the model including standard prognostic variables was comparable to that of the model including the methylation markers. There are however extensive differences between the three study populations. Firstly, the population-based series has been prospectively collected from a representative base population, including up to 80% of all incident ccRCC cases. In contrast, the hospital-based series and the TCGA series represent a selected study population and, in the case of the TCGA series, with less detailed clinical and follow up data. Moreover, considerably more patients were diagnosed with stage I disease in the TCGA series compared to the population-based and hospital-based series. This could however be due to differences in the TNM version used. In the population-based series patients were staged according to the TNM classification from 1987. Conversion to the latest TNM classification was not possible due to lack of information in the cancer registry files and the pathological reports. Because the main difference between the TNM classifications is the cut-off values for tumor size, we added tumor size as a separate variable in our analyses. In addition to that, methylation in the TCGA is measured using the Illumina Human Methylation 450 K platform as a quantitative trait which forced us to set a cut-off value for methylation above a β-value of 0.2. Although this is a commonly used value, altering this threshold may influence the methylation status of the samples and eventual conclusions. This could explain the disparities in methylation frequencies between the population-based, hospital-based and TCGA series.

Interestingly, for LAD1, NEFH, and NEURL, only one of the designed MSP assays was retained in the final model. This suggests that only methylation at that specific region has independent prognostic value. Traditionally, research in the DNA methylation marker field has focused on hypermethylation of the promoter region of genes [27] and undervalued the fact that not all CpGs in the promoter region are functionally uniform [16, 28]. The importance of the genomic location of DNA methylation markers and its biological and clinical relevance has previously been postulated [17, 19]. Here, we therefore utilized publicly available DNA methylation data from TCGA to select the optimal location for DNA methylation-based biomarker development [16] for each of the genes. Results suggest that for GREM1, NEFH, and NEURL the association between methylation and patient outcome was indeed dependent on the chosen assay location, supporting the fact that the location of DNA methylation influences the clinical relevance of the marker. These observations further highlight that the location of the CpG dinucleotides to be analyzed and with this namely MSP primer location and design can influence the observed methylation frequency and clinical relevance. Moreover, this highlights that developing an optimal methylation assay should not be solely dependent on selecting the optimal methylation location but also on combining that with clinical outcome factors.

We further explored the biological relevance of these markers and found that GREM1 is a member of the cystine knot superfamily and a bone morphogenetic protein (BMP) antagonist [29, 30] and that it plays a crucial role in embryogenesis, tissue differentiation and organ development through the regulation of the BMPs [31]. Several studies revealed its involvement in renal inflammation [32, 33] and renal fibrosis [34] through the epithelia mesenchymal transition (EMT) process, which in turn is critical for tumor metastasis and cancer progression [35]. Additionally, GREM1 stimulates angiogenesis and neovascularization by binding directly to vascular endothelial growth factor (VEGF) receptor 2 (VEGFR2) [36].

GATA 5 is a zinc-finger transcription factor and member of the GATA family proteins 1–6 and is known to be involved in cellular differentiation [37]. It has been reported that hypermethylation of GATA5 is associated with metastasis and progression‐free survival of RCC patients [38]. Besides that, several studies have shown that reduced GATA 5 mRNA levels were associated with a poor clinical outcome, indicating a possible role of GATA 5 for the development of aggressive ccRCC phenotypes [37].

LAD 1 is a relatively uncharacterized protein and is proposed to contribute to the stability of the association of the epithelial layers with the underlying mesenchyme. Therefore, it is believed that LAD 1 is involved in cell adhesion, cytoskeleton organization and invasion [14, 39, 40].

NEFH gene encodes the heavy neurofilament protein [41] and is suggested to play a role in the cell motility [14, 42]. Moreover, in tumor cells, loss of NEFH by promoter methylation leads to increased aerobic glycolysis and mitochondrial dysfunction [43] and could, therefore, contribute to the metabolic shift that is observed in aggressive ccRCC [44].

The NEURL on the other hand acts as a tumor suppressor [45] and is involved in the Notch signaling pathway [18, 46] which is critical for determination of cell fates within a wide variety of tissues by regulation of growth, differentiation, and apoptosis. Furthermore, several studies revealed that the Notch signaling pathway has an important role in the development of the mammalian kidney whereby several key members of the Notch cascade are expressed during nephrogenesis [47].

Although our model including the five methylation markers showed some incremental prognostic value compared with standard clinicopathological variables alone, we were not able to evaluate whether the identified prognostic methylation markers were also able to further improve other established prognostic models such as the UISS and the SSIGN score [5], due to lack of information on tumor necrosis and patients’ performance status in our patient series. This would however be important as these prognostic models are now considered efficacious tools in tailoring RCC management and making decisions for selection for adjuvant therapy [48]. Moreover, we have developed our prognostic model using stepwise backward elimination which, despite being the most popular variable selection method, has its shortcomings [49]. For example, backward elimination can lead to bias in parameter estimation as once a variable is eliminated from the model it is not re-entered again, whilst a dropped variable may become significant later in the final model [49].

Furthermore, we were not able to assess the effect of intratumor heterogeneity (ITH) on the performance of our model, as no multi-region sampling was performed at the time of tumor tissue collection. ITH can impede biomarker development due to sampling bias [50, 51] and can affect the reproducibility of biomarkers when relying solely on a single area of the tumor [52]. However, in contrast to the extensive genetic ITH observed in RCC, epigenetic intratumor heterogeneity (eITH), in particular DNA methylation, seems to be less prominent [53]. It is warranted that multiregion sampling is performed in further validation studies of our proposed prognostic model, as this will contribute to elucidating a possible impact of ITH on the performance of our prognostic model.

Conclusion

This work presents a head-to-head comparison of prognostic methylation markers for RCC using a novel approach to determine the optimal location for DNA methylation-based biomarker development. We demonstrated that using epigenomic TCGA data to guide methylation assay design is a suitable approach to identify clinically relevant regions of methylation. Using this concept, we were able to develop a prognostic risk model, including DNA methylation markers, for ccRCC that is suggested to have additional value in patients with localized ccRCC compared with the typical clinicopathological risk factors. This indicates that evaluating well defined and validated molecular markers for incremental value to existing models is worth the effort. However, further validation in large prospective series with extended patient data that comply with the requirements of the current prognostic models in practice, such as the SSIGN score and UISS, is crucial to establish its actual clinical value.

Availability of data and material

All data generated or analyzed during this study are included in this published article [and its supplementary information files].

References

  1. Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, et al. Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer. 2015;136(5):E359–86.

    Article  CAS  PubMed  Google Scholar 

  2. Moch H. An overview of renal cell cancer: pathology and genetics. Semin Cancer Biol. 2013;23(1):3–9.

    Article  CAS  PubMed  Google Scholar 

  3. Lerner SE, Hawkins CA, Blute ML, Grabner A, Wollan PC, Eickholt JT, et al. Disease outcome in patients with low stage renal cell carcinoma treated with nephron sparing or radical surgery. J Urol. 1996;155(6):1868–73.

    Article  CAS  PubMed  Google Scholar 

  4. Volpe A, Patard JJ. Prognostic factors in renal cell carcinoma. World J Urol. 2010;28(3):319–27.

    Article  PubMed  Google Scholar 

  5. Downs TM, Schultzel M, Shi H, Sanders C, Tahir Z, Sadler GR. Renal cell carcinoma: risk assessment and prognostic factors for newly diagnosed patients. Crit Rev Oncol Hematol. 2009;70(1):59–70.

    Article  PubMed  Google Scholar 

  6. Parker WP, Cheville JC, Frank I, Zaid HB, Lohse CM, Boorjian SA, et al. Application of the stage, size, grade, and necrosis (SSIGN) score for clear cell renal cell carcinoma in contemporary patients. Eur Urol. 2017;71(4):665–73.

    Article  PubMed  Google Scholar 

  7. Ficarra V, Novara G, Galfano A, Brunelli M, Cavalleri S, Martignoni G, Artibani W. The ‘Stage, Size, Grade and Necrosis’ score is more accurate than the University of California Los Angeles Integrated Staging System for predicitng cancer-specific survival in patients with clear cell renal cell carcinoma. BJUI. 2008;103(2):165–70.

    Article  Google Scholar 

  8. Crispen PL, Boorjian SA, Lohse CM, Leibovich BC, Kwon ED. Predicting disease progression after nephrectomy for localized renal cell carcinoma: the utility of prognostic models and molecular biomarkers. Cancer. 2008;113(3):450–60.

    Article  PubMed  Google Scholar 

  9. Klatte T, Seligson DB, LaRochelle J, Shuch B, Said JW, Riggs SB, et al. Molecular signatures of localized clear cell renal cell carcinoma to predict disease-free survival after nephrectomy. Cancer Epidemiol Biomarkers Prev. 2009;18(3):894–900.

    Article  CAS  PubMed  Google Scholar 

  10. Peters I, Merseburger AS, Tezval H, Lafos M, Tabrizi PF, Mazdak M, Wolters M, Kuczyk MA, Serth J, von Klot CA. The prognostic value of DNA methylation markers in renal cell cancer : a systematic review. Kidney Cancer. 2019;4:3–13.

    Article  Google Scholar 

  11. Lasseigne BN, Brooks JD. The role of DNA methylation in renal cell carcinoma. Mol Diagn Ther. 2018;22(4):431–42.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Zhang L, Zha Z, Qu W, Zhao H, Yuan J, Feng Y, et al. Tumor necrosis as a prognostic variable for the clinical outcome in patients with renal cell carcinoma: a systematic review and meta-analysis. BMC Cancer. 2018;18(1):870.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Buti S. A new prognostic model for localized renal cell carcinoma. World J Urol. 2019;37(1):211–2.

    Article  PubMed  Google Scholar 

  14. Joosten SC, Smits KM, Aarts MJ, Melotte V, Koch A, Tjan-Heijnen VC, et al. Epigenetics in renal cell cancer: mechanisms and clinical applications. Nat Rev Urol. 2018;15(7):430–51.

    Article  CAS  PubMed  Google Scholar 

  15. Joosten SC, Deckers IA, Aarts MJ, Hoeben A, van Roermund JG, Smits KM, et al. Prognostic DNA methylation markers for renal cell carcinoma: a systematic review. Epigenomics. 2017;9(9):1243–57.

    Article  CAS  PubMed  Google Scholar 

  16. Koch A, Joosten SC, Feng Z, de Ruijter TC, Draht MX, Melotte V, et al. Analysis of DNA methylation in cancer: location revisited. Nat Rev Clin Oncol. 2018;15(7):459–66.

    Article  CAS  PubMed  Google Scholar 

  17. van Vlodrop IJ, Niessen HE, Derks S, Baldewijns MM, van Criekinge W, Herman JG, et al. Analysis of promoter CpG island hypermethylation in cancer: location, location, location! Clin Cancer Res. 2011;17(13):4225–31.

    Article  PubMed  Google Scholar 

  18. van Vlodrop IJH, Joosten SC, De Meyer T, Smits KM, Van Neste L, Melotte V, et al. A four-gene promoter methylation marker panel consisting of GREM1, NEURL, LAD1, and NEFH predicts survival of clear cell renal cell cancer patients. Clin Cancer Res. 2017;23(8):2006–18.

    Article  PubMed  Google Scholar 

  19. van Vlodrop IJ, Baldewijns MM, Smits KM, Schouten LJ, van Neste L, van Criekinge W, et al. Prognostic significance of Gremlin1 (GREM1) promoter CpG island hypermethylation in clear cell renal cell carcinoma. Am J Pathol. 2010;176(2):575–84.

    Article  PubMed  PubMed Central  Google Scholar 

  20. van den Brandt PA, van’t Goldbohm RA, Veer P, Volovics A, Hermus RJ, Sturmans F. A large-scale prospective cohort study on diet and cancer in The Netherlands. J Clin Epidemiol. 1990;43(3):285–95.

    Article  PubMed  Google Scholar 

  21. Hermanek P, Scheibe O, Spiessl B, Wagner G. TNM classification of malignant tumors: the new 1987 edition. Rontgenblatter. 1987;40(6):200.

    CAS  PubMed  Google Scholar 

  22. Deckers IA, Schouten LJ, Van Neste L, van Vlodrop IJ, Soetekouw PM, Baldewijns MM, et al. Promoter methylation of CDO1 identifies clear-cell renal cell cancer patients with poor survival outcome. Clin Cancer Res. 2015;21(15):3492–500.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. van Houwelingen KP, van Dijk BA, Hulsbergen-van-de Kaa CA, Schouten LJ, Gorissen HJ, Schalken JA, et al. Prevalence of von Hippel-Lindau gene mutations in sporadic renal cell carcinoma: results from The Netherlands cohort study. BMC Cancer. 2005;5:57.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Derks S, Lentjes MH, Hellebrekers DM, de Bruine AP, Herman JG, van Engeland M. Methylation-specific PCR unraveled. Cell Oncol. 2004;26(5–6):291–9.

    CAS  PubMed  PubMed Central  Google Scholar 

  25. Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer; 2001.

    Book  Google Scholar 

  26. Kern SE. Why your new cancer biomarker may never work: recurrent patterns and remarkable diversity in biomarker failures. Cancer Res. 2012;72(23):6097–101.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Baylin SB, Herman JG, Graff JR, Vertino PM, Issa JP. Alterations in DNA methylation: a fundamental aspect of neoplasia. Adv Cancer Res. 1998;72:141–96.

    Article  CAS  PubMed  Google Scholar 

  28. Lioznova AV, Khamis AM, Artemov AV, Besedina E, Ramensky V, Bajic VB, et al. CpG traffic lights are markers of regulatory regions in human genome. BMC Genomics. 2019;20(1):102.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Brazil DP, Church RH, Surae S, Godson C, Martin F. BMP signalling: agony and antagony in the family. Trends Cell Biol. 2015;25(5):249–64.

    Article  CAS  PubMed  Google Scholar 

  30. Kisonaite M, Wang X, Hyvonen M. Structure of Gremlin-1 and analysis of its interaction with BMP-2. Biochem J. 2016;473(11):1593–604.

    Article  CAS  PubMed  Google Scholar 

  31. Gazzerro E, Smerdel-Ramoya A, Zanotti S, Stadmeyer L, Durant D, Economides AN, et al. Conditional deletion of gremlin causes a transient increase in bone formation and bone mass. J Biol Chem. 2007;282(43):31549–57.

    Article  CAS  PubMed  Google Scholar 

  32. Lavoz C, Poveda J, Marquez-Exposito L, Rayego-Mateos S, Rodrigues-Diez RR, Ortiz A, et al. Gremlin activates the Notch pathway linked to renal inflammation. Clin Sci (Lond). 2018;132(11):1097–115.

    Article  CAS  PubMed  Google Scholar 

  33. Lavoz C, Alique M, Rodrigues-Diez R, Pato J, Keri G, Mezzano S, et al. Gremlin regulates renal inflammation via the vascular endothelial growth factor receptor 2 pathway. J Pathol. 2015;236(4):407–20.

    Article  CAS  PubMed  Google Scholar 

  34. Church RH, Ali I, Tate M, Lavin D, Krishnakumar A, Kok HM, et al. Gremlin1 plays a key role in kidney development and renal fibrosis. Am J Physiol Renal Physiol. 2017;312(6):F1141–57.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Heerboth S, Housman G, Leary M, Longacre M, Byler S, Lapinska K, et al. EMT and tumor metastasis. Clin Transl Med. 2015;4:6.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Qi JH, Ebrahem Q, Moore N, Murphy G, Claesson-Welsh L, Bond M, et al. A novel function for tissue inhibitor of metalloproteinases-3 (TIMP3): inhibition of angiogenesis by blockage of VEGF binding to VEGF receptor-2. Nat Med. 2003;9(4):407–15.

    Article  CAS  PubMed  Google Scholar 

  37. Peters I, Dubrowinskaja N, Kogosov M, Abbas M, Hennenlotter J, von Klot C, et al. Decreased GATA5 mRNA expression associates with CpG island methylation and shortened recurrence-free survival in clear cell renal cell carcinoma. BMC Cancer. 2014;14:101.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Peters I, Eggers H, Atschekzei F, Hennenlotter J, Waalkes S, Trankenschuh W, et al. GATA5 CpG island methylation in renal cell cancer: a potential biomarker for metastasis and disease progression. BJU Int. 2012;110(2 Pt 2):E144–52.

    Article  CAS  PubMed  Google Scholar 

  39. Banumathy G, Cairns P. Signaling pathways in renal cell carcinoma. Cancer Biol Ther. 2010;10(7):658–64.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Dulaimi E, Ibanez de Caceres I, Uzzo RG, Al-Saleem T, Greenberg RE, Polascik TJ, et al. Promoter hypermethylation profile of kidney cancer. Clin Cancer Res. 2004;10(12 Pt 1):3972–9.

    Article  CAS  PubMed  Google Scholar 

  41. Lee MK, Cleveland DW. Neuronal intermediate filaments. Annu Rev Neurosci. 1996;19:187–217.

    Article  CAS  PubMed  Google Scholar 

  42. Dubrowinskaja N, Gebauer K, Peters I, Hennenlotter J, Abbas M, Scherer R, et al. Neurofilament Heavy polypeptide CpG island methylation associates with prognosis of renal cell carcinoma and prediction of antivascular endothelial growth factor therapy response. Cancer Med. 2014;3(2):300–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Dallol A, Forgacs E, Martinez A, Sekido Y, Walker R, Kishida T, et al. Tumour specific promoter region methylation of the human homologue of the Drosophila Roundabout gene DUTT1 (ROBO1) in human cancers. Oncogene. 2002;21(19):3020–8.

    Article  CAS  PubMed  Google Scholar 

  44. Tessarz P, Kouzarides T. Histone core modifications regulating nucleosome structure and dynamics. Nat Rev Mol Cell Biol. 2014;15(11):703–8.

    Article  CAS  PubMed  Google Scholar 

  45. Sjolund J, Johansson M, Manna S, Norin C, Pietras A, Beckman S, et al. Suppression of renal cell carcinoma growth by inhibition of Notch signaling in vitro and in vivo. J Clin Invest. 2008;118(1):217–28.

    Article  PubMed  Google Scholar 

  46. Schouten LJ, Deckers IA, van den Brandt PA, Baldewijns MM, van Engeland M. Alcohol and dietary folate intake and promoter CpG island methylation in clear-cell renal cell cancer. Nutr Cancer. 2016;68(7):1097–107.

    Article  CAS  PubMed  Google Scholar 

  47. Chen L, Al-Awqati Q. Segmental expression of Notch and Hairy genes in nephrogenesis. Am J Physiol Renal Physiol. 2005;288(5):F939–52.

    Article  CAS  PubMed  Google Scholar 

  48. Thompson RH, Leibovich BC, Lohse CM, Cheville JC, Zincke H, Blute ML, et al. Dynamic outcome prediction in patients with clear cell renal cell carcinoma treated with radical nephrectomy: the D-SSIGN score. J Urol. 2007;177(2):477–80.

    Article  PubMed  Google Scholar 

  49. Chowdhury MZI, Turin TC. Variable selection strategies and its importance in clinical prediction modelling. Fam Med Commun Health. 2020;8(1):e000262.

    Article  Google Scholar 

  50. Gerlinger M, Horswell S, Larkin J, Rowan AJ, Salm MP, Varela I, et al. Genomic architecture and evolution of clear cell renal cell carcinomas defined by multiregion sequencing. Nat Genet. 2014;46(3):225–33.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  51. Gerlinger M, Rowan AJ, Horswell S, Math M, Larkin J, Endesfelder D, et al. Intratumor heterogeneity and branched evolution revealed by multiregion sequencing. N Engl J Med. 2012;366(10):883–92.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Cyll K, Ersvaer E, Vlatkovic L, Pradhan M, Kildal W, Avranden Kjaer M, et al. Tumour heterogeneity poses a significant challenge to cancer biomarker research. Br J Cancer. 2017;117(3):367–75.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Stewart GD, Powles T, Van Neste C, Meynert A, O’Mahony F, Laird A, et al. Dynamic epigenetic changes to VHL occur with sunitinib in metastatic clear cell renal cancer. Oncotarget. 2016;7(18):25241–50.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Funding

This work was supported by the PPP Allowance made available by Health ~ Holland, Top Sector Life Sciences and Health, to stimulate public–private partnerships, grant number LSHM17059 (PRECEDE).

Author information

Author notes

  1. S.C. Joosten and S.N.O. Odeh contributed equally to this work

Authors and Affiliations

  1. Department of Pathology, GROW – School for Oncology and Developmental Biology, Maastricht University Medical Center, P.O. Box 5800, 6202 AZ, Maastricht, The Netherlands

    S. C. Joosten, S. N. O. Odeh, A. Koch, N. Buekers, L. Van Neste, M. van Engeland & K. M. Smits

  2. Department of Medical Oncology, GROW – School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands

    S. C. Joosten, M. J. B. Aarts & V. C. Tjan-Heijnen

  3. Department of Pathology, University Hospitals Leuven, Leuven, Belgium

    M. M. L. L. Baldewijns

  4. Department of Clinical Epidemiology and Medical Technology Assessment, GROW – School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands

    S. van Kuijk

  5. Department of Epidemiology, GROW – School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands

    L. J. Schouten & P. A. van den Brandt

Authors
  1. S. C. Joosten
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. N. O. Odeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Koch
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. N. Buekers
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. M. J. B. Aarts
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. M. M. L. L. Baldewijns
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. L. Van Neste
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. S. van Kuijk
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. L. J. Schouten
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. P. A. van den Brandt
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. V. C. Tjan-Heijnen
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. M. van Engeland
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. K. M. Smits
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Kim M. Smits had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Joosten, Odeh, Smits. Acquisition of data: Joosten, Odeh, Smits. Analysis and interpretation of data: Joosten, Odeh, Koch, Beukers, Aarts, Baldewijns, van Neste, van Kuik, Schouten, van den Brandt, Tjan-Heijnen, van Engeland, Smits. Drafting of the manuscript: Joosten, Odeh, Smits. Critical revision of the manuscript for important intellectual content: Joosten, Odeh, Koch, Beukers, Aarts, Baldewijns, van Neste, van Kuik, Schouten, van den Brandt, Tjan-Heijnen, van Engeland, Smits Statistical analysis: van Kuik, Smits. Obtaining funding: Smits. Supervision: Smits. All authors have approved the submitted version and have agreed both to be personally accountable for the author's own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature. All authors read and approved the final manuscript.

Corresponding author

Correspondence to K. M. Smits.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Medical Ethical Committee of the Maastricht University Medical Center.

Consent for publication

Not applicable.

Competing interests

Manon van Engeland is co-founder and shareholder of Epify BV.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Supplementary Tables and Figures.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Joosten, S.C., Odeh, S.N.O., Koch, A. et al. Development of a prognostic risk model for clear cell renal cell carcinoma by systematic evaluation of DNA methylation markers. Clin Epigenet 13, 103 (2021). https://0-doi-org.brum.beds.ac.uk/10.1186/s13148-021-01084-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13148-021-01084-8

Keywords

Clinical Epigenetics

ISSN: 1868-7083

Contact us