- Technical advance
- Open Access
- Open Peer Review
Identification of risk factors for hospital admission using multiple-failure survival models: a toolkit for researchers
BMC Medical Research Methodology volume 16, Article number: 46 (2016)
The UK population is ageing; improved understanding of risk factors for hospital admission is required. Linkage of the Hertfordshire Cohort Study (HCS) with Hospital Episode Statistics (HES) data has created a multiple-failure survival dataset detailing the characteristics of 2,997 individuals at baseline (1998–2004, average age 66 years) and their hospital admissions (regarded as ‘failure events’) over a 10 year follow-up. Analysis of risk factors using logistic regression or time to first event Cox modelling wastes information as an individual’s admissions after their first are disregarded. Sophisticated analysis techniques are established to examine risk factors for admission in such datasets but are not commonly implemented.
We review analysis techniques for multiple-failure survival datasets (logistic regression; time to first event Cox modelling; and the Andersen and Gill [AG] and Prentice, Williams and Peterson Total Time [PWP-TT] multiple-failure models), outline their implementation in Stata, and compare their results in an analysis of housing tenure (a marker of socioeconomic position) as a risk factor for different types of hospital admission (any; emergency; elective; >7 days). The AG and PWP-TT models include full admissions histories in the analysis of risk factors for admission and account for within-subject correlation of failure times. The PWP-TT model is also stratified on the number of previous failure events, allowing an individual’s baseline risk of admission to increase with their number of previous admissions.
All models yielded broadly similar results: not owner-occupying one’s home was associated with increased risk of hospital admission. Estimated effect sizes were smaller from the PWP-TT model in comparison with other models owing to it having accounted for an increase in risk of admission with number of previous admissions. For example, hazard ratios [HR] from time to first event Cox models were 1.67(95 % CI: 1.36,2.04) and 1.63(95 % CI:1.36,1.95) for not owner-occupying one’s home in relation to risk of emergency admission or death among women and men respectively; corresponding HRs from the PWP-TT model were 1.34(95 % CI:1.15,1.56) for women and 1.23(95 % CI:1.07,1.41) for men.
The PWP-TT model may be implemented using routine statistical software and is recommended for the analysis of multiple-failure survival datasets which detail repeated hospital admissions among older people.
The UK population is ageing ; improved understanding of lifecourse risk factors for hospital admission is required to identify subgroups of the population who are at increased risk of hospital admission, and to inform the development of intervention strategies to delay or prevent admissions to hospital .
Recent linkage between the Hertfordshire Cohort Study (HCS) database and routinely collected Hospital Episode Statistics (HES) data has yielded a complex dataset which comprises baseline information on socio-demographic, lifestyle and clinical characteristics of 2,997 community-dwelling men and women (average age 66 years at baseline 1998–2004) together with details of all inpatient hospital admissions over a 10 year follow-up period . HCS is the first UK birth cohort study to link with HES data but other well established UK cohorts [4, 5] have the potential to do so. Cohort study databases that have been linked with HES data are a rich resource for the investigation of risk factors for hospital admission among older men and women but require sophisticated statistical analysis techniques if they are to be fully explored.
A dataset which contains information about hospital admission histories for study participants may be referred to as a ‘multiple-failure survival dataset’. In this context, a hospital admission is regarded as a ‘failure event’; study participants may experience none, one, or many failure events during the study follow-up period. Statistical analysis techniques for multiple-failure survival datasets are well established [6, 7] but little applied in medical research owing to their complexity. We are not aware of any previous publications that have used multiple-failure survival analysis techniques to analyse risk factors for hospital admission among community-dwelling older people in the UK.
The objectives of this paper are to provide researchers with a ‘toolkit’ for the analysis of multiple-failure survival datasets by: reviewing suitable statistical analysis techniques; outlining their implementation using the Stata statistical software package; and contrasting the application of these techniques to an analysis of the association between housing tenure, a marker of socioeconomic position, and different types of hospital admission in the linked HCS-HES dataset.
Structure of the linked HCS-HES multiple-failure survival dataset
Hertfordshire cohort study
The Hertfordshire Cohort Study has been described in detail previously . In brief, the cohort comprises 1579 men and 1418 women born in Hertfordshire between 1931 and 1939 and who still lived in the county between 1998 and 2004 when they participated in a nurse administered home interview and attended a clinic for detailed physiological investigations. The HCS database includes detailed information on study participants’ socio-demographic, lifestyle and clinical characteristics. The study had ethical approval from the Hertfordshire and Bedfordshire Local Research Ethics Committee. All participants gave signed consent for the investigations they underwent in clinic and for researchers to access their medical records in the future. Investigations on participants were conducted in accordance with the principles expressed in the Declaration of Helsinki. Participants are flagged for continuous notification of death on the Central Register at the NHS Information Centre.
Linkage with HES data
Permission to obtain a HES extract for HCS participants covering the period 01/04/98–31/03/10 was granted by the Ethics and Confidentiality Committee of the National Information Governance Board. Linkage of the HCS database with Hospital Episode Statistics (HES) data has been described in detail previously ; the HES extract included information on date and method of admission (elective or emergency), primary diagnoses coded to ICD-10, and date of discharge. A total of 8687 admissions was identified among 2161 HCS participants after their date of HCS baseline clinic but before 31/3/10; 836 had no admissions. In total, 275 members of the cohort had died during the follow-up period, 21 without admission, 127 during an admission and 127 after being discharged alive.
Extract of the HCS-HES multiple-failure survival dataset
In this paper, we regard hospital admission or death as failure events. Accordingly, by the end of follow-up, a participant will have experienced one of the following:
no admissions and survived (no failures);
no admissions and died (one failure);
one admission and survived (one failure);
two or more admissions and survived (multiple failures);
one or more admission and died (multiple failures).
These five potential patterns of follow-up are illustrated in Fig. 1; extracts from the HCS-HES database which correspond to participants with these patterns of follow-up are listed in Tables 1 and 2 . Extract 1 lists admission and discharge dates for all hospital admissions experienced by the five indexed participants along with dates of death. In order to implement survival analysis techniques, the HCS-HES data were mapped from this initial format to a multiple-failure survival dataset which comprised separate periods during which study participants were at risk of hospital admission or death (Extract 2). Participants were not regarded as being at risk of a subsequent failure event whilst they were in hospital; the failure date for individuals who died whilst in hospital was coded as the date they were admitted to hospital.
Overview of statistical analysis techniques for multiple-failure survival datasets
This section outlines a range of progressively more sophisticated analysis techniques for multiple-failure survival datasets: logistic regression; the time to first event Cox proportional hazards model; the Andersen and Gill (AG) model; and the Prentice, Williams and Peterson (PWP-TT) Total Time model.
Logistic regression is a simple technique that can be used to analyse the association between the odds of ever having a failure event in relation to a range of risk factors; this approach has been used to investigate whether hospital admission is associated with individual characteristics such as age, gender and socioeconomic factors [9, 10]. Predictive models such as the Patients at Risk of Re-Hospitalisation (PARR)  and the Scottish Patients at Risk of Readmission and Admission (SPARRA)  have been developed using logistic regression.
A logistic regression approach could be applied to the analysis of multiple-failure survival datasets by reducing each individual’s hospital admission and mortality history to a binary variable which simply indicates whether or not an admission or death was ever experienced. However, this approach is simplistic as it takes no consideration of the different times from baseline to an individual’s first admission and, moreover, ignores all admissions after the first.
Time to first event Cox proportional hazards model
The Cox proportional hazards model can be used to analyse the association between time to a failure event and a range of risk factors; a comprehensive introduction to this survival analysis technique is provided by Hosmer and Lemeshow . When applied to a multiple-failure survival dataset, this approach only examines the association between the characteristics of study participants and the time to their first failure event . This approach was used to investigate risk factors for emergency hospital admission among 2,849,381 patients from the QResearch cohort and the Clinical Practice Research DataLink cohort .
A Cox proportional hazards model is more sophisticated than logistic regression because it considers the time to the first failure event. However, it still wastes information because failures after the first are disregarded; this can result in erroneous conclusions about the association between risk factors and failure events. For example, one study showed that sunscreen treatment was not associated with basal cell carcinoma (BCC) in a time to first event analysis but was associated with a lower risk of BCC when recurrences of the illness were also incorporated in the analysis as failure events .
A standard Cox proportional hazards model cannot be used to analyse repeated events in multiple-failure survival datasets because failure times from the same individual are likely to be correlated and, therefore, the assumption of independent observations required by the Cox model would not be satisfied .
Multiple-failure survival models
Complex multiple-failure survival analysis techniques are available; we outline the Andersen and Gill (AG) and the Prentice, Williams and Peterson Total Time (PWP-TT) models. The advantage of these techniques compared to both logistic regression and time to first event Cox modelling is that individuals’ failure events after the first are incorporated. In addition, the AG and PWP-TT models are variance correction models which account for within-subject correlation of failure times unlike a standard Cox model .
There are similarities between the AG and the PWP-TT models. Firstly, both approaches estimate hazard ratios for the association between risk factors and failure events. Secondly, in common with standard Cox modelling, these techniques assume proportional hazards  meaning that the difference in the risk of failure in relation to a risk factor is time independent; this assumption can be assessed by investigating the relationship between the scaled Schoenfeld residuals and functions of time, either by graphical examination or significance testing .
However, there is an important difference between these techniques which is particularly relevant when applied to the analysis of a multiple-failure dataset for hospital admissions. In the AG model, the underlying risk of failure is regarded as the same for each event within an individual whereas the PWP-TT model allows this underlying risk to vary . In the context of hospital admission among older people, it is reasonable to expect that risk of admission will increase with the accumulated number of previous admissions; stratified analyses illustrated that this was the case in the HCS-HES dataset (data not shown). Therefore, we recommend that the PWP-TT model is better suited than the AG model for the analysis of risk factors for hospital admission among older people as it allows the underlying risk of admission to increase with the number of accrued admissions. The PWP-TT model is in essence a variance corrected stratified Cox model, with stratification on the number of previous failure events. An introduction to the mathematical basis of the AG and PWP-TT models is beyond the scope of this paper but has been published previously [19, 20].
Implementation in Stata
Table 3 provides the Stata command syntax for implementation of the analysis techniques described above; variable names included in the command syntax are as shown in Extract 2. An online resource  provided guidance on how to implement the multiple-failure time models using Stata in a general setting. We did not implement logistic regression analysis because this technique is routinely available in statistical software packages and, more importantly, we recommend that it is an over-simplistic analysis for a multiple-failure survival dataset such as the HCS-HES dataset.
Application of techniques to an analysis of the relationship between housing tenure and risk of hospital admission in the HCS-HES dataset
Data were described using means and standard deviations (SD), medians and inter-quartile ranges (IQR) and frequency and percentage distributions. The association between housing tenure and risk of hospital admission or death was analysed using the following techniques: time to first event Cox regression; the Andersen and Gill (AG) model; and the Prentice, Williams and Peterson Total Time (PWP-TT) model. Analyses were conducted without and with adjustment for age, height, weight adjusted for height, smoking history, alcohol, and walking speed. We analysed different types of hospital admission: any admission; emergency admission; elective admission and long admission (greater than 7 days). All analyses were conducted for men and women separately using the syntax commands presented in Table 3 and using release 13.0 of the Stata statistical software package .
Characteristics of HCS participants
Characteristics of the HCS study participants are shown in Table 4. The average age of the men and women at HCS baseline clinic was 66 years. Men were more likely to be ever smokers and to report a high weekly alcohol intake than women, but men and women had similar BMI, self-reported walking speed and number of systems medicated. 19 % of men and 22 % of women did not owner-occupy their home. In total, 1185 (75 %) men and 976 (68.8 %) women had experienced at least one hospital admission subsequent to their HCS baseline clinic but prior to 31st March 2010. Of the 189 men and 86 women who died during the follow-up period, only 12 men and 9 women died without having also experienced a hospital admission. In total, the HCS participants experienced 8687 hospital admissions of which 6462 were elective and 2201 were emergency admissions.
Associations between housing tenure and risk of hospital admission
Table 5 shows the association between housing tenure and the risk of different types of hospital admission as analysed by the time to first event Cox, AG, and PWP-TT models; the same broad conclusions were drawn from all analysis techniques. Among women, not owner-occupying one’s home was associated with increased risk of all types of hospital admission or death, irrespective of the survival analysis technique implemented: all associations except those between housing tenure and long or elective hospital admission or death remained significant after adjustment for potential confounders. Among men, not owner-occupying one’s home was associated with increased risk of emergency or long hospital admission or death according to all survival analysis techniques, although only the association between housing tenure and emergency admission was robust to adjustment for potential confounders.
In spite of obtaining broadly similar conclusions about the pattern of association between housing tenure and risk of hospital admission or death from all survival analysis techniques, the hazard ratios estimated by the PWP-TT model were smaller than those from the time to first event Cox model and the AG model. For example, the time to first event Cox model estimated hazard ratios of 1.67 (95 %CI: 1.36, 2.04) and 1.63 (95 %CI: 1.36, 1.95) for the association between not owner-occupying one’s home and the risk of emergency admission or death among women and men respectively; the corresponding hazard ratios as estimated by the PWP-TT model were only 1.34 (95 %CI: 1.15, 1.56) for women and 1.23 (95 %CI 1.07, 1.41) for men.
Linkage between the HCS database and HES data has created a rich but complex multiple-failure survival dataset for the investigation of risk factors for hospital admission among older people; other UK cohorts are well placed to link with HES. This paper serves as a ‘toolkit’ to assist researchers in the appropriate analyses of multiple-failure survival datasets by: reviewing suitable analysis techniques; outlining their implementation using Stata; and contrasting their application in an indicative analysis of housing tenure as a socioeconomic risk factor for hospital admission. We recommend the Prentice, Williams and Peterson Total Time (PWP-TT) model for the analysis of multiple-failure survival datasets which detail hospital admissions among older people.
Our observation that the PWP-TT model gives smaller estimated hazard ratios than the time to first event Cox or Andersen and Gill models is consistent with previous research which investigated risk factors for hospital readmission in Brazil . The PWP-TT model is likely to yield more conservative hazard ratios because it accounts for the underlying increase in risk of admission with the number of accumulated previous admissions. Failure to account for an increase in this underlying risk of admission may result in exaggerated estimates of the impact of a risk factor on hospital admission.
This paper has some limitations. First, we regarded hospital admission and death as equivalent failure events. This approach was necessitated because death cannot simply be regarded as a non-informative censoring event such as emigration or the end of follow-up . Moreover, although competing risk regression , as an extension of time to first event Cox modelling, could account for deaths as a competing event (an event which occurs instead of the failure event of interest) and would be important to consider in a time to first event analysis of nursing home admission among elderly people where the risk of mortality is high, this approach is not extendable to multiple-failure survival datasets using routine statistical software. Second, our review of suitable techniques for multiple-failure survival datasets was focused on those that may be implemented using routine statistical software. Alternative techniques not discussed in this paper include; multi-state models, which investigate the relationship between individual risk factors and the transition probabilities between states representing different failure events ; frailty models, which are similar to a Cox’s proportional hazards model but include random effects to account for the within-subject correlation of failure times ; and the Wei, Lin and Weissfeld Model (WLW) model which has similarities to the AG and PWP-TT model but is poorly suited to the analysis of ordered failure events because the individual is regarded at risk of all repeated events from the outset .
This paper also has many strengths. First, we provide researchers with a comprehensive ‘toolkit’ for the analysis of multiple-failure survival datasets arising from linkage between cohort study datasets and routinely collected data on hospital admissions. We describe all stages of statistical analysis from the appropriate organisation of the dataset, to an understanding of the key properties of available analysis techniques and their implementation in Stata, through to a comparison of results from an indicative analysis of risk factors for hospital admission. This paper is a valuable resource which will enable researchers to apply complex multiple-failure survival analysis techniques in their own research. Second, our indicative analysis of the association between housing tenure and hospital admission used data from a well characterised cohort study of community-dwelling older men and women; data were collected by trained research doctors and nurses according to strict measurement protocols . We therefore have confidence in the broad conclusion that not owner-occupying one’s home, an indicator of socioeconomic disadvantage, is associated with increased risk of hospital admission and this is consistent with the wide evidence base for a social gradient in health [28, 29].
We recommend the Prentice, Williams and Peterson Total Time model for the analysis of multiple-failure survival datasets which detail hospital admissions among older people. This article serves as a toolkit to assist researchers in the appropriate analysis of multiple-failure survival datasets arising from data linkage between a cohort study and routinely collected data on hospital admissions.
Availability of supporting data
We welcome opportunities for collaboration. Enquiries should be directed to Professor Cyrus Cooper, Director of the MRC Lifecourse Epidemiology Unit and Hertfordshire Cohort Study Principal Investigator, University of Southampton (email@example.com).
Office for National Statistics. Population ageing in the United Kingdom its constituent countries and the European Union. London: Office for National Statistics. 2012. www.ons.gov.uk/ons/dcp171776_258607.pdf. Accessed 25 Nov. 2015.
House of Lords Select Committee on Public Service and Demographic Change. Ready for ageing. HL paper 140, Stationary office. 2013.
Simmonds SJ, Syddall HE, Walsh B, Evandrou M, Dennison EM, Cooper C, et al. Understanding NHS hospital admissions in England: linkage of Hospital episode statistics to the Hertfordshire cohort study. Age Ageing. 2014;43:653–60.
Wadsworth M, Kuh D, Richards M, Hardy R. Cohort Profile: The 1946 National Birth Cohort (MRC National Survey of Health and Development). Int J Epidemiol. 2006;35:49–54.
Steptoe A, Breeze E, Banks J, Nazroo J. Cohort profile: the English longitudinal study of ageing. Int J Epidemiol. 2013;42:1640–8.
Therneau TM, Grambsch PM. Modeling survival data: extending the Cox model. New York: Springer; 2000.
Castaneda J, Gerritse B. Appraisal of several methods to model time to multiple events per subject : modelling time to hospitalizations and death. Rev Colomb Estad. 2010;33:43–61.
Syddall HE, Sayer AA, Dennison EM, Martin HJ, Barker DJ, Cooper C. Cohort profile: the Hertfordshire cohort study. Int J Epidemiol. 2005;34:1234–42.
Lyon D, Lancaster GA, Taylor S, Dowrick C, Chellaswamy H. Predicting the likelihood of emergency admission to hospital of older people: development and validation of the Emergency Admission Risk Likelihood Index (EARLI). Fam Pract. 2007;24:158–67.
Bottle A, Aylin P, Majeed A. Identifying patients at high risk of emergency hospital admissions: a logistic regression analysis. J R Soc Med. 2006;99:406–14.
Billings J, Dixon J, Mijanovich T, Wennberg D. Case finding for patients at risk of readmission to hospital: development of algorithm to identify high risk patients. BMJ. 2006;333:327.
12 NHS Services Scotland. Scottish Patients at Risk of Readmission and Admission (SPARRA). A Report on the Development of SPARRA Version 3. 2011. www.isdscotland.org/Health-Topics/Health-and-Social-Community-Care/SPARRA/2012-02-09-SPARRA-Version-3.pdf. Accessed 25 Nov. 2015.
Hosmer D, Lemeshow S, May S. Applied Survival Analysis, Regression modelling of Time-to-Event Data. New York: Wiley; 2008.
Villegas R, Julià O, Ocaña J. Empirical study of correlated survival times for recurrent events with proportional hazards margins and the effect of correlation and censoring. BMC Med Res Methodol. 2013;13:95.
Hippisley-Cox J, Coupland C. Predicting risk of emergency admission to hospital using primary care data: derivation and validation of QAdmissions score. BMJ Open. 2013;3, e003482.
Pandeya N, Purdie DM, Green A, Williams G. Repeated occurrence of basal cell carcinoma of the skin and multifailure survival analysis: follow-up data from the Nambour Skin Cancer Prevention Trial. Am J Epidemiol. 2005;161:748–54.
Guo Z, Gill TM, Allore HG. Modeling repeated time-to-event health conditions with discontinuous risk intervals: an example of a longitudinal study of functional disability among older persons. Methods Inf Med. 2009;47:107–16.
Kennedy BS, Kasl SV, Vaccarino V. Repeated hospitalizations and self-rated health among the elderly: a multivariate failure time analysis. Am J Epidemiol. 2001;153:232–41.
Andersen PK, Gill RD. Cox’s Regression Model for Counting Processes: A Large Sample Study. Ann Stat. 1982;10:1100–20.
Prentice RL, Williams BJ, Peterson AV. On the regression analysis of multivariate failure time data. Biometrika. 1981;68:373–9.
21 Cleves M. Analysis of multiple failure-time survival data. 2009. http://www.stata.com/support/faqs/statistics/multiple-failure-time-data/. Accessed 25 Nov. 2015.
StataCorp. Stata Statistical Software: Release 13. College Station: StataCorp LP; 2013.
Castro M, Carvalho M, Travassos C. Factors associated with readmission to a general hospital in Brazil. Cad Saúde Pública. 2005;21:1186–200.
Murphy TE, Han L, Allore HG, Peduzzi PN, Gill TM, Lin H. Treatment of death in the analysis of longitudinal studies of gerontological outcomes. J Gerontol A Biol Sci Med Sci. 2011;66:109–14.
Dignam JJ, Zhang Q, Kocherginsky M. The use and interpretation of competing risks regression models. Clin Cancer Res. 2012;18:2301–8.
Meira-Machado L, Uña-Álvarez J, Cadarso-Suárez C, Andersen PK. Multi-state models for the analysis of time-to-event data. Stat Methods Med Researc. 2010;18:195–222.
Box-steffensmeier JM, Zorn C. Duration Models for Repeated Events. J Polit. 2002;64:1069–94.
Marmot M. Fair Society, Healthy Lives: A Strategic Review of Health Inequalities in England Post-2010. London: Department of Health; 2010.
CSDH. Closing the gap in a generation: health equity through action on the social determinants of health. Final Report of the Commission on Social Determinants of Health. Geneva: World Health Organization; 2008.
This work was supported by the Medical Research Council [MC_UP_A620_1015, MC_UU_12011/2] and University of Southampton UK.
The authors declare that they have no competing interests
LDW conducted the statistical analysis and prepared the first draft of the manuscript. HES prepared the study database, devised the analytical strategy and co-drafted the manuscript. SJS also helped prepare the study database. CC took overall responsibility for the Hertfordshire Cohort Study. AAS conceived the original idea for the study. All authors contributed to the preparation of the final manuscript. All authors read and approved the final manuscript.
About this article
Cite this article
Westbury, L.D., Syddall, H.E., Simmonds, S.J. et al. Identification of risk factors for hospital admission using multiple-failure survival models: a toolkit for researchers. BMC Med Res Methodol 16, 46 (2016) doi:10.1186/s12874-016-0147-x
- Medical statistics
- Epidemiological methods
- Cohort studies
- Hospital admissions
- Survival analysis
- Risk factor
- Older people