- Research Articles
- Open Access
The frailty, outcomes, recovery and care steps of critically ill patients (FORECAST) study: pilot study results
Intensive Care Medicine Experimental volume 10, Article number: 23 (2022)
Frailty is common in critically ill patients and is associated with increased morbidity and mortality. There remains uncertainty as to the optimal method/timing of frailty assessment and the impact of care processes and adverse events on outcomes is unknown. We conducted a pilot study to inform on the conduct, design and feasibility of a multicenter study measuring frailty longitudinally during critical illness, care processes, occurrence of adverse events, and resultant outcomes.
Single-center pilot study enrolling patients over the age of 55 admitted to an Intensive Care Unit (ICU) for life-support interventions including mechanical ventilation, vasopressor therapy and/or renal replacement therapy. Frailty was measured on ICU admission and hospital discharge with the Clinical Frailty Scale (CFS), the Frailty Index (FI) and CFS at 6-month follow-up. Frailty was defined as CFS ≥ 5 and a FI ≥ 0.20. Processes of care and adverse events were measured during their ICU and hospital stay including nutritional support, mobility, nosocomial infections and delirium. ICU, hospital and 6 months were determined.
In 49 patients enrolled, the mean (SD) age was 68.7 ± 7.9 with a 6-month mortality of 29%. Enrollment was 1 patient/per week. Frailty was successfully measured at different time points during the patients stay/follow-up and varied by method/timing of assessment; by CFS and FI, respectively, in 17/49 (36%), 23/49 (47%) on admission, 22/33 (67%), 21/33 (63%) on hospital discharge and 11/30 (37%) had a CFS ≥ 5 at 6 months. Processes of care and adverse events were readily captured during the ICU and ward stay with the exception of ward nutritional data. ICU, hospital outcomes and follow-up outcomes were worse in those who were frail irrespective of ascertainment method. Pre-existing frailty remained static in survivors, but progressed in non-frail survivors.
In this pilot study, we demonstrate that frailty measurement in critically ill patients over the course and recovery of their illness is feasible, that processes of care and adverse events are readily captured, have developed the tools and obtained data necessary for the planning and conduct of a large multicenter trial studying the interaction between frailty and critical illness.
Frailty is defined as a state of increased vulnerability resulting from reduced physiological reserve and loss of function in multiple systems reducing the ability to cope with normal or minor stressors . It is associated with increased risk of physical, cognitive and functional decline, adverse health outcomes and mortality . Thirty to forty percent of older individuals requiring hospitalization and treatment in Intensive Care Units (ICUs) are frail and it is associated with worse outcomes including increased hospital and long-term mortality compared to those not frail [3, 4]. As an example, the presence of frailty as measured with the Clinical Frailty Scale (CFS) has been found to be associated with increased ICU and 30-day mortality with a linear increase in mortality as the CFS increases . All of the studies studying frailty in critical care populations have used the CFS, Frailty Index (FI) or the Frailty Phenotype to identify and measure frailty [6, 7].
Most of the ICU frailty studies reported to date have anchored their assessment of frailty status upon admission to ICU. The measurement of frailty during hospitalization and longitudinally after recovery from critical illness has been done in a few studies. A pilot study found that measuring frailty on hospital discharge after ICU admission with the Frailty Phenotype  was feasible and correlated with poor long-term outcomes. Geense et al. found that frailty measured with the CFS increased at hospital discharge as compared with admission but then declined over the follow-up period of 3 and 12 months . Brummel et al. found that the majority of patients frail (CFS ≥ 5) at 3 or 12 months were not frail at ICU admission and that worsened frailty states were present in over 40% of the participants at 3 and 12 months; frailty was commonly associated high levels of disability and cognitive impairment . Both of these large studies concluded that further study on associated and potential modifiable factors was required.
Although the evidentiary base linking frailty with poor outcomes is convincing, knowledge gaps exist with regard to the interaction between critical illness and frailty. First, the reasons for worse outcomes from critical illness in those who are frail remain unknown. Possible reasons include reduced homeostatic reserve, the presence of pre-existing illness or co-morbidities, premorbid loss of muscle mass or sarcopenia and pre-existing chronic inflammation associated with frailty [11, 12]. Second, it is possible that the treatment received is influenced by the presence of frailty leading to different therapies or limitation of treatment for those who are frail. Third, there is a scarcity of data on the impact of ICU treatments received on outcomes. Finally, for patients admitted to ICU without frailty who become frail from their acute illness, it is unknown if the development of frailty while critically ill has the same prognostic significance as that acquired in the community. Further, it is unknown as to how and to what degree the presence of frailty on hospital discharge predicts long-term outcomes and response to rehabilitation.
To inform these knowledge gaps, a large multicenter observational study measuring frailty at different time points, using a variety of frailty instruments, reporting on the processes of care received and long-term outcomes is required. To guide the planning of this study, we undertook a single-center pilot study and herein we report the results. We hypothesized that an adequately powered multicenter observational study measuring frailty at different time points, collecting data on the processes of care and long-term outcomes during the course of critical illness was feasible. For this pilot study we had the following objectives: (1) to evaluate feasibility based on the recruitment rate, consent rate and long-term follow-up metrics; (2) to demonstrate that frailty can be measured on hospital discharge; (3) to demonstrate that the processes of care of interest in ICU, in-hospital post ICU discharge and 6-month follow-up could be collected.
A single-center, prospective observational pilot study of consecutive patients admitted to a tertiary care, medical-surgical ICU for treatment of life-threatening illness. We included patients over the age of 55 admitted to the ICU and receiving at least one life-support intervention for greater than 24 h. The eligible life-support interventions for this study were mechanical ventilation (invasive or non-invasive), receipt of intravenous vasopressors/inotropes or the receipt of acute dialysis greater than 24 h. We excluded patients who were in the ICU greater than 72 h; had limitations of treatment on ICU admission although an isolated no cardio-pulmonary resuscitation (CPR) order was acceptable; had a life expectancy less than 6 months; did not have family or caregivers available to collect collateral history; were not able to speak English and medical translators were not available; and had structural neurological disease necessitating the ICU admission including stroke or spinal cord pathology. In addition, we excluded patients in whom it was anticipated that 6-month follow-up would not be possible including lack of consent or inability to return for follow-up. As there were no therapeutic interventions, all care decisions were left to the treating clinicians.
We collected frailty status on ICU admission and hospital discharge using the CFS and a frailty index based on a modified geriatric assessment (Additional file 1: Appendix 1) [13, 14]. The timing of frailty assessment was anchored at 2 weeks prior to the acute illness and was defined as a CFS ≥ 5 or a frailty index ≥ 0.20. All data were collected from surrogates unless the patient was able to directly provide the data. We collected data at ICU admission including severity of illness (APACHE II ), co-morbidities (Charlson Co-Morbidity Index ), activities of daily living (Katz Index of Independence in Activities of Daily Living ) and the presence of cognitive dysfunction (The Informant Questionnaire on Cognitive decline in the elderly (IQCODE) ). During the patient’s ICU stay, we collected daily data on the treatment provided, including nutrition (protein, calories received), sedation/analgesia regimens (sedative and analgesic agents administered, mobility (ICU Mobility Scale ), and involvement of physiotherapy on that day of care. Further we collected daily data on the occurrence of adverse events including delirium (Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) , evidence of nosocomial infections including antibiotic utilization and positive microbial cultures. On discharge from ICU and during the patient’s remaining hospitalization the same data were collected with modifications for the ward environment (Confusion Assessment Method , highest level of mobility of that day categorized as bed, up to chair, walking with assistance or walking independently). Frailty was again assessed at hsopital discharge using the CFS or FI. Patients were urged to return for an in-person follow-up at 6 months where we again determined their frailty status using the CFS and outcomes including mortality and morbidity, indices of healthcare utilization (including hospital readmission and emergency room visits), need for institutionalization and quality of life (Euro-QoL 5D-5L ). All the data were collected electronically using a REDCAP database hosted at Queens University .
In order to be able to conduct a large multicenter study, we defined feasibility as an enrollment rate greater than 1 per week and a consent rate of 70%. To be able to evaluate feasibility, we aimed for a convenience sample of 50 patients for the pilot. For reporting of data, continuous variables are reported as means and standard deviations (SD), except for skewed variables which are reported as means, quartiles and ranges. Categorical variables are reported as counts and percentages.
Research Ethics Board (REB) approval was obtained from Queens University Health Sciences Research Ethics Board. If the patient was able to consent, consent and data were obtained from the patient. If the patient was unable to consent, consent was obtained from the substitute decision-maker. When the patient regained capacity, consent for ongoing participation was obtained from them for further data collection.
Fifty patients were enrolled in the study; 1 withdrew consent and 12 people died leaving 37 patients at hospital discharge, as outlined in Fig. 1. Of these 35 patients survived to the 6-month follow-up visit and 30 were available for assessment. The characteristics of the enrolled cohort are found in Table 1. The mean (SD) age was 68.7 ± 7.9, with the majority being male and a medical basis for their admission.
For the primary outcome of feasibility, the consent rate was 74% with an enrollment rate of 1 patient/per week. Processes of care were readily captured during the ICU and during the patient’s ward stay with the exception of nutrition. During the ‘patients’ ward stay we were unable to capture nutrition data in spite of multiple attempts including direct observation and calorie counts conducted by dietary staff. Barriers included variability in the timing of meals and collection of meal leftovers, provision of food by family members, low rate of calorie count collection and concern over the accuracy of calorie counts. Of the patients alive at 6 months (35), 20 (57%) were able to return for in-person follow-up.
The classification of frailty varied by the method used and when the frailty assessment was conducted (Table 2). Frailty was present on admission when using the CFS (CFS ≥ 5) in 17/49 (36%) and in 23/49 (47%) using the FI. On discharge from hospital 22/33 (67%) were categorized as frail using the CFS in contrast to 21/33 (63%) using the FI. Discharge assessments were missed in 4 patients. Individual courses of frailty are plotted in Fig. 2. At 6 months, 11 had a CFS ≥ 5. The CFS rose over the course of hospital but tended to return to baseline at the 6-month time-point; of the 23 patients who had a baseline CFS < 5, only 5 (22%) had a CFS ≥ 5 at 6 months.
Processes of care are outlined in Table 3. Outcomes classified by FI are outlined in Table 4 and outcomes classified by CFS are reported in Table 5. Overall, whether frailty was assessed by FI or CFS, the in-hospital outcomes and follow-up outcomes were worse in those who were classified as frail. In addition, the level of frailty appeared to remain static in survivors with pre-existing frailty but seemed to progress in non-frail survivors over the course of hospitalization and by the 6-month follow-up. Outcomes categorized by discharge frailty assessment are presented in Additional file 2: Appendix 2, Table S1. Patients identified as frail on discharge had fewer 28-day ICU-free days, were less likely to be discharged home and more like to be discharged to another facility including long-term care or a rehabilitation facility. The differences in 6-month mortality or quality of life between those that were or not frail on hospital discharge were not statistically significant.
In this single-center pilot study, we met the a priori enrollment criteria set as necessary to feasibly conduct a multicenter study and were able to develop the data collection tools required for its’ conduct. We also demonstrated that frailty identification varied with the tool used and was dynamic through the ICU and hospital course. Further, the identification of frailty, irrespective of the method used was associated with worse outcomes. Due to the small sample size of this pilot study and its single-center study design, these results are hypothesis generating only but are corroborated by the findings of other studies [4, 9, 10, 24, 25]. This study is novel in its measurement of frailty at different times points along with the process of care received and potentially adverse events for which frail patients may be at higher risk for. Although the data generated are preliminary and need to be verified in a larger multicenter study, they begin to fill some of the knowledge gaps for the interaction between critical illness and frailty.
In this pilot study, enrollment was 1 patient per week. Recognizing that a substantial number of patients of potentially eligible patients were not enrolled and in discussion with the steering committee, the inclusion and exclusion criteria were substantially revised for the multicenter study. In particular, the exclusion of patients with neurological disease was removed. In addition, the timelines for study entry were significantly lengthened to 5 days to reduce potential participants lost on weekends and holidays. In addition, recognizing that a significant number of patients were not able to return for in-person follow-up, for the multicenter study, both in-person and telephone follow-up will be allowed. These changes will facilitate recruitment and increase the generalizability of study findings. For planning purposes, we estimated that enrollment in the multicenter study will be 1.25 patients/week.
In the multicenter study, we aim to further describe the outcomes associated with the method and timing of frailty ascertainment in addition to the impact of processes of care on frailty outcomes. The analyses to answer our research questions will involve the construction of multi-variate models and we will need to have an adequate number of patients with the characteristics of interest including frailty on ICU admission and hospital discharge. Frailty at hospital discharge can be categorized as that persisting from ICU admission, unchanged, worsened or improved or newly developed, persistent or transitory as a consequence of the critical illness. A priori, the following co-variates may be important for the development or progression of frailty: admission variables (age, sex, body mass index, number of co-morbidities, presence of disability, severity of illness,, presence of cognitive impairment, admission FI, admission CFS), process of care variables (duration of life-support interventions, nutrition received as percentage of recommended amounts, mobility levels, sedation levels) and adverse events (nosocomial infections, occurrence and duration of delirium). For multi-variable models, it is desirable to have at least 10 events for every co-variate .
In this pilot study, approximately 40% of patients who were not frail on ICU admission (both by FI and CFS) survived, but also were found to be frail on hospital discharge. Further hospital mortality in those who were frail on ICU admission (both by FI and CFS) was approximately 47% which is higher than in some larger studies. In a meta-analysis of ICU studies, patients with frailty were reported to have a hospital mortality of 30% .
Given the uncertainty, for the multicenter study, we will utilize an event driven sample size where we will recruit patients until we have recruited at least 120 frail survivors and at least 150 newly developed frail survivors at hospital discharge. Assuming a mortality rate of between 30 and 45% in enrolled frail patients, between 170 and 220 patients with frailty would need to be enrolled to have 120 frail survivors. To have at least 150 patients with newly developed frailty at hospital discharge, we would need to enroll approximately 375 non-frail patients. In our pilot study, 36% of patients were frail based on the CFS and 49% were frail based on the FI. With a sample size of 700 patients, we expect to have 250–340 frail patients, at least 130 frail survivors to hospital discharge and at least 180 patients with newly developed frailty.
Strengths of this study include the measurement of frailty using different methods at different time points during critical illness and the collection of data outside the ICU. Limitations of this study included its single-center design, significant loss of patients to follow-up and that it was not powered for detailed analyses. All the results observed are hypothesis generating and will need to be confirmed in the larger multicenter study that will be adequately powered to control for important co-variates.
In conclusion, a large multicenter study studying the measurement of frailty in critically ill patients with different ascertainment tools at both ICU admission and hospital discharge was determined to be feasible and is currently in progress. The processes and data collection tools developed for the pilot study are being used in the multicenter study. The results of this pilot study have also been used to inform the sample size estimates for the multicenter study. This pilot study provides is an important step forward in elucidating the interaction between frailty and critical illness. It is only by better understanding frailty in critically ill patients including how to ascertain it and the impact of processes of care on its outcomes that we can design interventions that will improve outcomes.
Availability of data and materials
The data generated during the current study are not publicly available pending the conduct of the multicenter study but are available from the corresponding author on reasonable request.
Intensive care unit
Clinical frailty scale
Acute physiology and chronic health evaluation
Informant questionnaire on cognitive decline in the elderly
Confusion assessment method
Xue QL (2011) The frailty syndrome: definition and natural history. Clin Geriatr Med 27:1–15
Walston J, Hadley EC, Ferrucci L, Guralnik JM, Newman AB, Studenski SA, Ershler WB, Harris T, Fried LP (2006) Research agenda for frailty in older adults: toward a better understanding of physiology and etiology: summary from the American Geriatrics Society/National Institute on Aging Research Conference on Frailty in Older Adults. J Am Geriatr Soc 54:991–1001
Bagshaw SM, Stelfox HT, McDermid RC, Rolfson DB, Tsuyuki RT, Baig N, Artiuch B, Ibrahim Q, Stollery DE, Rokosh E, Majumdar SR (2014) Association between frailty and short- and long-term outcomes among critically ill patients: a multicentre prospective cohort study. CMAJ 186:E95-102
Muscedere J, Waters B, Varambally A, Bagshaw SM, Boyd JG, Maslove D, Sibley S, Rockwood K (2017) The impact of frailty on intensive care unit outcomes: a systematic review and meta-analysis. Intensive Care Med 43:1105–1122
Flaatten H, De Lange DW, Morandi A, Andersen FH, Artigas A, Bertolini G, Boumendil A, Cecconi M, Christensen S, Faraldi L, Fjolner J, Jung C, Marsh B, Moreno R, Oeyen S, Ohman CA, Pinto BB, Soliman IW, Szczeklik W, Valentin A, Watson X, Zaferidis T, Guidet B, group VIPs, (2017) The impact of frailty on ICU and 30-day mortality and the level of care in very elderly patients (≥ 80 years). Intensive Care Med 43:1820–1828
Mitnitski AB, Mogilner AJ, Rockwood K (2001) Accumulation of deficits as a proxy measure of aging. ScientificWorldJournal 1:323–336
Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, Seeman T, Tracy R, Kop WJ, Burke G, McBurnie MA, Cardiovascular Health Study Collaborative Research G (2001) Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci 56:M146-156
Baldwin MR, Reid MC, Westlake AA, Rowe JW, Granieri EC, Wunsch H, Dam TT, Rabinowitz D, Goldstein NE, Maurer MS, Lederer DJ (2014) The feasibility of measuring frailty to predict disability and mortality in older medical intensive care unit survivors. J Crit Care 29:401–408
Geense W, Zegers M, Dieperink P, Vermeulen H, van der Hoeven J, van den Boogaard M (2020) Changes in frailty among ICU survivors and associated factors: results of a one-year prospective cohort study using the Dutch Clinical Frailty Scale. J Crit Care 55:184–193
Brummel NE, Girard TD, Pandharipande PP, Thompson JL, Jarrett RT, Raman R, Hughes CG, Patel MB, Morandi A, Gill TM, Ely EW (2020) Prevalence and course of frailty in survivors of critical illness. Crit Care Med 48:1419–1426
Moisey LL, Mourtzakis M, Cotton BA, Premji T, Heyland DK, Wade CE, Bulger E, Kozar RA, Nutrition, Rehabilitation Investigators C (2013) Skeletal muscle predicts ventilator-free days, ICU-free days, and mortality in elderly ICU patients. Crit Care 17:R206
Du Y, Karvellas CJ, Baracos V, Williams DC, Khadaroo RG, Acute C, Emergency Surgery G (2014) Sarcopenia is a predictor of outcomes in very elderly patients undergoing emergency surgery. Surgery 156:521–527
Heyland DK, Garland A, Bagshaw SM, Cook D, Rockwood K, Stelfox HT, Dodek P, Fowler RA, Turgeon AF, Burns K, Muscedere J, Kutsogiannis J, Albert M, Mehta S, Jiang X, Day AG (2015) Recovery after critical illness in patients aged 80 years or older: a multi-center prospective observational cohort study. Intensive Care Med 41:1911–1920
Rockwood K, Song X, MacKnight C, Bergman H, Hogan DB, McDowell I, Mitnitski A (2005) A global clinical measure of fitness and frailty in elderly people. CMAJ 173:489–495
Knaus WA, Draper EA, Wagner DP, Zimmerman JE (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829
Charlson ME, Pompei P, Ales KL, MacKenzie CR (1987) A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 40:373–383
Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffe MW (1963) Studies of illness in the aged. The index of Adl: a standardized measure of biological and psychosocial function. JAMA 185:914–919
Jorm AF (2004) The Informant Questionnaire on cognitive decline in the elderly (IQCODE): a review. Int Psychogeriatr 16:275–293
Hodgson C, Needham D, Haines K, Bailey M, Ward A, Harrold M, Young P, Zanni J, Buhr H, Higgins A, Presneill J, Berney S (2014) Feasibility and inter-rater reliability of the ICU mobility scale. Heart Lung 43:19–24
Ely EW, Margolin R, Francis J, May L, Truman B, Dittus R, Speroff T, Gautam S, Bernard GR, Inouye SK (2001) Evaluation of delirium in critically ill patients: validation of the Confusion Assessment Method for the Intensive Care Unit (CAM-ICU). Crit Care Med 29:1370–1379
Inouye SK, van Dyck CH, Alessi CA, Balkin S, Siegal AP, Horwitz RI (1990) Clarifying confusion: the confusion assessment method. A new method for detection of delirium. Ann Intern Med 113:941–948
EuroQol Research Foundation. EQ-5D-5L User Guide. In: Editor. Book EuroQol Research Foundation. EQ-5D-5L User Guide. City, 2019.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, McLeod L, Delacqua G, Delacqua F, Kirby J, Duda SN, Consortium RE (2019) The REDCap consortium: Building an international community of software platform partners. J Biomed Inform 95:103208
Fernando SM, McIsaac DI, Perry JJ, Rochwerg B, Bagshaw SM, Thavorn K, Seely AJE, Forster AJ, Fiest KM, Dave C, Tran A, Reardon PM, Tanuseputro P, Kyeremanteng K (2019) Frailty and associated outcomes and resource utilization among older ICU patients with suspected infection. Crit Care Med 47:e669–e676
Zampieri FG, Iwashyna TJ, Viglianti EM, Taniguchi LU, Viana WN, Costa R, Correa TD, Moreira CEN, Maia MO, Moralez GM, Lisboa T, Ferez MA, Freitas CEF, de Carvalho CB, Mazza BF, Lima MFA, Ramos GV, Silva AR, Bozza FA, Salluh JIF, Soares M, Investigators OS (2018) Association of frailty with short-term outcomes, organ support and resource use in critically ill patients. Intensive Care Med 44:1512–1520
Harrell JFE (2015) Regression Modeling Strategies: with Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis. In: Book Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis. Springer International Publishing: Imprint: Springer, City, pp. 1 online resource (XXV, 582 pages 157 illustrations, 553 illustrations in color.
We would like to acknowledge Tracy Boyd and Miranda Hunt who acted as the study coordinators. In addition, we would like to thank the patients and their families who made this study possible by their agreement to participate and by donating valuable time for data collection.
Through an unrestricted grant from Canadian Frailty Network. The funder of the study had no role in its analysis, interpretation or in preparation of the manuscript.
Ethics approval and consent to participate
Approval was obtained from Queens University Health Sciences Research Ethics Board. Consent was obtained from the patient if they were able to consent. If unable, consent was obtained from the substitute decision-maker. Consent for ongoing participation was obtained from patients regaining capacity.
Consent for publication
JM is the scientific director for the Canadian Frailty Network, which is a pan-Canadian not-for-profit network funded through the Networks of Centers of Excellence (NCE) program by the government of Canada.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Muscedere, J., Bagshaw, S.M., Boyd, G. et al. The frailty, outcomes, recovery and care steps of critically ill patients (FORECAST) study: pilot study results. ICMx 10, 23 (2022). https://doi.org/10.1186/s40635-022-00446-7
- Clinical frailty scale
- Frailty index
- Critical care outcomes
- Adverse events
- Care processes