- Open Access
The diagnostic accuracy for ARDS of global versus regional lung ultrasound scores - a post hoc analysis of an observational study in invasively ventilated ICU patients
Intensive Care Medicine Experimental volume 7, Article number: 44 (2019)
Semi-quantification of lung aeration by ultrasound helps to assess presence and extent of pulmonary pathologies, including the acute respiratory distress syndrome (ARDS). It is uncertain which lung regions add most to the diagnostic accuracy for ARDS of the frequently used global lung ultrasound (LUS) score. We aimed to compare the diagnostic accuracy of the global versus those of regional LUS scores in invasively ventilated intensive care unit patients.
This was a post-hoc analysis of a single-center observational study in the mixed medical–surgical intensive care unit of a university-affiliated hospital in the Netherlands. Consecutive patients, aged ≥ 18 years, and are expected to receive invasive ventilation for > 24 h underwent a LUS examination within the first 2 days of ventilation. The Berlin Definition was used to diagnose ARDS, and to classify ARDS severity. From the 12-region LUS examinations, the global score (minimum 0 to maximum 36) and 3 regional scores (the ‘anterior,’ ‘lateral,’ and ‘posterior’ score, minimum 0 to maximum 12) were computed. The area under the receiver operating characteristic (AUROC) curve was calculated and the best cutoff for ARDS discrimination was determined for all scores.
The study enrolled 152 patients; 35 patients had ARDS. The global score was higher in patients with ARDS compared to patients without ARDS (median 19 [15–23] vs. 5 [3–9]; P < 0.001). The posterior score was the main contributor to the global score, and was the only score that increased significantly with ARDS severity. However, the posterior score performed worse than the global score in diagnosing ARDS, and it had a positive predictive value of only 50 (41–59)% when using the optimal cutoff. The combined anterolateral score performed as good as the global score (AUROC of 0.91 [0.85–0.97] vs. 0.91 [0.86–0.95]).
While the posterior score increases with ARDS severity, its diagnostic accuracy for ARDS is hampered due to an unfavorable signal-to-noise ratio. An 8-region ‘anterolateral’ score performs as well as the global score and may prove useful to exclude ARDS in invasively ventilated ICU patients.
Point-of-care ultrasound is an increasingly used clinical imaging modality for diagnostic and monitoring purposes in a number of common intensive care unit (ICU) conditions, including the acute respiratory distress syndrome (ARDS) [1, 2]. Lung ultrasound (LUS) is an attractive alternative to chest radiography or CT scan , in particular in places where these latter imaging modalities are scarce or absent . By now, several approaches integrate LUS in the diagnosis and monitoring of ARDS [5,6,7,8]. The recently proposed Kigali modification of the Berlin Definition for ARDS is a pragmatic attempt to replace chest radiography or computer tomography in the diagnostic process of ARDS . Its excellent sensitivity for ARDS was recently confirmed .
One challenge with LUS is the way to report and interpret its findings, which are peculiar being a mix of non-numeric artifactual and real sonographic images [10,11,12,13]. One frequently used approach is semi-quantification of lung aeration across 12 lung regions into a numerical score , of which the steep learning curve was recently demonstrated . The so-called ‘global score,’ a lung aeration score that correlates well with CT-quantified aeration , is in fact nothing more than a composite of scores integrating anterior, lateral, and posterior lung regions. All abnormalities in each region count equally within the final score, even while the relative importance and meaning of these abnormalities may be very different. Specifically, the signal-to-noise ratio could be low in those regions that are subject to the development of abnormalities other than ARDS, which is particularly true for posterior regions where compressive and perioperative atelectasis, pre-existing or new infiltrates, and hydrostatic pulmonary edema may concentrate due to a positional gradient [11, 17,18,19,20].
We hypothesized that the diagnostic accuracy for ARDS and ARDS severity of the ‘posterior’ score would be inferior to that of the global score, and to that of the ‘lateral’ and ‘anterior’ scores. To test this hypothesis, we determined and compared the diagnostic accuracy of the global score and the three regional scores in a cohort of invasively ventilated ICU patients, on which we reported previously . In addition, we tested whether omitting the posterior score from the global score, i.e., using an ‘anterolateral’ score, would yield a diagnostic accuracy for ARDS comparable to that of the global score.
This was a post-hoc analysis of a single-center observational study performed from November 2016 to June 2017 in the mixed medical–surgical ICU of the Amsterdam University Medical Centers, in Amsterdam, The Netherlands. The study was approved by the Institutional Review Board of the Academic Medical Center (approval W17_353 #17.411). The need for written informed consent was waived seen the observational nature of the study.
Inclusion and exclusion criteria
The original study had the following two inclusion criteria: age ≥ 18 years, and expected to receive invasive ventilation for > 24 h . Exclusion criteria were no LUS examination, performed as part of standard care, in the first 48 h of ventilation, unreliable oximetry data, and not having a chest radiograph or computed tomography scan of the lungs while on at least 5 cm H2O positive end-expiratory pressure (PEEP), mandatory to make the diagnosis of ARDS according to the Berlin Definition for ARDS . This post-hoc analysis did not use additional exclusion criteria. The presence of ARDS was assessed by a panel of two clinicians, using the Berlin Definition for ARDS  that includes new or worsening respiratory symptoms within 1 week of a known medical clinical insult, a PaO2/FiO2 < 300 mmHg; bilateral opacities on the chest film or computed tomography (CT) exam, not explained by effusions, collapse, or nodules; and respiratory failure not fully explained by cardiac failure or fluid overload. In case of persistent disagreement on radiographic criteria, radiography results were discussed with a third clinician who had no access to other clinical information, to reach consensus.
A trained and experienced intensivist (VV), not involved in direct patient care and unaware of clinical information or ARDS status, performed the LUS examination using a LOGIQe ultrasound machine (GE Healthcare, Little Chalfont, UK). A convex 2–5 MHz transducer was used with the probe applied longitudinally and perpendicularly to the thoracic wall. LUS consisted of a scan of 12 different regions—6 per hemithorax, i.e., two anterior, two lateral, and two posterior thoracic regions were delimitated as described before . Each region was scored, as follows: ‘0’, A-pattern with ≤ 2 B-lines; ‘1,’ more than two separated B-lines; ‘2’, multiple coalescent B-lines; or ‘3’, lung consolidation.
Global and regional scores
The global score was calculated by summing the scores of all 12 lung regions, which thus could range from 0 (i.e., normal aeration in all regions) to 36 (i.e., the extreme situation in which all regions had consolidations). Regional scores were calculated by summing the field scores of anterior, lateral, or posterior regions, respectively (range from 0 to 12). An adjusted composite score, called the ‘anterolateral’ score, was derived by summing the anterior and lateral regional scores (range from 0 to 24) .
Missing scores values from one or more regions that were non-examinable were complemented by the proportional quotation from the same examination using the formula (final score = actual score × (N° of potential regions / N° of actual regions scanned), where the number of potential regions was 12 or 4 for the global and regional scores, respectively.
Primary clinical endpoint
The clinical endpoint was ARDS according to the Berlin Definition . The same definition was used to classify ARDS severity as mild, moderate, or severe.
Demographic, clinical, and outcome variables were presented as percentages for categorical variables and as medians with interquartile ranges (IQR) for continuous variables.
The Mann–Whitney U test was used to compare LUS scores between patients with and without ARDS, and Kruskal–Wallis statistics to seek significant differences across patients with mild, moderate, and severe ARDS. Pairwise comparisons across groups were explored using the Dunn test with a Benjamini–Hochberg correction for multiple comparisons.
Receiver operating characteristic (ROC) curves for ARDS were drafted for the global score, and the regional scores. The area under the receiver operating characteristic curves (AUROC) with 95% confidence intervals where calculated to determine the diagnostic accuracy for ARDS of global and regional scores. AUROCs were compared using the De Long test . The optimal cutoffs were determined as the highest Youden’s index (sensitivity + specificity − 1) . Sensitivity, specificity, and positive and negative predictive values were calculated, based on these cutoffs.
The diagnostic accuracy based on ROCs was predefined as ‘excellent’ if the AUROC was between 0.9 and 1, ‘good’ between 0.8 and 0.9, ‘moderate’ between 0.7 and 0.8, poor between 0.6 and 0.7, and ‘fail’ when below 0.6. As LUS is a first line diagnostic technique, a positive predictive value below 50% and a negative predictive value below 80% were considered clinically irrelevant .
All statistical analyses were performed in R (version 3.3.1, www.r-project.org) and graphs built using GraphPad Prism (version 7.03, www.graphpad.com). A P value below 0.05 was considered significant.
Out of 152 patients, 35 (23.0%) had ARDS according to the Berlin Definition for ARDS. Twelve patients were classified as having mild ARDS, and 18 and 5 patients as having moderate or severe ARDS, respectively.
Twelve patients had at least 1 lung region that could not be scored, due to large surgical or drainage dressings, chest tubes, or due to patient positioning, resulting in a total of 36/1824 (2.0%) non-scannable regions.
Global and regional scores
Global and regional LUS scores and ROC curves are presented in Fig. 2. AUROC, sensitivity, specificity, and negative and positive predictive values are presented in Table 2. Comparisons between the AUROC using the De Long test are shown in Table 3.
Patients without ARDS had a significant lower global score compared to patients with ARDS (5 [3,4,5,6,7,8,9] versus 19 [15,16,17,18,19,20,21,22,23]; P < 0.001]). The posterior score was the main contributor to the global score (Table 4), and was the only score that increased with rising ARDS severity groups (P = 0.016, mild vs. severe ARDS). The diagnostic accuracy for ARDS of the posterior scores was comparable to that of the other regional scores, but yielded a lower AUROC than the global score, the lowest specificity, and a clinically irrelevant positive predictive value of 49.8%.
Composite of anterior and lateral scores
Omitting the posterior regions from the global score did not result in a lower diagnostic performance, i.e., the diagnostic accuracy of the anterolateral score was as good as the performance of the global score (AUROC 0.91 [0.85–0.97] vs. 0.91 (0.86–0.95]). Using a cutoff of 5 for the anterolateral score yielded similar predictive values.
The main findings of this study can be summarized as follows: (1) the posterior score is the main contributor to the global score, in patient with ARDS as well as in patients without ARDS; (2) the posterior score, but not the anterior and lateral scores, increases with ARDS severity; however (3), the posterior score has a lower diagnostic accuracy than the global score; and (4) the diagnostic accuracy for ARDS of the simpler anterolateral score is comparable to that of the global score.
This study has several strengths. The study included consecutive invasively ventilated ICU patients, as the ICU where this study was performed follows a clinical protocol dictating that all invasively ventilated patients who are expected to need invasive ventilation > 24 h undergo a LUS examination within the first 2 days of ventilation. Patients included had a wide range of medical and surgical primary diagnoses, and had a prevalence of ARDS comparable to that in other studies , increasing its external validity. In addition, each LUS examination followed a strict protocol in which 12 lung regions were scanned, resulting in a detailed representation of all regions, and LUS examinations were performed by a single physician, experienced in performing LUS. The number of regions that were non-examinable was low. The LUS performer remained blinded for clinical data, in particular the presence or absence of ARDS. Finally, ARDS was diagnosed by a team of physicians experienced in using the Berlin Definition , which was strictly applied.
The lung aeration scores reported here are very much in line with those from previous investigations [17, 28,29,30]. Mean global scores in patients with ARDS varied between 18 and 21 in several reports [17, 28, 29], which was confirmed in the present cohort. The previously reported higher global scores with increasing ARDS severity  was also found in ARDS patients in the here studied cohort, albeit with a less pronounced linearity.
In line with a previous study, patients without ARDS had a relatively high global score . While aeration was affected in both anterior and posterior regions in the previous study , in the present investigation it was the posterior score that contributed most to the global score. This difference may have been caused by the fact that unlike the previous study in which 9 lung points were scanned, here a 12-region approach was used. The noticeable finding that patients without ARDS have relatively high global scores point to the fact that, even in the absence of ARDS, quantifiable dependent lung densities are present in invasively ventilated ICU patients. This is due to the presence of various conditions like hydrostatic lung edema , postoperative atelectasis , and also infectious infiltrates , and do create ‘noise’ that hampers the usefulness of LUS to diagnose ARDS. Therefore, the high optimal cutoff of the global score for diagnosing ARDS, 15 in this representative cohort of patients who are expected to need invasive ventilation for > 24 h, is not surprising.
By omitting the posterior scores, i.e., by combining only the scores for the four anterior and the four lateral regions [8, 10], the abovementioned low signal-to-noise ratio of part of the global score could be overcome. This finding, however, certainly does not mean that posterior regions should not be scanned, as important clinical information could come from the detection or monitoring of pleural effusion, but also assessment of lung inhomogeneity and, e.g., the effects of lung recruitment maneuvers . Also, despite the finding that the posterior score had the lowest diagnostic accuracy for ARDS, this score was the single regional score that showed a significant linear rise with ARDS severity.
A noticeable drop in the global score was found from moderate to severe ARDS, a finding that was mainly driven by an increase in the number of non-dependent regions that were scored as normally aerated or having an ‘A-pattern.’ One possible explanation is that these lung regions were more subject to overdistension, facilitated by the higher levels of PEEP used in these patients. It should be noticed, though, that the number of patients with severe ARDS was rather low. Clearly, this finding deserves more attention in future studies.
The low number of patients with severe ARDS may not necessarily affect the physiological meaning of the results of this study. The modest diagnostic accuracy of posterior LUS scores reflects an unfavorable signal-to-noise ratio in dependent lung regions. This, however, seems mostly due to a higher level of noise, i.e., increased posterior LUS scores in all patients, thus also those without ARDS.
Ventilatory settings, like tidal volume and PEEP, potentially affect LUS scores because they could alter the amount of aerated lung tissue. The effect of the small variations in tidal volume in the current study, though, is negligible, as recently demonstrated . The effects of PEEP-induced recruitment on LUS findings have been described before . Of note, the caregivers within the ICU where this study was performed followed a local guideline that recommended to titrate PEEP to the lowest level at which oxygenation was acceptable, meaning that excessive high PEEP was only used in the most severe cases of ARDS . Interestingly, while the effects of high PEEP on lung aeration could also affect other imaging techniques including chest X-ray and lung CT, this is not accounted for in the currently used Berlin Definition for ARDS .
The results of the present study, at least in part, suggest that if LUS scores are used in a heterogeneous process like ARDS, an anterolateral score < 5 has particular interest in excluding ARDS, while posterior scores preserve a specific role in defining ARDS severity, once ARDS is confirmed. This could be of help for clinical reasoning, but is certainly in research purposes.
Several limitations of this study should be acknowledged. As this study took place in one single intensive care unit, its results need external confirmation. The number of patients with severe ARDS was very low, which makes it challenging to draw firm conclusions with respect to this category of patients. Finally, other LUS features, like presence and extent of lung sliding, presence of pleural line abnormalities and subpleural consolidations, and sonographic spared areas, were not collected, while these all may further add to the diagnostic accuracy for ARDS of LUS .
In this cohort of ICU patients expected to need invasive ventilated for > 24 h, the posterior score was the main contributor to the global score, irrespective of the presence of ARDS. While the posterior score had a lower diagnostic accuracy when compared to the global score, it performed best when classifying ARDS severity. Omitting the posterior regions from the global score did not alter the diagnostic accuracy.
Acute respiratory distress syndrome
Area under ROC
Intensive care unit
Negative predictive value
Positive end-expiratory pressure
Positive predictive value
Receiver operating characteristic curve
Corradi F, Brusasco C, Pelosi P (2014) Chest ultrasound in acute respiratory distress syndrome. Curr Opin Crit Care 20:98–103. https://doi.org/10.1097/MCC.0000000000000042
Sweeney RM, McAuley DF (2016) Acute respiratory distress syndrome. Lancet. 388:2416–2430. https://doi.org/10.1016/S0140-6736(16)00578-X
See KC, Ong V, Tan YL, Sahagun J, Taculod J (2018) Chest radiography versus lung ultrasound for identification of acute respiratory distress syndrome: a retrospective observational study. Crit Care 22:203. https://doi.org/10.1186/s13054-018-2105-y
Vukoja M, Riviello E, Gavrilovic S, Adhikari NKJ, Kashyap R, Bhagwanjee S et al (2014) A survey on critical care resources and practices in low- and middle-income countries. Glob Heart 9:337–42.e1-5. https://doi.org/10.1016/j.gheart.2014.08.002
Bass CM, Sajed DR, Adedipe AA, West TE (2015) Pulmonary ultrasound and pulse oximetry versus chest radiography and arterial blood gas analysis for the diagnosis of acute respiratory distress syndrome: a pilot study. Crit Care 19:282. https://doi.org/10.1186/s13054-015-0995-5
Riviello ED, Kiviri W, Twagirumugabe T, Mueller A, Banner-Goodspeed VM, Officer L et al (2016) Hospital incidence and outcomes of the acute respiratory distress syndrome using the Kigali modification of the Berlin Definition. Am J Respir Crit Care Med 193:52–59
Lichtenstein D, Goldstein I, Mourgeon E, Cluzel P, Grenier P, Rouby J-J (2004) Comparative diagnostic performances of auscultation, chest radiography, and lung ultrasonography in acute respiratory distress syndrome. Anesthesiology. 100:9–15. https://doi.org/10.1097/01.sa.0000140524.23073.da
Kruisselbrink R, Chan V, Cibinel GA, Abrahamson S, Goffi A (2017) I-AIM (indication, acquisition, interpretation, medical decision-making) framework for point of care lung ultrasound. Anesthesiology. 127:568–582. https://doi.org/10.1097/ALN.0000000000001779
Vercesi V, Pisani L, van Tongeren PSI, Lagrand WK, Leopold SJ, Huson MMA et al (2018) External confirmation and exploration of the Kigali modification for diagnosing moderate or severe ARDS. Intensive Care Med 44:523–524. https://doi.org/10.1007/s00134-018-5048-5
Volpicelli G, Elbarbary M, Blaivas M, Lichtenstein DA, Mathis G, Kirkpatrick AW et al (2012) International evidence-based recommendations for point-of-care lung ultrasound. Intensive Care Med 38:577–591
Monastesse A, Girard F, Massicotte N, Chartrand-Lefebvre C, Girard M (2017) Lung ultrasonography for the assessment of perioperative atelectasis: a pilot feasibility study. Anesth Analg 124:494–504. https://doi.org/10.1213/ANE.0000000000001603
Bouhemad B, Brisson H, Le-Guen M, Arbelot C, Lu Q, Rouby J-J (2011) Bedside ultrasound assessment of positive end-expiratory pressure-induced lung recruitment. Am J Respir Crit Care Med 183:341–347. https://doi.org/10.1164/rccm.201003-0369OC
Enghard P, Rademacher S, Nee J, Hasper D, Engert U, Jörres A et al (2015) Simplified lung ultrasound protocol shows excellent prediction of extravascular lung water in ventilated intensive care patients. Crit Care 19:36
Bouhemad B, Liu ZH, Arbelot C, Zhang M, Ferarri F, Le-Guen M et al (2010) Ultrasound assessment of antibiotic-induced pulmonary reaeration in ventilator-associated pneumonia. Crit Care Med 38:84–92
Rouby J-J, Arbelot C, Gao Y, Zhang M, Lv J, An Y et al (2018) Training for lung ultrasound score measurement in critically ill patients. Am J Respir Crit Care Med 198:398–401. https://doi.org/10.1164/rccm.201802-0227LE
Chiumello D, Mongodi S, Algieri I, Vergani GL, Orlando A, Via G et al (2018) Assessment of lung aeration and recruitment by CT scan and ultrasound in acute respiratory distress syndrome patients. Crit Care Med 46(11):1761–1768. https://doi.org/10.1097/CCM.0000000000003340
Tierney DM, Boland LL, Overgaard JD, Huelster JS, Jorgenson A, Normington JP et al (2018) Pulmonary ultrasound scoring system for intubated critically ill patients and its association with clinical metrics and mortality: a prospective cohort study. J Clin Ultrasound 46:14–22. https://doi.org/10.1002/jcu.22526
Yu X, Zhai Z, Zhao Y, Zhu Z, Tong J, Yan J et al (2016) Performance of lung ultrasound in detecting peri-operative atelectasis after general anesthesia. Ultrasound Med Biol 42:2775–2784
Bilotta F, Giudici LD, Zeppa IO, Guerra C, Stazi E, Rosa G (2013) Ultrasound imaging and use of B-lines for functional lung evaluation in neurocritical care. Eur J Anaesthesiol 30:464–468. https://doi.org/10.1097/EJA.0b013e32835fe4a4
Mongodi S, Via G, Girard M, Rouquette I, Misset B, Braschi A et al (2016) Lung ultrasound for early diagnosis of ventilator-associated pneumonia. Chest. 149:969–980. https://doi.org/10.1016/j.chest.2015.12.012
The ARDS Definition Task Force, Ranieri VM, Rubenfeld GD, Thompson BT, Ferguson ND, Caldwell E et al (2012) Acute respiratory distress syndrome: the Berlin Definition. JAMA 307:1. https://doi.org/10.1001/jama.2012.5669
Definition Task Force ARDS, Ranieri VM, Rubenfeld GD, Thompson BT, Ferguson ND, Caldwell E et al (2012) Acute respiratory distress syndrome. JAMA. 307:2526–2533. https://doi.org/10.1001/jama.2012.5669
Bouhemad B, Mongodi S, Via G, Rouquette I (2015) Ultrasound for “lung monitoring” of ventilated patients. Anesthesiology. 122:437–447
DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 44:837–845 http://www.ncbi.nlm.nih.gov/pubmed/3203132. Accessed 17 Aug 2018
Youden WJ (1950) Index for rating diagnostic tests. Cancer. 3:32–35. https://doi.org/10.1002/1097-0142
van Stralen KJ, Stel VS, Reitsma JB, Dekker FW, Zoccali C, Jager KJ (2009) Diagnostic methods I: sensitivity, specificity, and other measures of accuracy. Kidney Int 75:1257–1263. https://doi.org/10.1038/ki.2009.92
Bellani G, Gattinoni L, Van HF, Larsson A, Mcauley DF, Ranieri M et al (2016) Epidemiology, patterns of care, and mortality for patients with acute respiratory distress syndrome in intensive care units in 50 countries. JAMA. 315:2526–2533
Haddam M, Zieleskiewicz L, Perbet S, Baldovini A, Guervilly C, Arbelot C et al (2016) Lung ultrasonography for assessment of oxygenation response to prone position ventilation in ARDS. Intensive Care Med 42:1546–1556. https://doi.org/10.1007/s00134-016-4411-7
Zhao Z, Jiang L, Xi X, Jiang Q, Zhu B, Wang M et al (2015) Prognostic value of extravascular lung water assessed with lung ultrasound score by chest sonography in patients with acute respiratory distress syndrome. BMC Pulm Med 15:98. https://doi.org/10.1186/s12890-015-0091-2
Li L, Yang Q, Li L, Guan J, Liu Z, Han J et al (2015) The value of lung ultrasound score on evaluating clinical severity and prognosis in patients with acute respiratory distress syndrome. Zhonghua Wei Zhong Bing Ji Jiu Yi Xue 27:579–584. https://doi.org/10.3760/cma.j.issn.2095-4352.2015.07.008.
Smit M, Pisani L, Simonis F, Schultz M (2018) Lung aeration as assessed by lung ultrasound is independent of tidal volume size in intensive care unit patients with invasive ventilation. In: Acute Critical Care European Respiratory Society, p OA3299. https://doi.org/10.1183/13993003.congress-2018.OA3299
Schultz MJ, de Pont A-C (2011) Prone or PEEP, PEEP and prone. Intensive Care Med 37:366–367. https://doi.org/10.1007/s00134-010-2070-7
Copetti R, Soldati G, Copetti P (2008) Chest sonography: a useful tool to differentiate acute cardiogenic pulmonary edema from acute respiratory distress syndrome. Cardiovasc Ultrasound 6:16
No funding was received for this study. This article did not receive sponsorship for publication.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author and the Lung Ultrasound Consortium on reasonable request.
About this supplement
This article has been published as part of the supplement Intensive Care Medicine Experimental Volume 7 Supplement 1 2019: Proceedings from the Third International Symposium on Acute Pulmonary Injury and Translational Research (INSPIRES III). The full contents of the supplement are available at https://icm-experimental.springeropen.com/articles/supplements/volume-7-supplement-1.
Ethics approval and consent to participate
The study was approved by the Institutional Review Board of the Academic Medical Center (approval W17_353 #17.411). The need for written informed consent was waived seen the observational nature of the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.