Skip to main content

Advertisement

You are viewing the new article page. Let us know what you think. Return to old version

Volume 3 Supplement 1

ESICM LIVES 2015

Agreement in the assessment of practical skills in basic CPR between observers and a CPR mannequin with a specific software

Introduction

Conducting a training activity usually involves assessing to students the knowledge and/or the skills acquired. Assessment methods must be objectives and representatives of the item being evaluated and able to ensure their independence from the evaluator. The assessment of practical skills in cardiopulmonary resuscitation (CPR) acquired by a student during a training course conforming the quality criteria for CPR on adults (2010 International Guidelines on Resuscitation 1), continues to be accomplished currently by observers. Increasingly, other objective methods of assessment (CPR manikin with specific 2 software, mechanical devices, etc.) of these skills with an excellent degree of accuracy and feedback, are being extended. The correct evaluation of these practical skills is crucial to ensure their correct acquisition, as a first step to the translation into clinical practice.

Objectives

To check the agreement between three different observers to each other and with a mechanical device with a specific software for CPR.

Methods

Descriptive and univariate analysis according to Cohen´s Kappa coefficient and the intraclass correlation coefficient (ICC). 54 volunteers, health workers, with training and experience in CPR, performed a complete sequence of basic CPR maneuvers in a dummy (Laerdal PC v 4.2.1 Skill Reporting Software) (L). Three expert instructors (A, B and C) in teaching courses in CPR evaluated, visually, the performing of correct external chest compressions regarding the placement of the hands, depth compression and decompression, and rate. We analyze the concordance between the observers (A, B and C) among themselves and with L.

Results

Table 1 shows the mean scores of A, B, C and L for the 54 students. Table 2 shows the crude concordance, the value of Cohen´s kappa coefficient and the ICC. Figure 1 shows the Bland and Altmann graphics. We can observe that the degree of agreement and uniformity among the 4 evaluators are poor, and there is a high degree of dispersion without a defined trend.

Figure 1
figure1

Bland and Altmann graphics.

Table 1 Mean scores
Table 2 Concordance between pairs of evaluators

Conclusions

The CPR skills assessment in a visual way by expert evaluators is associated with an important lack of agreement and a high dispersion. At present, it must pose routinely the use of mechanical devices for training and evaluation of these skills.

References

  1. 1.

    Michael R Sayre, Rudolph W Koster, Martin Botha , Diana M. Cave, Michael T. Cudnik, Anthony J. Handley, Tetsuo Hatanaka , Mary Fran Hazinski , Ian Jacobs , Koen Monsieurs , Peter T. Morley, Jerry P. Nolan, Andrew H. Travers: Part 5: Adult Basic Life Support 2010 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science WithTreatment Recommendations. Circulation. 2010, 122 (S298): S324-

  2. 2.

    Zhang FL, Yan L, Huang SF, Bai XJ: Correlations between quality indexes of chest compression. World J Emerg Med. 2013, 4: 54-8.

Download references

Author information

Correspondence to R Algarte.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Intraclass Correlation Coefficient
  • Kappa Coefficient
  • Specific Software
  • Chest Compression
  • Mechanical Device