Biomed Pap Med Fac Univ Palacky Olomouc Czech Repub. 2011, 155(3):275-281 | DOI: 10.5507/bp.2011.041

INTER-OBSERVER REPRODUCIBILITY OF 15 TESTS USED FOR PREDICTING DIFFICULT INTUBATION

Milan Adamusa, Ondrej Jorb, Tereza Vavreckovab, Lumir Hrabalekc, Jana Zapletalovad,e, Tomas Gabrhelika, Hana Tomaskovaf, Vladimir Janoutg
a Department of Anesthesiology and Intensive Care Medicine, University Hospital Olomouc and Faculty of Medicine and Dentistry, Palacky University Olomouc, Czech Republic
b Faculty of Medicine and Dentistry, Palacky University Olomouc
c Department of Neurosurgery, University Hospital Olomouc and Faculty of Medicine and Dentistry, Palacky University Olomouc
d Department of Medical Biophysics, Faculty of Medicine and Dentistry, Palacky University Olomouc
e Institute of Molecular and Translational Medicine, Faculty of Medicine and Dentistry, Palacky University Olomouc
f Department of Epidemiology and Public Health, Faculty of Medicine, Ostrava University
g Department of Preventive Medicine, Faculty of Medicine and Dentistry, Palacky University Olomouc

Aim: To determine the inter-observer reproducibility of 15 tests used for predicting difficult tracheal intubation (DI).

Material and methods: Following local ethics committee approval and informed consent, 101 volunteers were examined by two assessors using 15 tests for predicting DI. The two assessors who were blinded to the results of the other, examined each volunteer independently. Cohen's kappa (κ) or first-order agreement coefficient (AC1) were used to measure agreement between assessor ratings on a qualitative scale. Agreement between two quantitative outcomes was described using the intraclass correlation coefficient (ICC) and Pearson's (PCC) or Spearman's (SCC) correlation coefficients. The following interpretation of the coefficients was used: poor (< 0.20), fair (0.21-0.40), satisfactory (0.41-0.60), good (0.61-0.80), and excellent (0.81-1.00).

Results: Respective coefficients of inter-rater agreement and correlation coefficients were determined for the following parameters: pathologies associated with DI (κ=0.662, AC1=0.990), clinical impression (κ=-0.013, AC1=0.969), modified Mallampati test (κ=0.503, AC1=0.861), upper lip bite test (κ=0.370, AC1=0.897), temporo-mandibular joint movement (κ=0.088, AC1=0.797), max. anteroflexion of C-spine (ICC=0.136, SCC=0.391), max. retroflexion of C-spine (ICC=0.020, SCC=0.284), mandibular length (ICC=0.301, SCC=0.553), neck circumference (ICC=0.832, SCC=0.928), hyo-mental distance (ICC=0.378, SCC=0.472), thyro-mental distance (ICC=-0.002, PCC=0.265), sternomental distance (ICC=0.674, PCC=0.815), and finally, inter-incisor gap (ICC=0.695, PCC=0.785). Two tests (positive history of DI and retrogenia), were excluded from calculation because no positive cases were found.

Conclusion: Best inter-rater agreement was found for the assessment of neck circumference while the highest discrepancies between raters were in goniometrically-measured mobility of the C-spine. Many of the pre-operative airway tests had only fair inter-observer reproducibility. This may be one reason why models for predicting difficult intubation are not universally reliable.

Keywords: Reproducibility, Prediction, Difficult intubation, Inter-Observer Variability

Received: May 17, 2011; Accepted: July 12, 2011; Published: September 1, 2011  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Adamus, M., Jor, O., Vavreckova, T., Hrabalek, L., Zapletalova, J., Gabrhelik, T., Tomaskova, H., & Janout, V. (2011). INTER-OBSERVER REPRODUCIBILITY OF 15 TESTS USED FOR PREDICTING DIFFICULT INTUBATION. Biomedical papers155(3), 275-281. doi: 10.5507/bp.2011.041
Download citation

References

  1. Lee A, Fan LT, Gin T, Karmakar MK, Ngan Kee WD. A systematic review (meta-analysis) of the accuracy of the Mallampati tests to predict the difficult airway. Anesth Analg 2006;102:1867-78. Go to original source... Go to PubMed...
  2. Bindra A, Prabhakar H, Singh GP, Ali Z, Singhal V. Is the modified Mallampati test performed in supine position a reliable predictor of difficult tracheal intubation? J Anesth 2010;24:482-5. Go to original source... Go to PubMed...
  3. Adamus M. Comment on the article by Bindra A et al. Is the modified Mallampati test performed in supine position a reliable predictor of difficult tracheal intubation? J Anesth 2011;25:135. Go to original source... Go to PubMed...
  4. Law JA. Relying on just a few predictors of easy airway management may bite back! Anesth Analg 2008;106:668. Go to original source... Go to PubMed...
  5. Naguib M, Scamman FL, O'Sullivan C, Aker J, Ross AF, Kosmach S, Ensor JE. Predictive performance of three multivariate difficult tracheal intubation models: a double-blind, case-controlled study. Anesth Analg 2006;102:818-24. Go to original source... Go to PubMed...
  6. Wilson ME, Spiegelhalter D, Robertson JA, Lesser P. Predicting difficult intubation. Br J Anaesth 1988;61:211-6. Go to original source... Go to PubMed...
  7. Arné J, Descoins P, Fusciardi J, Ingrand P, Ferrier B, Boudigues D, Aris J. Preoperative assessment for difficult intubation in general and ENT surgery: predictive value of a clinical multivariate risk index. Br J Anaesth 1998;80:140-6. Go to original source... Go to PubMed...
  8. Rosenstock C, Gillesberg I, Gätke MR, Levin D, Kristensen MS, Rasmussen LS. Inter-observer agreement of tests used for prediction of difficult laryngoscopy/tracheal intubation. Acta Anaesthesiol Scand 2005;49:1057-62. Go to original source... Go to PubMed...
  9. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;Feb 8;1(8476):307-10. Go to original source... Go to PubMed...
  10. Hilditch WG, Kopka A, Crawford JM, Asbury AJ. Interobserver reliability between a nurse and anaesthetist of tests used for predicting difficult tracheal intubation. Anaesthesia 2004;59:881-4. Go to original source... Go to PubMed...
  11. Karkouti K, Rose DK, Ferris LE, Wigglesworth DF, Meisami-Fard T, Lee H. Inter-observer reliability of ten tests used for predicting difficult tracheal intubation. Can J Anaesth 1996;43:554-9. Go to original source... Go to PubMed...
  12. Uebersax JS. Kappa Coefficients. Cited [2011, April 11]. Available from: http://www.john-uebersax.com/stat/kappa.htm
  13. Ben-David A. Comparison of classification accuracy using Cohens Weighted Kappa. Expert Systems with Applications 2008;34:825- 32. Go to original source...
  14. Gwet KL. Computing inter-rater reliability and its variance in the presence of high agreement. Br J Math Stat Psychol 2008;61:29-48. Go to original source... Go to PubMed...
  15. Blood E, Spratt KF. Disagreement on Agreement: Two Alternative Agreement Coefficients. Statistics and Data Analysis. SAS Global Forum 2007. Paper 1862007. Cited [2011, April 11, 2011]. Available from: http://www2.sas.com/proceedings/forum2007/ 186-2007.pdf
  16. Samsoon GL, Young JR. Difficult tracheal intubation: a retrospective study. Anaesthesia 1987;42:487-90. Go to original source... Go to PubMed...
  17. Khan ZH, Kashfi A, Ebrahimkhani E. A comparison of the upper lip bite test (a simple new technique) with modified Mallampati classification in predicting difficulty in endotracheal intubation: a prospective blinded study. Anesth Analg 2003;96:595-9. Go to original source... Go to PubMed...
  18. Hester CE, Dietrich SA, White SW. A comparison of preoperative airway assessment techniques: the modified Mallampati and the upper lip bite test. AANA J 2007;75:177-82. Go to PubMed...
  19. Myneni N, O'Leary AM, Sandison M, Roberts K. Evaluation of the upper lip bite test in predicting difficult laryngoscopy. J Clin Anesth 2010;22:174-8. Go to original source... Go to PubMed...
  20. Orozco-Diaz E, Alvarez-Rios JJ, Arceo-Diaz JL, Ornelas-Aguirre JM. Predictive factors of difficult airway with known assessment scales. Cir Cir 2010;78:393-9. Go to PubMed...
  21. Torres K, Patel AA, Stylinski K, Blonski M, Torres A, Staskiewicz G, Maciejewski R, Wojtaszek M. The body constitution of patients and intubation scales as predictors of difficult intubation considered in relation to the experience of the intubator. Folia Morphol (Warsz). 2008;67:171-4. Go to PubMed...
  22. Merino Garcia M, Marcos Vidal JM, Garcia Pelaz R, Diez Buron F, Espaa Fuente L, Bermejo Gonzalez JC. Evaluation of a protocol for predicting difficult airway in routine practice: interobserver agreement. Rev Esp Anestesiol Reanim 2010;57:473-8. Go to original source... Go to PubMed...